[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:15:14.788869 22720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.48.62:34129
I20260709 12:15:14.790458 22720 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:15:14.791610 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:14.808679 22726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:14.808677 22727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:14.811121 22720 server_base.cc:1061] running on GCE node
W20260709 12:15:14.809494 22729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:16.014000 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:16.014282 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:16.014528 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599316014497 us; error 0 us; skew 500 ppm
I20260709 12:15:16.015369 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:16.020721 22720 webserver.cc:533] Webserver started at http://127.22.48.62:34039/ using document root <none> and password file <none>
I20260709 12:15:16.021615 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:16.021880 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:16.022383 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:16.028244 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/master-0-root/instance:
uuid: "a42eb2a847ae428b999ca36f6229af89"
format_stamp: "Formatted at 2026-07-09 12:15:16 on dist-test-slave-044g"
I20260709 12:15:16.036150 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:15:16.041684 22735 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.043123 22720 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:15:16.043429 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/master-0-root
uuid: "a42eb2a847ae428b999ca36f6229af89"
format_stamp: "Formatted at 2026-07-09 12:15:16 on dist-test-slave-044g"
I20260709 12:15:16.043728 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:16.111788 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:16.113296 22720 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:15:16.113710 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:16.184677 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.62:34129
I20260709 12:15:16.184760 22786 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.62:34129 every 8 connection(s)
I20260709 12:15:16.192368 22787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:16.214188 22787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89: Bootstrap starting.
I20260709 12:15:16.220296 22787 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:16.222127 22787 log.cc:826] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89: Log is configured to *not* fsync() on all Append() calls
I20260709 12:15:16.226758 22787 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89: No bootstrap required, opened a new log
I20260709 12:15:16.247159 22787 raft_consensus.cc:359] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42eb2a847ae428b999ca36f6229af89" member_type: VOTER }
I20260709 12:15:16.247707 22787 raft_consensus.cc:385] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:16.247905 22787 raft_consensus.cc:740] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a42eb2a847ae428b999ca36f6229af89, State: Initialized, Role: FOLLOWER
I20260709 12:15:16.248836 22787 consensus_queue.cc:260] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42eb2a847ae428b999ca36f6229af89" member_type: VOTER }
I20260709 12:15:16.249302 22787 raft_consensus.cc:399] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:16.249540 22787 raft_consensus.cc:493] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:16.249820 22787 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:16.253773 22787 raft_consensus.cc:515] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42eb2a847ae428b999ca36f6229af89" member_type: VOTER }
I20260709 12:15:16.254454 22787 leader_election.cc:304] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a42eb2a847ae428b999ca36f6229af89; no voters: 
I20260709 12:15:16.256102 22787 leader_election.cc:290] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:16.256456 22790 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:16.258661 22790 raft_consensus.cc:697] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 1 LEADER]: Becoming Leader. State: Replica: a42eb2a847ae428b999ca36f6229af89, State: Running, Role: LEADER
I20260709 12:15:16.259627 22790 consensus_queue.cc:237] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42eb2a847ae428b999ca36f6229af89" member_type: VOTER }
I20260709 12:15:16.260666 22787 sys_catalog.cc:565] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:16.269608 22792 sys_catalog.cc:455] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a42eb2a847ae428b999ca36f6229af89. Latest consensus state: current_term: 1 leader_uuid: "a42eb2a847ae428b999ca36f6229af89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42eb2a847ae428b999ca36f6229af89" member_type: VOTER } }
I20260709 12:15:16.269873 22791 sys_catalog.cc:455] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a42eb2a847ae428b999ca36f6229af89" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a42eb2a847ae428b999ca36f6229af89" member_type: VOTER } }
I20260709 12:15:16.270444 22791 sys_catalog.cc:458] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:16.270444 22792 sys_catalog.cc:458] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:16.273612 22798 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:16.285662 22798 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:16.288787 22720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:16.302973 22798 catalog_manager.cc:1383] Generated new cluster ID: 11f3206d81d547a7964fb8c62f249090
I20260709 12:15:16.303289 22798 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:16.332098 22798 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:16.333787 22798 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:16.352346 22798 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89: Generated new TSK 0
I20260709 12:15:16.353423 22798 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:16.420579 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:16.430334 22809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:16.431774 22810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:16.435315 22720 server_base.cc:1061] running on GCE node
W20260709 12:15:16.435506 22812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:16.436424 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:16.436617 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:16.436826 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599316436793 us; error 0 us; skew 500 ppm
I20260709 12:15:16.437431 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:16.441888 22720 webserver.cc:533] Webserver started at http://127.22.48.1:38553/ using document root <none> and password file <none>
I20260709 12:15:16.442471 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:16.442682 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:16.442974 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:16.444064 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-0-root/instance:
uuid: "23e6751435fb4899b4271bfccb192385"
format_stamp: "Formatted at 2026-07-09 12:15:16 on dist-test-slave-044g"
I20260709 12:15:16.449698 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:15:16.454205 22817 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.455093 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:15:16.455375 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "23e6751435fb4899b4271bfccb192385"
format_stamp: "Formatted at 2026-07-09 12:15:16 on dist-test-slave-044g"
I20260709 12:15:16.455646 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:16.475472 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:16.477109 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:16.480192 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:16.485419 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:16.485656 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.486027 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:16.486194 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.596972 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:34819
I20260709 12:15:16.597048 22879 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:34819 every 8 connection(s)
I20260709 12:15:16.604168 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:16.617725 22884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:16.629937 22885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:16.630921 22720 server_base.cc:1061] running on GCE node
W20260709 12:15:16.632598 22887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:16.633662 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:16.633917 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:16.634138 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599316634117 us; error 0 us; skew 500 ppm
I20260709 12:15:16.634958 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:16.638216 22880 heartbeater.cc:344] Connected to a master server at 127.22.48.62:34129
I20260709 12:15:16.638725 22880 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:16.638880 22720 webserver.cc:533] Webserver started at http://127.22.48.2:44067/ using document root <none> and password file <none>
I20260709 12:15:16.639355 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:16.639523 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:16.639736 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:16.639837 22880 heartbeater.cc:507] Master 127.22.48.62:34129 requested a full tablet report, sending...
I20260709 12:15:16.640736 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-1-root/instance:
uuid: "f9d01a4199814e0694db9696be3054c3"
format_stamp: "Formatted at 2026-07-09 12:15:16 on dist-test-slave-044g"
I20260709 12:15:16.643347 22752 ts_manager.cc:194] Registered new tserver with Master: 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819)
I20260709 12:15:16.646256 22752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41200
I20260709 12:15:16.648075 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.006s
I20260709 12:15:16.653196 22892 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.654088 22720 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 12:15:16.654407 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-1-root
uuid: "f9d01a4199814e0694db9696be3054c3"
format_stamp: "Formatted at 2026-07-09 12:15:16 on dist-test-slave-044g"
I20260709 12:15:16.654706 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:16.675212 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:16.676551 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:16.679119 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:16.682654 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:16.682832 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.683140 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:16.683296 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.777828 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.2:43063
I20260709 12:15:16.778025 22954 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.2:43063 every 8 connection(s)
I20260709 12:15:16.786561 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:16.793092 22958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:16.796656 22959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:16.799746 22720 server_base.cc:1061] running on GCE node
W20260709 12:15:16.800457 22961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:16.801565 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:16.801806 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:16.802012 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599316801994 us; error 0 us; skew 500 ppm
I20260709 12:15:16.802773 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:16.805600 22955 heartbeater.cc:344] Connected to a master server at 127.22.48.62:34129
I20260709 12:15:16.805953 22955 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:16.806872 22720 webserver.cc:533] Webserver started at http://127.22.48.3:38773/ using document root <none> and password file <none>
I20260709 12:15:16.806980 22955 heartbeater.cc:507] Master 127.22.48.62:34129 requested a full tablet report, sending...
I20260709 12:15:16.807636 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:16.807924 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:16.808287 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:16.809581 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-2-root/instance:
uuid: "a302b1fe229f4823bba82472f7669f86"
format_stamp: "Formatted at 2026-07-09 12:15:16 on dist-test-slave-044g"
I20260709 12:15:16.809585 22752 ts_manager.cc:194] Registered new tserver with Master: f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:16.811514 22752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41216
I20260709 12:15:16.814949 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:15:16.819092 22966 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.819964 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:15:16.820262 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-2-root
uuid: "a302b1fe229f4823bba82472f7669f86"
format_stamp: "Formatted at 2026-07-09 12:15:16 on dist-test-slave-044g"
I20260709 12:15:16.820526 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599314612061-22720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:16.833994 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:16.835230 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:16.837946 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:16.841411 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:16.841634 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.841946 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:16.842087 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:16.935774 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.3:41289
I20260709 12:15:16.935873 23028 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.3:41289 every 8 connection(s)
I20260709 12:15:16.951355 23029 heartbeater.cc:344] Connected to a master server at 127.22.48.62:34129
I20260709 12:15:16.951810 23029 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:16.952957 23029 heartbeater.cc:507] Master 127.22.48.62:34129 requested a full tablet report, sending...
I20260709 12:15:16.955516 22752 ts_manager.cc:194] Registered new tserver with Master: a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:16.955742 22720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015087301s
I20260709 12:15:16.957231 22752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41232
I20260709 12:15:17.006597 22752 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41244:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:17.010484 22752 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:17.113210 22994 tablet_service.cc:1511] Processing CreateTablet for tablet 8324aaf80dd244bd97b38cc38b3313fe (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:17.113556 22993 tablet_service.cc:1511] Processing CreateTablet for tablet 20f84af7089a463494ee86f95fd98e8a (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:17.115830 22992 tablet_service.cc:1511] Processing CreateTablet for tablet 3937e63580634894931a96316149504d (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:17.116854 22991 tablet_service.cc:1511] Processing CreateTablet for tablet d82b7d913c984a6a835e96bd82383cd3 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:17.119836 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8324aaf80dd244bd97b38cc38b3313fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.122020 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3937e63580634894931a96316149504d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.121701 22990 tablet_service.cc:1511] Processing CreateTablet for tablet f0b1c182fe0b48e6969e4ffc1b48c0cf (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:17.123060 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b1c182fe0b48e6969e4ffc1b48c0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.126771 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f84af7089a463494ee86f95fd98e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.132411 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82b7d913c984a6a835e96bd82383cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.135389 22989 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8d8ab76f294e53964036fe114d52f0 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:17.138348 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8d8ab76f294e53964036fe114d52f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.151144 22920 tablet_service.cc:1511] Processing CreateTablet for tablet 8324aaf80dd244bd97b38cc38b3313fe (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:17.154671 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8324aaf80dd244bd97b38cc38b3313fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.154759 22919 tablet_service.cc:1511] Processing CreateTablet for tablet 20f84af7089a463494ee86f95fd98e8a (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:17.160653 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f84af7089a463494ee86f95fd98e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.164635 22988 tablet_service.cc:1511] Processing CreateTablet for tablet 50faeb359c874bd28d57da5acc71007f (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:17.176343 22988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50faeb359c874bd28d57da5acc71007f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.164016 22845 tablet_service.cc:1511] Processing CreateTablet for tablet 8324aaf80dd244bd97b38cc38b3313fe (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:17.187724 22845 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8324aaf80dd244bd97b38cc38b3313fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.193356 22839 tablet_service.cc:1511] Processing CreateTablet for tablet 50faeb359c874bd28d57da5acc71007f (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:17.194115 22841 tablet_service.cc:1511] Processing CreateTablet for tablet f0b1c182fe0b48e6969e4ffc1b48c0cf (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:17.199939 22918 tablet_service.cc:1511] Processing CreateTablet for tablet 3937e63580634894931a96316149504d (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:17.187145 22844 tablet_service.cc:1511] Processing CreateTablet for tablet 20f84af7089a463494ee86f95fd98e8a (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:17.208839 23047 tablet_bootstrap.cc:492] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86: Bootstrap starting.
I20260709 12:15:17.202316 22843 tablet_service.cc:1511] Processing CreateTablet for tablet 3937e63580634894931a96316149504d (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:17.211280 22842 tablet_service.cc:1511] Processing CreateTablet for tablet d82b7d913c984a6a835e96bd82383cd3 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:17.204021 22915 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8d8ab76f294e53964036fe114d52f0 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:17.214614 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3937e63580634894931a96316149504d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.215754 22839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50faeb359c874bd28d57da5acc71007f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.208796 22917 tablet_service.cc:1511] Processing CreateTablet for tablet d82b7d913c984a6a835e96bd82383cd3 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:17.218488 22838 tablet_service.cc:1511] Processing CreateTablet for tablet 06be7cc62642471f9fb9ea54e5965014 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:17.214061 22990 tablet_service.cc:1511] Processing CreateTablet for tablet 06be7cc62642471f9fb9ea54e5965014 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:17.218405 22840 tablet_service.cc:1511] Processing CreateTablet for tablet 7d8d8ab76f294e53964036fe114d52f0 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:17.211432 22916 tablet_service.cc:1511] Processing CreateTablet for tablet f0b1c182fe0b48e6969e4ffc1b48c0cf (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:17.229869 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8d8ab76f294e53964036fe114d52f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.230890 22990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06be7cc62642471f9fb9ea54e5965014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.231580 22914 tablet_service.cc:1511] Processing CreateTablet for tablet 50faeb359c874bd28d57da5acc71007f (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:17.231806 22913 tablet_service.cc:1511] Processing CreateTablet for tablet 06be7cc62642471f9fb9ea54e5965014 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:17.238819 22837 tablet_service.cc:1511] Processing CreateTablet for tablet dd2040e5d0084269bce20a1df98718a5 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:17.242720 22913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06be7cc62642471f9fb9ea54e5965014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.239446 22841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b1c182fe0b48e6969e4ffc1b48c0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.254684 22840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d8d8ab76f294e53964036fe114d52f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.256806 22843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3937e63580634894931a96316149504d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.258703 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82b7d913c984a6a835e96bd82383cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.259539 22842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82b7d913c984a6a835e96bd82383cd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.266938 22844 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20f84af7089a463494ee86f95fd98e8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.268767 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0b1c182fe0b48e6969e4ffc1b48c0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.279349 22838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06be7cc62642471f9fb9ea54e5965014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.271346 22912 tablet_service.cc:1511] Processing CreateTablet for tablet dd2040e5d0084269bce20a1df98718a5 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:17.287602 22837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2040e5d0084269bce20a1df98718a5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:17.302783 22800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:17.289724 22914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50faeb359c874bd28d57da5acc71007f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.304039 22912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2040e5d0084269bce20a1df98718a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.310760 22989 tablet_service.cc:1511] Processing CreateTablet for tablet dd2040e5d0084269bce20a1df98718a5 (DEFAULT_TABLE table=test-workload [id=72fbe95a7bb64e00aba1963c079c1695]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:17.315896 22989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd2040e5d0084269bce20a1df98718a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:17.357561 23048 tablet_bootstrap.cc:492] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3: Bootstrap starting.
I20260709 12:15:17.391988 23047 tablet_bootstrap.cc:654] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.452783 23048 tablet_bootstrap.cc:654] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.461362 23049 tablet_bootstrap.cc:492] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385: Bootstrap starting.
I20260709 12:15:17.464700 23047 tablet_bootstrap.cc:492] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86: No bootstrap required, opened a new log
I20260709 12:15:17.465406 23047 ts_tablet_manager.cc:1403] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86: Time spent bootstrapping tablet: real 0.271s	user 0.008s	sys 0.019s
I20260709 12:15:17.469393 23048 tablet_bootstrap.cc:492] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3: No bootstrap required, opened a new log
I20260709 12:15:17.469862 23048 ts_tablet_manager.cc:1403] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.004s
I20260709 12:15:17.472790 23049 tablet_bootstrap.cc:654] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.477092 23048 raft_consensus.cc:359] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:17.478196 23048 raft_consensus.cc:385] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.478626 23048 raft_consensus.cc:740] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.479611 23048 consensus_queue.cc:260] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:17.481491 23047 raft_consensus.cc:359] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.482208 23047 raft_consensus.cc:385] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.482542 23047 raft_consensus.cc:740] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.483263 23047 consensus_queue.cc:260] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.487185 22955 heartbeater.cc:499] Master 127.22.48.62:34129 was elected leader, sending a full tablet report...
I20260709 12:15:17.487880 23048 ts_tablet_manager.cc:1434] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.007s
I20260709 12:15:17.490778 23048 tablet_bootstrap.cc:492] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3: Bootstrap starting.
I20260709 12:15:17.500072 23029 heartbeater.cc:499] Master 127.22.48.62:34129 was elected leader, sending a full tablet report...
I20260709 12:15:17.501299 23049 tablet_bootstrap.cc:492] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385: No bootstrap required, opened a new log
I20260709 12:15:17.501766 23049 ts_tablet_manager.cc:1403] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.002s
I20260709 12:15:17.502962 23048 tablet_bootstrap.cc:654] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.503971 23047 ts_tablet_manager.cc:1434] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.006s
I20260709 12:15:17.504951 23047 tablet_bootstrap.cc:492] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86: Bootstrap starting.
I20260709 12:15:17.507107 23049 raft_consensus.cc:359] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:17.508078 23049 raft_consensus.cc:385] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.508466 23049 raft_consensus.cc:740] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.509378 23049 consensus_queue.cc:260] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:17.519032 23047 tablet_bootstrap.cc:654] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:17.536465 22956 tablet.cc:2406] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:17.544716 22880 heartbeater.cc:499] Master 127.22.48.62:34129 was elected leader, sending a full tablet report...
I20260709 12:15:17.545346 23049 ts_tablet_manager.cc:1434] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385: Time spent starting tablet: real 0.043s	user 0.017s	sys 0.005s
I20260709 12:15:17.546615 23049 tablet_bootstrap.cc:492] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385: Bootstrap starting.
I20260709 12:15:17.555033 23049 tablet_bootstrap.cc:654] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.559516 23047 tablet_bootstrap.cc:492] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86: No bootstrap required, opened a new log
I20260709 12:15:17.560120 23047 ts_tablet_manager.cc:1403] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86: Time spent bootstrapping tablet: real 0.055s	user 0.010s	sys 0.012s
I20260709 12:15:17.562716 23048 tablet_bootstrap.cc:492] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3: No bootstrap required, opened a new log
I20260709 12:15:17.563182 23048 ts_tablet_manager.cc:1403] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3: Time spent bootstrapping tablet: real 0.073s	user 0.019s	sys 0.046s
I20260709 12:15:17.563069 23047 raft_consensus.cc:359] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:17.563829 23047 raft_consensus.cc:385] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.564132 23047 raft_consensus.cc:740] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.564858 23047 consensus_queue.cc:260] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:17.566078 23048 raft_consensus.cc:359] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.566819 23048 raft_consensus.cc:385] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.567122 23048 raft_consensus.cc:740] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.567265 23047 ts_tablet_manager.cc:1434] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:17.567847 23048 consensus_queue.cc:260] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.568962 23047 tablet_bootstrap.cc:492] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86: Bootstrap starting.
I20260709 12:15:17.570470 23048 ts_tablet_manager.cc:1434] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:15:17.571377 23048 tablet_bootstrap.cc:492] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3: Bootstrap starting.
I20260709 12:15:17.578660 23048 tablet_bootstrap.cc:654] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.581380 23049 tablet_bootstrap.cc:492] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385: No bootstrap required, opened a new log
I20260709 12:15:17.581938 23049 ts_tablet_manager.cc:1403] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.004s
I20260709 12:15:17.585592 23049 raft_consensus.cc:359] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.586556 23049 raft_consensus.cc:385] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.586930 23049 raft_consensus.cc:740] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.587747 23049 consensus_queue.cc:260] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.589828 23049 ts_tablet_manager.cc:1434] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260709 12:15:17.590152 23048 tablet_bootstrap.cc:492] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3: No bootstrap required, opened a new log
I20260709 12:15:17.590601 23048 ts_tablet_manager.cc:1403] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 12:15:17.590845 23047 tablet_bootstrap.cc:654] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.593470 23048 raft_consensus.cc:359] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.594026 23049 tablet_bootstrap.cc:492] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385: Bootstrap starting.
I20260709 12:15:17.594197 23048 raft_consensus.cc:385] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.594513 23048 raft_consensus.cc:740] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.596522 23048 consensus_queue.cc:260] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.599213 23048 ts_tablet_manager.cc:1434] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:15:17.600411 23048 tablet_bootstrap.cc:492] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3: Bootstrap starting.
I20260709 12:15:17.603753 23047 tablet_bootstrap.cc:492] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86: No bootstrap required, opened a new log
I20260709 12:15:17.604257 23047 ts_tablet_manager.cc:1403] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.001s
I20260709 12:15:17.607056 23048 tablet_bootstrap.cc:654] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.607281 23047 raft_consensus.cc:359] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.608016 23047 raft_consensus.cc:385] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.608381 23047 raft_consensus.cc:740] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.612709 23049 tablet_bootstrap.cc:654] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.614665 23047 consensus_queue.cc:260] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.617486 23047 ts_tablet_manager.cc:1434] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:15:17.618649 23047 tablet_bootstrap.cc:492] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86: Bootstrap starting.
I20260709 12:15:17.626014 23053 raft_consensus.cc:493] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.626667 23053 raft_consensus.cc:515] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.631882 23053 leader_election.cc:290] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:17.640159 23047 tablet_bootstrap.cc:654] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.645251 23049 tablet_bootstrap.cc:492] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385: No bootstrap required, opened a new log
I20260709 12:15:17.645404 23048 tablet_bootstrap.cc:492] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3: No bootstrap required, opened a new log
I20260709 12:15:17.645923 23049 ts_tablet_manager.cc:1403] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.014s
I20260709 12:15:17.646116 23048 ts_tablet_manager.cc:1403] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.007s
I20260709 12:15:17.653330 23056 raft_consensus.cc:493] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.653793 23056 raft_consensus.cc:515] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:17.654099 23049 raft_consensus.cc:359] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.655104 23049 raft_consensus.cc:385] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.655472 23049 raft_consensus.cc:740] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.656201 23056 leader_election.cc:290] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:17.658967 23048 raft_consensus.cc:359] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.659451 23049 consensus_queue.cc:260] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.687572 23049 ts_tablet_manager.cc:1434] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
I20260709 12:15:17.688606 23049 tablet_bootstrap.cc:492] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385: Bootstrap starting.
I20260709 12:15:17.665282 23048 raft_consensus.cc:385] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.690431 23048 raft_consensus.cc:740] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.691599 23048 consensus_queue.cc:260] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.699304 23047 tablet_bootstrap.cc:492] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86: No bootstrap required, opened a new log
I20260709 12:15:17.700080 23047 ts_tablet_manager.cc:1403] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.015s
I20260709 12:15:17.703016 23047 raft_consensus.cc:359] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.703920 23047 raft_consensus.cc:385] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.704260 23047 raft_consensus.cc:740] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.705031 23047 consensus_queue.cc:260] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.707999 23054 raft_consensus.cc:493] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.708446 23054 raft_consensus.cc:515] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.712523 23048 ts_tablet_manager.cc:1434] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3: Time spent starting tablet: real 0.066s	user 0.010s	sys 0.009s
I20260709 12:15:17.713354 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86" is_pre_election: true
I20260709 12:15:17.713742 23048 tablet_bootstrap.cc:492] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3: Bootstrap starting.
W20260709 12:15:17.720376 22895 leader_election.cc:343] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:17.727685 23054 leader_election.cc:290] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:17.728194 23049 tablet_bootstrap.cc:654] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.731835 23048 tablet_bootstrap.cc:654] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.737324 23047 ts_tablet_manager.cc:1434] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 12:15:17.738292 23047 tablet_bootstrap.cc:492] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86: Bootstrap starting.
I20260709 12:15:17.744951 23048 tablet_bootstrap.cc:492] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3: No bootstrap required, opened a new log
I20260709 12:15:17.745420 23048 ts_tablet_manager.cc:1403] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 12:15:17.748699 23047 tablet_bootstrap.cc:654] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.748308 23048 raft_consensus.cc:359] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.749094 23048 raft_consensus.cc:385] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.749402 23048 raft_consensus.cc:740] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.759202 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:17.760663 23056 raft_consensus.cc:493] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.760756 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:17.761251 23056 raft_consensus.cc:515] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.762297 22855 raft_consensus.cc:2468] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 0.
I20260709 12:15:17.763391 23056 leader_election.cc:290] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:17.764653 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:17.765645 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
W20260709 12:15:17.766376 22967 leader_election.cc:343] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:17.766371 22929 raft_consensus.cc:2468] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 0.
I20260709 12:15:17.760114 22930 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 0.
I20260709 12:15:17.777678 22893 leader_election.cc:304] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: a302b1fe229f4823bba82472f7669f86
I20260709 12:15:17.778422 22818 leader_election.cc:304] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:17.767688 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86" is_pre_election: true
I20260709 12:15:17.779222 23056 raft_consensus.cc:2804] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:17.779261 23004 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 0.
I20260709 12:15:17.779387 22818 leader_election.cc:304] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:17.779713 23056 raft_consensus.cc:493] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.779935 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:17.780125 23056 raft_consensus.cc:3060] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.780972 23053 raft_consensus.cc:2804] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:17.781363 23053 raft_consensus.cc:493] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:15:17.781644 22967 leader_election.cc:343] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:17.782316 22967 leader_election.cc:304] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a302b1fe229f4823bba82472f7669f86; no voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3
I20260709 12:15:17.782995 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86" is_pre_election: true
I20260709 12:15:17.774380 23049 tablet_bootstrap.cc:492] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385: No bootstrap required, opened a new log
I20260709 12:15:17.784428 23049 ts_tablet_manager.cc:1403] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385: Time spent bootstrapping tablet: real 0.096s	user 0.019s	sys 0.007s
I20260709 12:15:17.750120 23048 consensus_queue.cc:260] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.781754 23053 raft_consensus.cc:3060] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.785238 23054 raft_consensus.cc:493] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:15:17.785270 22820 leader_election.cc:343] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:17.781826 23047 tablet_bootstrap.cc:492] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86: No bootstrap required, opened a new log
I20260709 12:15:17.785750 23054 raft_consensus.cc:515] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.794036 23056 raft_consensus.cc:515] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.795531 23077 raft_consensus.cc:2804] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:17.796017 23047 ts_tablet_manager.cc:1403] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86: Time spent bootstrapping tablet: real 0.058s	user 0.008s	sys 0.004s
I20260709 12:15:17.798422 23077 raft_consensus.cc:493] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.798836 23077 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.797012 23054 leader_election.cc:290] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:17.794474 23053 raft_consensus.cc:515] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.802621 23054 raft_consensus.cc:2749] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:17.797631 23049 raft_consensus.cc:359] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.803627 23049 raft_consensus.cc:385] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.804059 23049 raft_consensus.cc:740] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.805146 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:17.805168 23049 consensus_queue.cc:260] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.805986 23053 leader_election.cc:290] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:17.807490 22855 raft_consensus.cc:2393] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f9d01a4199814e0694db9696be3054c3 in current term 1: Already voted for candidate 23e6751435fb4899b4271bfccb192385 in this term.
I20260709 12:15:17.810482 23056 leader_election.cc:290] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 election: Requested vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:17.811430 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:17.811704 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:17.812250 22929 raft_consensus.cc:2393] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 23e6751435fb4899b4271bfccb192385 in current term 1: Already voted for candidate f9d01a4199814e0694db9696be3054c3 in this term.
I20260709 12:15:17.813184 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
W20260709 12:15:17.813257 22967 leader_election.cc:343] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:17.814586 22967 leader_election.cc:343] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:17.815130 22967 leader_election.cc:304] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a302b1fe229f4823bba82472f7669f86; no voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3
I20260709 12:15:17.815618 23003 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:17.816032 23054 raft_consensus.cc:2749] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:17.808780 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:17.802017 23047 raft_consensus.cc:359] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.817049 23047 raft_consensus.cc:385] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.817365 23047 raft_consensus.cc:740] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Initialized, Role: FOLLOWER
W20260709 12:15:17.817529 22820 leader_election.cc:343] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:17.817809 22895 leader_election.cc:343] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:17.818178 23047 consensus_queue.cc:260] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.820461 23047 ts_tablet_manager.cc:1434] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:15:17.820628 22893 leader_election.cc:304] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9d01a4199814e0694db9696be3054c3; no voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86
I20260709 12:15:17.823087 23049 ts_tablet_manager.cc:1434] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 12:15:17.823643 23047 tablet_bootstrap.cc:492] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86: Bootstrap starting.
I20260709 12:15:17.824273 23049 tablet_bootstrap.cc:492] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385: Bootstrap starting.
I20260709 12:15:17.822355 22818 leader_election.cc:304] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23e6751435fb4899b4271bfccb192385; no voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3
I20260709 12:15:17.826707 23053 raft_consensus.cc:2749] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:17.835958 23080 raft_consensus.cc:2749] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:17.838147 23054 raft_consensus.cc:493] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.838635 23054 raft_consensus.cc:515] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.839825 23048 ts_tablet_manager.cc:1434] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3: Time spent starting tablet: real 0.094s	user 0.015s	sys 0.006s
I20260709 12:15:17.840806 23048 tablet_bootstrap.cc:492] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3: Bootstrap starting.
I20260709 12:15:17.840878 23054 leader_election.cc:290] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:17.846329 23047 tablet_bootstrap.cc:654] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.847622 23049 tablet_bootstrap.cc:654] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.842010 23077 raft_consensus.cc:515] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:17.849071 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:17.849486 23048 tablet_bootstrap.cc:654] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.851459 22930 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 0.
I20260709 12:15:17.852425 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:17.854655 22967 leader_election.cc:304] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:17.855397 23054 raft_consensus.cc:2804] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:17.855741 23054 raft_consensus.cc:493] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.853056 22855 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 0.
I20260709 12:15:17.856107 23054 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.857263 23077 leader_election.cc:290] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 election: Requested vote from peers a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:17.858132 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:17.858340 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:17.858733 22930 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.859033 23004 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.863446 23054 raft_consensus.cc:515] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.865463 23054 leader_election.cc:290] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:17.866576 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:17.867138 22854 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.867558 23004 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 1.
I20260709 12:15:17.868717 22820 leader_election.cc:304] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:17.869616 23077 raft_consensus.cc:2804] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:17.870759 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:17.871038 23077 raft_consensus.cc:697] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:17.871539 22929 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.872732 23054 raft_consensus.cc:493] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:17.873350 23054 raft_consensus.cc:515] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.893234 22930 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 1.
I20260709 12:15:17.881135 22854 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 1.
I20260709 12:15:17.896764 23047 tablet_bootstrap.cc:492] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86: No bootstrap required, opened a new log
I20260709 12:15:17.896864 22967 leader_election.cc:304] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:17.897490 23047 ts_tablet_manager.cc:1403] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.007s
I20260709 12:15:17.897976 23078 raft_consensus.cc:2804] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:17.904320 23054 leader_election.cc:290] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:17.905755 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:17.906448 23078 raft_consensus.cc:697] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Becoming Leader. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:17.906567 22855 raft_consensus.cc:2468] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 0.
I20260709 12:15:17.906204 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:17.901476 22929 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 1.
I20260709 12:15:17.908393 23049 tablet_bootstrap.cc:492] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385: No bootstrap required, opened a new log
I20260709 12:15:17.908679 22928 raft_consensus.cc:2468] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 0.
I20260709 12:15:17.909013 23049 ts_tablet_manager.cc:1403] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385: Time spent bootstrapping tablet: real 0.085s	user 0.019s	sys 0.002s
I20260709 12:15:17.892745 23077 consensus_queue.cc:237] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:17.908118 22967 leader_election.cc:304] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:17.910880 23084 raft_consensus.cc:2804] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:17.911489 23084 raft_consensus.cc:493] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:17.911952 23084 raft_consensus.cc:3060] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.907346 23078 consensus_queue.cc:237] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.913604 23049 raft_consensus.cc:359] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.910503 23047 raft_consensus.cc:359] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.915916 23049 raft_consensus.cc:385] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.919570 23047 raft_consensus.cc:385] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.923182 23049 raft_consensus.cc:740] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.923243 23047 raft_consensus.cc:740] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.924201 23047 consensus_queue.cc:260] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.926648 23047 ts_tablet_manager.cc:1434] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.012s
I20260709 12:15:17.926581 23049 consensus_queue.cc:260] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.927763 23047 tablet_bootstrap.cc:492] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86: Bootstrap starting.
I20260709 12:15:17.927805 23084 raft_consensus.cc:515] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.929248 23049 ts_tablet_manager.cc:1434] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:15:17.931049 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:17.931649 22854 raft_consensus.cc:3060] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.931869 23084 leader_election.cc:290] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:17.920421 23048 tablet_bootstrap.cc:492] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3: No bootstrap required, opened a new log
I20260709 12:15:17.933089 23048 ts_tablet_manager.cc:1403] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3: Time spent bootstrapping tablet: real 0.092s	user 0.021s	sys 0.024s
I20260709 12:15:17.930218 23049 tablet_bootstrap.cc:492] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385: Bootstrap starting.
I20260709 12:15:17.935195 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:17.935792 22930 raft_consensus.cc:3060] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:17.936383 23048 raft_consensus.cc:359] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.937080 23048 raft_consensus.cc:385] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:17.937412 23048 raft_consensus.cc:740] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Initialized, Role: FOLLOWER
I20260709 12:15:17.938331 23048 consensus_queue.cc:260] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.943881 22854 raft_consensus.cc:2468] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 1.
I20260709 12:15:17.945200 22967 leader_election.cc:304] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:17.946132 23084 raft_consensus.cc:2804] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:17.946636 23084 raft_consensus.cc:697] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Becoming Leader. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:17.947461 23084 consensus_queue.cc:237] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:17.943881 22930 raft_consensus.cc:2468] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 1.
I20260709 12:15:17.951902 23048 ts_tablet_manager.cc:1434] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:15:17.962634 22749 catalog_manager.cc:5697] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to a302b1fe229f4823bba82472f7669f86 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a302b1fe229f4823bba82472f7669f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:17.985879 23047 tablet_bootstrap.cc:654] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:17.985154 22752 catalog_manager.cc:5697] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:17.987457 23048 tablet_bootstrap.cc:492] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3: Bootstrap starting.
I20260709 12:15:17.997483 23047 tablet_bootstrap.cc:492] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86: No bootstrap required, opened a new log
I20260709 12:15:18.136083 23047 ts_tablet_manager.cc:1403] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86: Time spent bootstrapping tablet: real 0.209s	user 0.019s	sys 0.053s
I20260709 12:15:18.138445 23047 raft_consensus.cc:359] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.139185 23047 raft_consensus.cc:385] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.139482 23047 raft_consensus.cc:740] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.140360 23047 consensus_queue.cc:260] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.140872 23048 tablet_bootstrap.cc:654] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:18.145740 23084 raft_consensus.cc:493] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.146678 23049 tablet_bootstrap.cc:654] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:18.146337 23084 raft_consensus.cc:515] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.148682 23084 leader_election.cc:290] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:18.150874 23047 ts_tablet_manager.cc:1434] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 12:15:18.153308 23047 tablet_bootstrap.cc:492] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86: Bootstrap starting.
I20260709 12:15:18.158198 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:18.161639 22930 raft_consensus.cc:2468] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 0.
I20260709 12:15:18.163090 23079 raft_consensus.cc:493] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.163218 22967 leader_election.cc:304] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.163609 23079 raft_consensus.cc:515] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.164096 23084 raft_consensus.cc:2804] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:18.164491 23084 raft_consensus.cc:493] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.164855 23084 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.166165 23079 leader_election.cc:290] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:18.166796 23047 tablet_bootstrap.cc:654] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:18.167635 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86" is_pre_election: true
W20260709 12:15:18.169579 22895 leader_election.cc:343] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:18.173612 23049 tablet_bootstrap.cc:492] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385: No bootstrap required, opened a new log
I20260709 12:15:18.174818 23049 ts_tablet_manager.cc:1403] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385: Time spent bootstrapping tablet: real 0.245s	user 0.008s	sys 0.013s
I20260709 12:15:18.173596 23084 raft_consensus.cc:515] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.181197 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:18.181916 22930 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.181039 23049 raft_consensus.cc:359] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.184646 23049 raft_consensus.cc:385] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.184908 23049 raft_consensus.cc:740] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.186502 23048 tablet_bootstrap.cc:492] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3: No bootstrap required, opened a new log
I20260709 12:15:18.186985 23048 ts_tablet_manager.cc:1403] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3: Time spent bootstrapping tablet: real 0.200s	user 0.036s	sys 0.042s
I20260709 12:15:18.190153 23049 consensus_queue.cc:260] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.193069 23049 ts_tablet_manager.cc:1434] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:15:18.193588 23084 leader_election.cc:290] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:18.194070 23049 tablet_bootstrap.cc:492] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385: Bootstrap starting.
I20260709 12:15:18.196024 22930 raft_consensus.cc:2468] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 1.
I20260709 12:15:18.196480 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:18.197636 22967 leader_election.cc:304] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.198521 23084 raft_consensus.cc:2804] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:18.199168 23084 raft_consensus.cc:697] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Becoming Leader. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:18.198998 23048 raft_consensus.cc:359] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.199786 23048 raft_consensus.cc:385] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.200103 23048 raft_consensus.cc:740] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.201262 23048 consensus_queue.cc:260] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.202582 23049 tablet_bootstrap.cc:654] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:18.202744 22893 leader_election.cc:343] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:18.203177 22893 leader_election.cc:304] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f9d01a4199814e0694db9696be3054c3; no voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86
I20260709 12:15:18.203980 23048 ts_tablet_manager.cc:1434] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 12:15:18.204533 23079 raft_consensus.cc:2749] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:18.200102 23084 consensus_queue.cc:237] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.208210 23048 tablet_bootstrap.cc:492] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3: Bootstrap starting.
I20260709 12:15:18.216894 23047 tablet_bootstrap.cc:492] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86: No bootstrap required, opened a new log
I20260709 12:15:18.217356 23047 ts_tablet_manager.cc:1403] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.010s
I20260709 12:15:18.218241 23048 tablet_bootstrap.cc:654] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:18.223021 23049 tablet_bootstrap.cc:492] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385: No bootstrap required, opened a new log
I20260709 12:15:18.222590 23047 raft_consensus.cc:359] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.223542 23049 ts_tablet_manager.cc:1403] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.004s
I20260709 12:15:18.223556 23047 raft_consensus.cc:385] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.224133 23047 raft_consensus.cc:740] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.226260 23047 consensus_queue.cc:260] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.227337 23049 raft_consensus.cc:359] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.228130 23049 raft_consensus.cc:385] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.228363 23047 ts_tablet_manager.cc:1434] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:15:18.228487 23049 raft_consensus.cc:740] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.229403 23047 tablet_bootstrap.cc:492] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86: Bootstrap starting.
I20260709 12:15:18.229329 23049 consensus_queue.cc:260] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.231067 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:18.231726 22855 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.231789 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:18.240345 23048 tablet_bootstrap.cc:492] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3: No bootstrap required, opened a new log
I20260709 12:15:18.240118 22855 raft_consensus.cc:2468] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 1.
I20260709 12:15:18.241222 23048 ts_tablet_manager.cc:1403] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.012s
I20260709 12:15:18.231745 23049 ts_tablet_manager.cc:1434] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:18.247747 23049 tablet_bootstrap.cc:492] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385: Bootstrap starting.
I20260709 12:15:18.249620 23048 raft_consensus.cc:359] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.250340 23048 raft_consensus.cc:385] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.250636 23048 raft_consensus.cc:740] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.252094 23047 tablet_bootstrap.cc:654] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:18.254426 23048 consensus_queue.cc:260] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.265933 23048 ts_tablet_manager.cc:1434] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:15:18.270920 23048 tablet_bootstrap.cc:492] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3: Bootstrap starting.
I20260709 12:15:18.331840 23047 tablet_bootstrap.cc:492] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86: No bootstrap required, opened a new log
I20260709 12:15:18.332891 23047 ts_tablet_manager.cc:1403] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.022s
I20260709 12:15:18.335479 23047 raft_consensus.cc:359] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.336549 23047 raft_consensus.cc:385] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.336989 23047 raft_consensus.cc:740] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.337720 23047 consensus_queue.cc:260] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.338583 23056 raft_consensus.cc:493] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.339061 23056 raft_consensus.cc:515] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.339931 23047 ts_tablet_manager.cc:1434] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:15:18.342065 23056 leader_election.cc:290] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:18.368479 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:18.369112 22930 raft_consensus.cc:2468] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 0.
I20260709 12:15:18.370265 22818 leader_election.cc:304] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.371212 23056 raft_consensus.cc:2804] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:18.371598 23056 raft_consensus.cc:493] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.371953 23056 raft_consensus.cc:3060] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.380139 23056 raft_consensus.cc:515] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.383500 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:18.384111 22930 raft_consensus.cc:3060] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.384670 23056 leader_election.cc:290] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 election: Requested vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:18.391166 22930 raft_consensus.cc:2468] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 1.
I20260709 12:15:18.392416 23048 tablet_bootstrap.cc:654] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:18.392426 22818 leader_election.cc:304] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.394845 23056 raft_consensus.cc:2804] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:18.395316 23056 raft_consensus.cc:697] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:18.398185 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:18.398648 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86" is_pre_election: true
I20260709 12:15:18.398873 23002 raft_consensus.cc:3060] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.396130 23056 consensus_queue.cc:237] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.401679 23084 raft_consensus.cc:493] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.403532 23084 raft_consensus.cc:515] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.403712 23078 consensus_queue.cc:1048] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:18.426738 23077 raft_consensus.cc:493] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.428172 23077 raft_consensus.cc:515] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.431736 23084 leader_election.cc:290] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:18.432296 23077 leader_election.cc:290] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:18.443624 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86" is_pre_election: true
I20260709 12:15:18.444010 23002 raft_consensus.cc:2468] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 1.
I20260709 12:15:18.444288 23004 raft_consensus.cc:2468] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 0.
W20260709 12:15:18.446228 22800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:18.446766 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:18.446942 22749 catalog_manager.cc:5697] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to a302b1fe229f4823bba82472f7669f86 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a302b1fe229f4823bba82472f7669f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:18.453833 22930 raft_consensus.cc:2468] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 0.
I20260709 12:15:18.453999 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:18.455549 22855 raft_consensus.cc:2393] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a302b1fe229f4823bba82472f7669f86 in current term 1: Already voted for candidate 23e6751435fb4899b4271bfccb192385 in this term.
I20260709 12:15:18.455636 22818 leader_election.cc:304] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.453473 22749 catalog_manager.cc:5697] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 reported cstate change: term changed from 0 to 1, leader changed from <none> to a302b1fe229f4823bba82472f7669f86 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a302b1fe229f4823bba82472f7669f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:18.456789 23077 raft_consensus.cc:2804] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:18.457141 23077 raft_consensus.cc:493] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.457477 23077 raft_consensus.cc:3060] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.459059 23080 consensus_queue.cc:1048] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:18.459517 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:18.460290 22930 raft_consensus.cc:2393] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a302b1fe229f4823bba82472f7669f86 in current term 1: Already voted for candidate f9d01a4199814e0694db9696be3054c3 in this term.
I20260709 12:15:18.463570 23048 tablet_bootstrap.cc:492] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3: No bootstrap required, opened a new log
I20260709 12:15:18.464229 23078 consensus_queue.cc:1048] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:18.464459 22967 leader_election.cc:304] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a302b1fe229f4823bba82472f7669f86; no voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3
I20260709 12:15:18.466205 23048 ts_tablet_manager.cc:1403] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3: Time spent bootstrapping tablet: real 0.199s	user 0.021s	sys 0.004s
I20260709 12:15:18.465838 23084 raft_consensus.cc:3060] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.469179 23049 tablet_bootstrap.cc:654] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:18.487722 23054 raft_consensus.cc:493] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.488291 23054 raft_consensus.cc:515] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.492231 23054 leader_election.cc:290] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:18.494021 23054 consensus_queue.cc:1048] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:18.494450 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:18.495494 23048 raft_consensus.cc:359] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.496798 23048 raft_consensus.cc:385] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.497175 23048 raft_consensus.cc:740] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.498099 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:18.499037 23048 consensus_queue.cc:260] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
W20260709 12:15:18.499475 22967 leader_election.cc:343] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:18.500232 23084 raft_consensus.cc:2749] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:15:18.504858 22967 leader_election.cc:343] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:18.505282 22967 leader_election.cc:304] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a302b1fe229f4823bba82472f7669f86; no voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3
I20260709 12:15:18.505652 23048 ts_tablet_manager.cc:1434] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.001s
I20260709 12:15:18.500555 23077 raft_consensus.cc:515] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.511153 23084 raft_consensus.cc:2749] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:18.529929 23077 leader_election.cc:290] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 election: Requested vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:18.530696 22929 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:18.534976 22929 raft_consensus.cc:3060] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.531082 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:18.536531 23004 raft_consensus.cc:3060] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.553877 23056 consensus_queue.cc:1048] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:18.598331 22750 catalog_manager.cc:5697] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.607191 22929 raft_consensus.cc:2468] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 1.
I20260709 12:15:18.608824 22818 leader_election.cc:304] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.610078 23113 raft_consensus.cc:2804] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:18.618475 23004 raft_consensus.cc:2468] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 1.
I20260709 12:15:18.632274 23113 raft_consensus.cc:697] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:18.633165 23113 consensus_queue.cc:237] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.637053 23112 consensus_queue.cc:1048] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:18.639417 23049 tablet_bootstrap.cc:492] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385: No bootstrap required, opened a new log
I20260709 12:15:18.639858 23049 ts_tablet_manager.cc:1403] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385: Time spent bootstrapping tablet: real 0.392s	user 0.023s	sys 0.017s
I20260709 12:15:18.643937 23049 raft_consensus.cc:359] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.644685 23049 raft_consensus.cc:385] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.644937 23049 raft_consensus.cc:740] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.646840 23049 consensus_queue.cc:260] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.654932 23049 ts_tablet_manager.cc:1434] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:15:18.660805 23049 tablet_bootstrap.cc:492] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385: Bootstrap starting.
I20260709 12:15:18.672219 23053 raft_consensus.cc:493] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.674590 23053 raft_consensus.cc:515] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.686415 23084 consensus_queue.cc:1048] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:18.693590 23053 leader_election.cc:290] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:18.694639 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86" is_pre_election: true
I20260709 12:15:18.694792 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:18.695293 23002 raft_consensus.cc:2468] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 0.
I20260709 12:15:18.695523 22855 raft_consensus.cc:2468] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 0.
I20260709 12:15:18.696585 22895 leader_election.cc:304] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.699275 23053 raft_consensus.cc:2804] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:18.699024 23078 consensus_queue.cc:1048] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:18.700249 23053 raft_consensus.cc:493] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.701733 23053 raft_consensus.cc:3060] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.742962 23049 tablet_bootstrap.cc:654] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:18.746644 22751 catalog_manager.cc:5697] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.738354 23053 raft_consensus.cc:515] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.755399 23053 leader_election.cc:290] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:18.756453 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:18.757242 23002 raft_consensus.cc:3060] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.764946 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:18.765715 22855 raft_consensus.cc:3060] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.772922 23049 tablet_bootstrap.cc:492] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385: No bootstrap required, opened a new log
I20260709 12:15:18.773435 23049 ts_tablet_manager.cc:1403] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385: Time spent bootstrapping tablet: real 0.118s	user 0.015s	sys 0.011s
I20260709 12:15:18.773401 23002 raft_consensus.cc:2468] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 1.
I20260709 12:15:18.774827 22895 leader_election.cc:304] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.775648 23053 raft_consensus.cc:2804] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:18.776129 23053 raft_consensus.cc:697] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:18.777004 23049 raft_consensus.cc:359] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.776952 23053 consensus_queue.cc:237] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.779793 22855 raft_consensus.cc:2468] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 1.
I20260709 12:15:18.781622 23049 raft_consensus.cc:385] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:18.781947 23049 raft_consensus.cc:740] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Initialized, Role: FOLLOWER
I20260709 12:15:18.783842 23049 consensus_queue.cc:260] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.793988 23049 ts_tablet_manager.cc:1434] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:15:18.799691 22751 catalog_manager.cc:5697] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.844316 23053 raft_consensus.cc:493] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:18.844939 23053 raft_consensus.cc:515] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.847128 23053 leader_election.cc:290] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:18.848341 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385" is_pre_election: true
I20260709 12:15:18.848368 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86" is_pre_election: true
I20260709 12:15:18.849056 22855 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 0.
I20260709 12:15:18.849195 23002 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 0.
I20260709 12:15:18.850461 22893 leader_election.cc:304] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.851461 23053 raft_consensus.cc:2804] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:18.851868 23053 raft_consensus.cc:493] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:18.852253 23053 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.859084 23053 raft_consensus.cc:515] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.862025 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:18.862623 22855 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.863991 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:18.864565 23002 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:18.869001 22855 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 1.
I20260709 12:15:18.870354 22893 leader_election.cc:304] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:18.871142 23079 raft_consensus.cc:2804] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:18.871371 23053 leader_election.cc:290] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 1 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:18.872119 23002 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 1.
I20260709 12:15:18.874400 23079 raft_consensus.cc:697] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:18.875370 23079 consensus_queue.cc:237] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:18.884256 22751 catalog_manager.cc:5697] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:18.899731 23113 consensus_queue.cc:1048] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:18.911464 23056 consensus_queue.cc:1048] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:19.185803 23056 consensus_queue.cc:1048] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:19.196403 23080 consensus_queue.cc:1048] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:19.205837 23123 consensus_queue.cc:1048] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:19.225414 23079 consensus_queue.cc:1048] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:19.284634 22876 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 22723
W20260709 12:15:19.285368 22876 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 22786
W20260709 12:15:19.286058 22876 debug-util.cc:398] Leaking SignalData structure 0x7b08001cde20 after lost signal to thread 22879
W20260709 12:15:19.286727 22876 debug-util.cc:398] Leaking SignalData structure 0x7b080014aa20 after lost signal to thread 22954
W20260709 12:15:19.287359 22876 debug-util.cc:398] Leaking SignalData structure 0x7b080018acc0 after lost signal to thread 23028
W20260709 12:15:19.287737 22876 debug-util.cc:398] Leaking SignalData structure 0x7b080018a6a0 after lost signal to thread 23063
W20260709 12:15:19.288003 22876 debug-util.cc:398] Leaking SignalData structure 0x7b080018a820 after lost signal to thread 23070
W20260709 12:15:19.288264 22876 debug-util.cc:398] Leaking SignalData structure 0x7b080018a200 after lost signal to thread 23072
W20260709 12:15:19.457052 22800 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:19.461468 23079 consensus_queue.cc:1048] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:19.479591 23123 consensus_queue.cc:1048] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:19.558137 23056 raft_consensus.cc:493] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:19.558981 23056 raft_consensus.cc:515] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:19.562840 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3" is_pre_election: true
I20260709 12:15:19.563439 22930 raft_consensus.cc:2468] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 1.
I20260709 12:15:19.564599 23056 leader_election.cc:290] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:19.564846 22818 leader_election.cc:304] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:19.565932 23056 raft_consensus.cc:2804] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:19.566113 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86" is_pre_election: true
I20260709 12:15:19.566450 23056 raft_consensus.cc:493] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:19.566807 23002 raft_consensus.cc:2468] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 1.
I20260709 12:15:19.567142 23056 raft_consensus.cc:3060] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.574726 23056 raft_consensus.cc:515] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:19.577630 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:19.577826 23056 leader_election.cc:290] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 election: Requested vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:19.578230 22930 raft_consensus.cc:3060] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.581768 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:19.582496 23002 raft_consensus.cc:3060] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.588039 22930 raft_consensus.cc:2468] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 2.
I20260709 12:15:19.589795 22818 leader_election.cc:304] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:19.590919 23056 raft_consensus.cc:2804] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:19.591528 23056 raft_consensus.cc:697] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:19.592571 23056 consensus_queue.cc:237] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:19.596086 23002 raft_consensus.cc:2468] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 2.
I20260709 12:15:19.604489 22749 catalog_manager.cc:5697] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 0 to 2, leader changed from <none> to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:19.729163 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
mode: GRACEFUL
new_leader_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:15:19.729949 23002 raft_consensus.cc:606] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Received request to transfer leadership to TS 23e6751435fb4899b4271bfccb192385
I20260709 12:15:19.736155 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3937e63580634894931a96316149504d"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
mode: GRACEFUL
new_leader_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:15:19.736825 23002 raft_consensus.cc:606] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Received request to transfer leadership to TS 23e6751435fb4899b4271bfccb192385
I20260709 12:15:19.753938 22930 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
mode: GRACEFUL
new_leader_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:58020
I20260709 12:15:19.754693 22930 raft_consensus.cc:606] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Received request to transfer leadership to TS 23e6751435fb4899b4271bfccb192385
I20260709 12:15:19.770226 22855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
mode: GRACEFUL
new_leader_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:43700
I20260709 12:15:19.771023 22855 raft_consensus.cc:606] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Received request to transfer leadership to TS f9d01a4199814e0694db9696be3054c3
I20260709 12:15:19.776532 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
mode: GRACEFUL
new_leader_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:15:19.777204 23002 raft_consensus.cc:606] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Received request to transfer leadership to TS f9d01a4199814e0694db9696be3054c3
I20260709 12:15:19.785495 22855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
mode: GRACEFUL
new_leader_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:43700
I20260709 12:15:19.786171 22855 raft_consensus.cc:606] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Received request to transfer leadership to TS f9d01a4199814e0694db9696be3054c3
I20260709 12:15:19.791167 22855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
mode: GRACEFUL
new_leader_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:43700
I20260709 12:15:19.791798 22855 raft_consensus.cc:606] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Received request to transfer leadership to TS a302b1fe229f4823bba82472f7669f86
I20260709 12:15:19.845368 23141 raft_consensus.cc:993] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86: : Instructing follower 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:19.845898 23078 raft_consensus.cc:1081] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Signalling peer 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:19.847741 22855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3937e63580634894931a96316149504d"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:43698
I20260709 12:15:19.848371 22855 raft_consensus.cc:493] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:19.848841 22855 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.854326 22855 raft_consensus.cc:515] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:19.856967 22855 leader_election.cc:290] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 election: Requested vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:19.857590 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:19.857558 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:19.858412 23002 raft_consensus.cc:3055] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:19.858469 22930 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.858865 23002 raft_consensus.cc:740] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:19.859721 23002 consensus_queue.cc:260] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:19.861200 23002 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:19.863530 22930 raft_consensus.cc:2468] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 2.
I20260709 12:15:19.864701 22818 leader_election.cc:304] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:19.865947 23056 raft_consensus.cc:2804] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:19.866434 23056 raft_consensus.cc:697] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:19.867219 23056 consensus_queue.cc:237] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:19.871088 23002 raft_consensus.cc:2468] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 2.
I20260709 12:15:19.879426 22750 catalog_manager.cc:5697] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 1 to 2, leader changed from a302b1fe229f4823bba82472f7669f86 (127.22.48.3) to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.024659 22930 raft_consensus.cc:1275] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:20.025882 23056 consensus_queue.cc:1048] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:20.035522 23002 raft_consensus.cc:1275] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:20.037197 23056 consensus_queue.cc:1048] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:20.050920 23056 raft_consensus.cc:993] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385: : Instructing follower a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:20.051417 23113 raft_consensus.cc:1081] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Signalling peer a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:20.053128 23002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:38552
I20260709 12:15:20.053762 23002 raft_consensus.cc:493] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:20.054167 23002 raft_consensus.cc:3060] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:20.061535 23002 raft_consensus.cc:515] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.063611 23002 leader_election.cc:290] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 3 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:20.064579 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:20.064920 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd2040e5d0084269bce20a1df98718a5" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:20.065171 22855 raft_consensus.cc:3055] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:20.065466 22930 raft_consensus.cc:3060] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:20.065491 22855 raft_consensus.cc:740] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:20.066381 22855 consensus_queue.cc:260] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.067555 22855 raft_consensus.cc:3060] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:20.072049 22930 raft_consensus.cc:2468] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 3.
I20260709 12:15:20.073194 22967 leader_election.cc:304] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:20.073980 23078 raft_consensus.cc:2804] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:20.074074 22855 raft_consensus.cc:2468] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 3.
I20260709 12:15:20.074569 23078 raft_consensus.cc:697] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 3 LEADER]: Becoming Leader. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:20.075462 23078 consensus_queue.cc:237] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.079561 23113 raft_consensus.cc:993] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385: : Instructing follower f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:20.079974 23080 raft_consensus.cc:1081] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Signalling peer f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:20.081552 22930 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:58000
I20260709 12:15:20.082139 22930 raft_consensus.cc:493] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:20.082559 22930 raft_consensus.cc:3060] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.083338 22750 catalog_manager.cc:5697] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 reported cstate change: term changed from 2 to 3, leader changed from 23e6751435fb4899b4271bfccb192385 (127.22.48.1) to a302b1fe229f4823bba82472f7669f86 (127.22.48.3). New cstate: current_term: 3 leader_uuid: "a302b1fe229f4823bba82472f7669f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:20.090034 22930 raft_consensus.cc:515] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.092772 22930 leader_election.cc:290] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 2 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:20.093968 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:20.094753 23002 raft_consensus.cc:3060] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.093968 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06be7cc62642471f9fb9ea54e5965014" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:20.095997 22855 raft_consensus.cc:3055] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:20.096424 22855 raft_consensus.cc:740] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:20.097465 22855 consensus_queue.cc:260] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.098860 22855 raft_consensus.cc:3060] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.102742 23002 raft_consensus.cc:2468] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 2.
I20260709 12:15:20.103861 22895 leader_election.cc:304] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:20.104564 23053 raft_consensus.cc:2804] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:20.104987 23053 raft_consensus.cc:697] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 2 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:20.105801 23053 consensus_queue.cc:237] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.107122 22855 raft_consensus.cc:2468] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 2.
I20260709 12:15:20.113920 22750 catalog_manager.cc:5697] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 1 to 2, leader changed from 23e6751435fb4899b4271bfccb192385 (127.22.48.1) to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.125759 23141 raft_consensus.cc:993] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86: : Instructing follower 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:20.126195 23078 raft_consensus.cc:1081] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Signalling peer 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:20.127823 22855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:43698
I20260709 12:15:20.128383 22855 raft_consensus.cc:493] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:20.128765 22855 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.135715 22855 raft_consensus.cc:515] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.137923 22855 leader_election.cc:290] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 election: Requested vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:20.138309 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:20.138592 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:20.138904 22930 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.139253 23002 raft_consensus.cc:3055] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:20.139634 23002 raft_consensus.cc:740] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:20.140381 23002 consensus_queue.cc:260] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.141330 23002 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.146060 23002 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 2.
I20260709 12:15:20.146165 22930 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 2.
I20260709 12:15:20.147210 22820 leader_election.cc:304] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:20.148057 23056 raft_consensus.cc:2804] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:20.148537 23056 raft_consensus.cc:697] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:20.149362 23056 consensus_queue.cc:237] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.157848 22750 catalog_manager.cc:5697] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 1 to 2, leader changed from a302b1fe229f4823bba82472f7669f86 (127.22.48.3) to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.180171 23141 raft_consensus.cc:993] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86: : Instructing follower f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:20.180580 23078 raft_consensus.cc:1081] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Signalling peer f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:20.182173 22930 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:58016
I20260709 12:15:20.182727 22930 raft_consensus.cc:493] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:20.183049 22930 raft_consensus.cc:3060] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.187510 22930 raft_consensus.cc:515] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.189076 22930 leader_election.cc:290] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 2 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:20.190117 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:20.190088 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:20.190831 23002 raft_consensus.cc:3055] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:20.190888 22855 raft_consensus.cc:3060] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.191311 23002 raft_consensus.cc:740] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:20.192135 23002 consensus_queue.cc:260] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.193281 23002 raft_consensus.cc:3060] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.197706 22855 raft_consensus.cc:2468] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 2.
I20260709 12:15:20.198969 22893 leader_election.cc:304] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:20.199771 23053 raft_consensus.cc:2804] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:20.199887 23002 raft_consensus.cc:2468] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 2.
I20260709 12:15:20.200296 23053 raft_consensus.cc:697] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 2 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:20.201192 23053 consensus_queue.cc:237] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.208946 22750 catalog_manager.cc:5697] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 1 to 2, leader changed from a302b1fe229f4823bba82472f7669f86 (127.22.48.3) to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.245141 23113 raft_consensus.cc:993] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385: : Instructing follower f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:20.245582 23056 raft_consensus.cc:1081] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Signalling peer f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:20.247201 22930 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:58000
I20260709 12:15:20.247783 22930 raft_consensus.cc:493] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:20.248193 22930 raft_consensus.cc:3060] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.255586 22930 raft_consensus.cc:515] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.257824 22930 leader_election.cc:290] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 2 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:20.258814 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:20.258912 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0b1c182fe0b48e6969e4ffc1b48c0cf" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:20.259482 23002 raft_consensus.cc:3060] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.260102 22855 raft_consensus.cc:3055] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:20.260496 22855 raft_consensus.cc:740] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:20.261348 22930 raft_consensus.cc:1275] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.261451 22855 consensus_queue.cc:260] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.262755 23056 consensus_queue.cc:1048] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.263737 22855 raft_consensus.cc:3060] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.266364 23002 raft_consensus.cc:2468] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 2.
I20260709 12:15:20.267577 22895 leader_election.cc:304] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:20.268365 23053 raft_consensus.cc:2804] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:20.268837 23053 raft_consensus.cc:697] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 2 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:20.269671 23053 consensus_queue.cc:237] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.272250 22855 raft_consensus.cc:2468] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 2.
I20260709 12:15:20.274320 23002 raft_consensus.cc:1275] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.275754 23056 consensus_queue.cc:1048] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.283084 22750 catalog_manager.cc:5697] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 1 to 2, leader changed from 23e6751435fb4899b4271bfccb192385 (127.22.48.1) to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.305848 23053 raft_consensus.cc:993] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3: : Instructing follower 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:20.306345 23053 raft_consensus.cc:1081] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Signalling peer 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:20.308106 22855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:43686
I20260709 12:15:20.308724 22855 raft_consensus.cc:493] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:20.309157 22855 raft_consensus.cc:3060] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.314666 22855 raft_consensus.cc:515] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.316177 22855 leader_election.cc:290] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 election: Requested vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:20.317118 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:20.317305 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:20.317711 22930 raft_consensus.cc:3055] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:20.317848 23002 raft_consensus.cc:3060] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.318084 22930 raft_consensus.cc:740] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:20.318876 22930 consensus_queue.cc:260] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.320075 22930 raft_consensus.cc:3060] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:20.322948 23002 raft_consensus.cc:2468] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 2.
I20260709 12:15:20.323906 22820 leader_election.cc:304] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:20.324573 23056 raft_consensus.cc:2804] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:20.324985 23056 raft_consensus.cc:697] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:20.325765 23056 consensus_queue.cc:237] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:20.326560 22930 raft_consensus.cc:2468] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 2.
I20260709 12:15:20.334013 22751 catalog_manager.cc:5697] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 1 to 2, leader changed from f9d01a4199814e0694db9696be3054c3 (127.22.48.2) to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:20.531440 23002 raft_consensus.cc:1275] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.532794 23056 consensus_queue.cc:1048] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.546972 22930 raft_consensus.cc:1275] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.548184 23113 consensus_queue.cc:1048] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.574695 23002 raft_consensus.cc:1275] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.575922 23123 consensus_queue.cc:1048] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.585876 22855 raft_consensus.cc:1275] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.588562 23123 consensus_queue.cc:1048] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.619273 22855 raft_consensus.cc:1275] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.620630 23123 consensus_queue.cc:1048] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.625859 23002 raft_consensus.cc:1275] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.629323 23123 consensus_queue.cc:1048] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:20.646723 22930 raft_consensus.cc:1275] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:20.651250 23078 consensus_queue.cc:1048] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.668277 22855 raft_consensus.cc:1275] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:20.670447 23078 consensus_queue.cc:1048] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.681203 22855 raft_consensus.cc:1275] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.682823 23123 consensus_queue.cc:1048] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.698107 23002 raft_consensus.cc:1275] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.700001 23079 consensus_queue.cc:1048] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.779188 22928 raft_consensus.cc:1275] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.780680 23113 consensus_queue.cc:1048] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:20.788000 23002 raft_consensus.cc:1275] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:20.789541 23056 consensus_queue.cc:1048] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:22.824224 22720 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:15:22.825004 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:22.841897 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
mode: GRACEFUL
new_leader_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:15:22.842458 22928 raft_consensus.cc:606] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Received request to transfer leadership to TS a302b1fe229f4823bba82472f7669f86
I20260709 12:15:22.853586 22854 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
mode: GRACEFUL
new_leader_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:43702
I20260709 12:15:22.854068 22854 raft_consensus.cc:606] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Received request to transfer leadership to TS a302b1fe229f4823bba82472f7669f86
I20260709 12:15:22.855111 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:22.855551 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:23.276391 23079 raft_consensus.cc:993] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3: : Instructing follower a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:23.276886 23053 raft_consensus.cc:1081] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Signalling peer a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:23.278357 23004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:38538
I20260709 12:15:23.278825 23004 raft_consensus.cc:493] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:23.279114 23004 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:23.283617 23004 raft_consensus.cc:515] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:23.285764 23004 leader_election.cc:290] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 2 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:23.286744 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:23.287215 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:23.287412 22928 raft_consensus.cc:3055] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:23.287794 22854 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:23.287771 22928 raft_consensus.cc:740] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:23.288949 22928 consensus_queue.cc:260] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:23.290112 22928 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:23.291030 23173 raft_consensus.cc:993] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385: : Instructing follower a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:23.291491 23169 raft_consensus.cc:1081] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Signalling peer a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:23.293154 23004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:38552
I20260709 12:15:23.293771 23004 raft_consensus.cc:493] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:23.294147 23004 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:23.294530 22854 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 2.
I20260709 12:15:23.295735 22967 leader_election.cc:304] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:23.295852 22928 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 2.
I20260709 12:15:23.296578 23167 raft_consensus.cc:2804] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:23.297983 23167 raft_consensus.cc:697] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Becoming Leader. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:23.298774 23167 consensus_queue.cc:237] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:23.300843 23004 raft_consensus.cc:515] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:23.302755 23004 leader_election.cc:290] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 2 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:23.303722 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:23.304200 22854 raft_consensus.cc:3055] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:23.304459 22854 raft_consensus.cc:740] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:23.305147 22854 consensus_queue.cc:260] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:23.305446 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:23.306069 22928 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:23.306504 22854 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:23.307358 22750 catalog_manager.cc:5697] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 reported cstate change: term changed from 1 to 2, leader changed from f9d01a4199814e0694db9696be3054c3 (127.22.48.2) to a302b1fe229f4823bba82472f7669f86 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "a302b1fe229f4823bba82472f7669f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:23.311307 22854 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 2.
I20260709 12:15:23.313022 22967 leader_election.cc:304] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:23.313730 22928 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 2.
I20260709 12:15:23.313936 23167 raft_consensus.cc:2804] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:23.314437 23167 raft_consensus.cc:697] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Becoming Leader. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:23.315289 23167 consensus_queue.cc:237] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:23.327301 22749 catalog_manager.cc:5697] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 reported cstate change: term changed from 1 to 2, leader changed from 23e6751435fb4899b4271bfccb192385 (127.22.48.1) to a302b1fe229f4823bba82472f7669f86 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "a302b1fe229f4823bba82472f7669f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:23.774887 22854 raft_consensus.cc:1275] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:23.776239 23167 consensus_queue.cc:1048] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:23.786053 22928 raft_consensus.cc:1275] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:23.788165 23174 consensus_queue.cc:1048] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:23.856609 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:23.862747 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:23.863209 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:23.892902 22928 raft_consensus.cc:1275] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:23.894037 23183 consensus_queue.cc:1048] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:23.901755 22854 raft_consensus.cc:1275] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:23.903033 23183 consensus_queue.cc:1048] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:24.864508 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:24.870093 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:24.870517 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:25.871440 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:25.876111 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:25.876468 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:26.877283 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:26.882643 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:26.883144 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:27.884112 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:27.889137 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:27.889535 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:28.890468 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:28.895102 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:28.895517 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:29.896420 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:29.901219 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:29.901624 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:30.902642 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:30.907511 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:30.907924 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:31.908842 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:31.913997 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:31.914460 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:32.941162 22720 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:15:32.946033 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
mode: GRACEFUL
new_leader_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:15:32.946942 23002 raft_consensus.cc:606] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Received request to transfer leadership to TS f9d01a4199814e0694db9696be3054c3
I20260709 12:15:32.952276 22855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
mode: GRACEFUL
new_leader_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:43700
I20260709 12:15:32.952708 22855 raft_consensus.cc:606] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Received request to transfer leadership to TS f9d01a4199814e0694db9696be3054c3
I20260709 12:15:32.957021 22855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3937e63580634894931a96316149504d"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
mode: GRACEFUL
new_leader_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:43700
I20260709 12:15:32.957432 22855 raft_consensus.cc:606] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Received request to transfer leadership to TS f9d01a4199814e0694db9696be3054c3
I20260709 12:15:32.962087 22855 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
mode: GRACEFUL
new_leader_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:43700
I20260709 12:15:32.962662 22855 raft_consensus.cc:606] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Received request to transfer leadership to TS f9d01a4199814e0694db9696be3054c3
I20260709 12:15:32.972230 23002 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
mode: GRACEFUL
new_leader_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:38562
I20260709 12:15:32.972709 23002 raft_consensus.cc:606] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Received request to transfer leadership to TS f9d01a4199814e0694db9696be3054c3
I20260709 12:15:32.987906 23200 raft_consensus.cc:993] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385: : Instructing follower f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:32.988323 23200 raft_consensus.cc:1081] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Signalling peer f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:32.989727 22928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3937e63580634894931a96316149504d"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:58000
I20260709 12:15:32.990124 22928 raft_consensus.cc:493] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:32.990455 22928 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:32.994951 22928 raft_consensus.cc:515] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:32.997176 22928 leader_election.cc:290] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:32.998090 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:32.998350 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:32.998854 22855 raft_consensus.cc:3055] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:32.998934 23002 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:32.999136 22855 raft_consensus.cc:740] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:32.999877 22855 consensus_queue.cc:260] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.000878 22855 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.003334 23002 raft_consensus.cc:2468] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.004446 22895 leader_election.cc:304] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:33.005227 23197 raft_consensus.cc:2804] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:33.005318 22855 raft_consensus.cc:2468] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.006358 23197 raft_consensus.cc:697] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:33.007197 23197 consensus_queue.cc:237] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.014184 22750 catalog_manager.cc:5697] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 2 to 3, leader changed from 23e6751435fb4899b4271bfccb192385 (127.22.48.1) to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.036373 23201 raft_consensus.cc:993] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385: : Instructing follower f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:33.036828 23200 raft_consensus.cc:1081] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Signalling peer f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:33.038062 22928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:58000
I20260709 12:15:33.038479 22928 raft_consensus.cc:493] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.038700 22928 raft_consensus.cc:3060] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.042418 22928 raft_consensus.cc:515] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.043627 22928 leader_election.cc:290] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:33.044332 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:33.044600 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82b7d913c984a6a835e96bd82383cd3" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:33.044809 22855 raft_consensus.cc:3055] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:33.045087 23002 raft_consensus.cc:3060] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.045120 22855 raft_consensus.cc:740] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:33.045822 22855 consensus_queue.cc:260] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.046610 22855 raft_consensus.cc:3060] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.048873 23002 raft_consensus.cc:2468] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.049664 22895 leader_election.cc:304] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:33.050323 23197 raft_consensus.cc:2804] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:33.050783 22855 raft_consensus.cc:2468] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.050787 23197 raft_consensus.cc:697] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:33.051750 23197 consensus_queue.cc:237] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.057477 22750 catalog_manager.cc:5697] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 2 to 3, leader changed from 23e6751435fb4899b4271bfccb192385 (127.22.48.1) to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.095428 23201 raft_consensus.cc:993] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385: : Instructing follower f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:33.096029 23201 raft_consensus.cc:1081] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Signalling peer f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:33.097544 22928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:58000
I20260709 12:15:33.097971 22928 raft_consensus.cc:493] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.098248 22928 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.102725 22928 raft_consensus.cc:515] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.104774 22928 leader_election.cc:290] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:33.105504 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:33.105865 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:33.106103 22855 raft_consensus.cc:3055] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:33.106365 23002 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.106474 22855 raft_consensus.cc:740] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:33.107220 22855 consensus_queue.cc:260] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.108016 22855 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.110515 23002 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.111418 22895 leader_election.cc:304] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a302b1fe229f4823bba82472f7669f86, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:33.111862 22855 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.112084 23197 raft_consensus.cc:2804] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:33.112561 23197 raft_consensus.cc:697] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:33.113337 23197 consensus_queue.cc:237] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.119532 22750 catalog_manager.cc:5697] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 2 to 3, leader changed from 23e6751435fb4899b4271bfccb192385 (127.22.48.1) to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.139192 23191 raft_consensus.cc:993] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86: : Instructing follower f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:33.139675 23210 raft_consensus.cc:1081] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Signalling peer f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:33.140934 22928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:58016
I20260709 12:15:33.141285 22928 raft_consensus.cc:493] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.141516 22928 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.145321 22928 raft_consensus.cc:515] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:33.146662 22928 leader_election.cc:290] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:33.147272 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:33.147637 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:33.147852 22855 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.148137 23002 raft_consensus.cc:3055] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:33.148391 23002 raft_consensus.cc:740] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:33.149039 23002 consensus_queue.cc:260] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:33.149878 23002 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.151808 22855 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.152848 22893 leader_election.cc:304] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:33.153592 23197 raft_consensus.cc:2804] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:33.154006 23197 raft_consensus.cc:697] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:33.154265 23002 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.154809 23197 consensus_queue.cc:237] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:33.161227 22750 catalog_manager.cc:5697] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 2 to 3, leader changed from a302b1fe229f4823bba82472f7669f86 (127.22.48.3) to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:33.354653 23191 raft_consensus.cc:993] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86: : Instructing follower f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:33.355073 23210 raft_consensus.cc:1081] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Signalling peer f9d01a4199814e0694db9696be3054c3 to start an election
I20260709 12:15:33.356242 22928 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
 from {username='slave'} at 127.0.0.1:58016
I20260709 12:15:33.356671 22928 raft_consensus.cc:493] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:33.356945 22928 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.360919 22928 raft_consensus.cc:515] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.362249 22928 leader_election.cc:290] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:33.363070 22855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:33.363306 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "f9d01a4199814e0694db9696be3054c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:33.363680 22855 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.363770 23002 raft_consensus.cc:3055] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:33.364090 23002 raft_consensus.cc:740] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:33.364630 23002 consensus_queue.cc:260] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.365419 23002 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:33.368129 22855 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.368993 22893 leader_election.cc:304] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:33.369376 23002 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9d01a4199814e0694db9696be3054c3 in term 3.
I20260709 12:15:33.369674 23197 raft_consensus.cc:2804] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:33.370128 23197 raft_consensus.cc:697] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Becoming Leader. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:33.370975 23197 consensus_queue.cc:237] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:33.377444 22750 catalog_manager.cc:5697] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 reported cstate change: term changed from 2 to 3, leader changed from a302b1fe229f4823bba82472f7669f86 (127.22.48.3) to f9d01a4199814e0694db9696be3054c3 (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f9d01a4199814e0694db9696be3054c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:33.459033 22855 raft_consensus.cc:1275] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.460027 23197 consensus_queue.cc:1048] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.469658 23002 raft_consensus.cc:1275] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.471354 23215 consensus_queue.cc:1048] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:33.536578 22855 raft_consensus.cc:1275] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.537715 23215 consensus_queue.cc:1048] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.545897 23002 raft_consensus.cc:1275] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.547338 23197 consensus_queue.cc:1048] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.605382 23002 raft_consensus.cc:1275] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.606539 23202 consensus_queue.cc:1048] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.616452 22855 raft_consensus.cc:1275] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.617888 22854 raft_consensus.cc:1275] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.619354 23197 consensus_queue.cc:1048] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.619529 23202 consensus_queue.cc:1048] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.632730 23002 raft_consensus.cc:1275] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.633986 23215 consensus_queue.cc:1048] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.850389 23002 raft_consensus.cc:1275] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.851505 23202 consensus_queue.cc:1048] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:33.860450 22855 raft_consensus.cc:1275] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Refusing update from remote peer f9d01a4199814e0694db9696be3054c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:33.861913 23197 consensus_queue.cc:1048] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:36.007459 22720 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:15:36.008294 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:36.014945 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
mode: GRACEFUL
new_leader_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:15:36.015607 22928 raft_consensus.cc:606] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Received request to transfer leadership to TS 23e6751435fb4899b4271bfccb192385
I20260709 12:15:36.018134 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3937e63580634894931a96316149504d"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
mode: GRACEFUL
new_leader_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:15:36.018596 22928 raft_consensus.cc:606] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Received request to transfer leadership to TS 23e6751435fb4899b4271bfccb192385
I20260709 12:15:36.020678 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
mode: GRACEFUL
new_leader_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:15:36.021080 22928 raft_consensus.cc:606] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Received request to transfer leadership to TS a302b1fe229f4823bba82472f7669f86
I20260709 12:15:36.023324 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
mode: GRACEFUL
new_leader_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:15:36.023715 22928 raft_consensus.cc:606] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 2 LEADER]: Received request to transfer leadership to TS a302b1fe229f4823bba82472f7669f86
I20260709 12:15:36.025727 22928 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe"
dest_uuid: "f9d01a4199814e0694db9696be3054c3"
mode: GRACEFUL
new_leader_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:58022
I20260709 12:15:36.026149 22928 raft_consensus.cc:606] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Received request to transfer leadership to TS 23e6751435fb4899b4271bfccb192385
I20260709 12:15:36.027180 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:15:36.027622 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:36.184775 23215 raft_consensus.cc:993] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3: : Instructing follower 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:36.185216 23215 raft_consensus.cc:1081] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Signalling peer 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:36.186697 22855 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:43686
I20260709 12:15:36.187371 22855 raft_consensus.cc:493] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:36.187758 22855 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.189528 23231 raft_consensus.cc:993] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3: : Instructing follower 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:36.189970 23215 raft_consensus.cc:1081] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Signalling peer 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:36.191383 22854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:43686
I20260709 12:15:36.191792 22854 raft_consensus.cc:493] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:36.192080 22854 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.193482 22855 raft_consensus.cc:515] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:36.196455 22855 leader_election.cc:290] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 4 election: Requested vote from peers a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:36.196736 23002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:36.197461 23002 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.197930 22854 raft_consensus.cc:515] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.199295 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8324aaf80dd244bd97b38cc38b3313fe" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:36.199790 22928 raft_consensus.cc:3055] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:36.200057 22928 raft_consensus.cc:740] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:36.200220 22854 leader_election.cc:290] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 4 election: Requested vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:36.200644 22930 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:36.201159 22930 raft_consensus.cc:3055] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:36.200907 22928 consensus_queue.cc:260] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:36.201458 22930 raft_consensus.cc:740] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:36.202144 22928 raft_consensus.cc:3060] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.202154 22930 consensus_queue.cc:260] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.203011 23002 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 4.
I20260709 12:15:36.203392 22930 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.203677 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20f84af7089a463494ee86f95fd98e8a" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:36.204197 23004 raft_consensus.cc:3060] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.206853 22820 leader_election.cc:304] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:36.208213 22930 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 4.
I20260709 12:15:36.208513 22928 raft_consensus.cc:2468] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 4.
I20260709 12:15:36.209618 22818 leader_election.cc:304] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, f9d01a4199814e0694db9696be3054c3; no voters: 
I20260709 12:15:36.209973 23232 raft_consensus.cc:2804] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:36.210163 23004 raft_consensus.cc:2468] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 4.
I20260709 12:15:36.211186 23233 raft_consensus.cc:2804] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:36.211303 23232 raft_consensus.cc:697] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 4 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:36.211862 23233 raft_consensus.cc:697] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 4 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:36.212352 23232 consensus_queue.cc:237] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } }
I20260709 12:15:36.212661 23233 consensus_queue.cc:237] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.219664 22750 catalog_manager.cc:5697] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 3 to 4, leader changed from f9d01a4199814e0694db9696be3054c3 (127.22.48.2) to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 4 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.236346 22750 catalog_manager.cc:5697] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 3 to 4, leader changed from f9d01a4199814e0694db9696be3054c3 (127.22.48.2) to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 4 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.287240 23231 raft_consensus.cc:993] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3: : Instructing follower a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:36.287726 23231 raft_consensus.cc:1081] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 2 LEADER]: Signalling peer a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:36.288990 23004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:38538
I20260709 12:15:36.289419 23004 raft_consensus.cc:493] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:36.289719 23004 raft_consensus.cc:3060] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.293607 23004 raft_consensus.cc:515] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.295285 23004 leader_election.cc:290] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 3 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:36.296005 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:36.296295 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d8d8ab76f294e53964036fe114d52f0" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:36.296510 22854 raft_consensus.cc:3060] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.296804 22928 raft_consensus.cc:3055] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:36.297065 22928 raft_consensus.cc:740] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:36.297657 22928 consensus_queue.cc:260] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.298516 22928 raft_consensus.cc:3060] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:36.300894 22854 raft_consensus.cc:2468] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 3.
I20260709 12:15:36.302042 22967 leader_election.cc:304] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:36.302799 23210 raft_consensus.cc:2804] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:36.302799 22928 raft_consensus.cc:2468] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 3.
I20260709 12:15:36.304330 23210 raft_consensus.cc:697] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 3 LEADER]: Becoming Leader. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:36.305094 23210 consensus_queue.cc:237] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.311829 22750 catalog_manager.cc:5697] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 reported cstate change: term changed from 2 to 3, leader changed from f9d01a4199814e0694db9696be3054c3 (127.22.48.2) to a302b1fe229f4823bba82472f7669f86 (127.22.48.3). New cstate: current_term: 3 leader_uuid: "a302b1fe229f4823bba82472f7669f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:36.461620 23215 raft_consensus.cc:993] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3: : Instructing follower 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:36.462100 23231 raft_consensus.cc:1081] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Signalling peer 23e6751435fb4899b4271bfccb192385 to start an election
I20260709 12:15:36.463541 22854 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3937e63580634894931a96316149504d"
dest_uuid: "23e6751435fb4899b4271bfccb192385"
 from {username='slave'} at 127.0.0.1:43686
I20260709 12:15:36.464036 22854 raft_consensus.cc:493] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:36.464318 22854 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.468271 22854 raft_consensus.cc:515] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.469601 22854 leader_election.cc:290] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 4 election: Requested vote from peers f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063), a302b1fe229f4823bba82472f7669f86 (127.22.48.3:41289)
I20260709 12:15:36.470484 23004 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a302b1fe229f4823bba82472f7669f86"
I20260709 12:15:36.470485 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3937e63580634894931a96316149504d" candidate_uuid: "23e6751435fb4899b4271bfccb192385" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:36.470920 23004 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.471055 22928 raft_consensus.cc:3055] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:36.471450 22928 raft_consensus.cc:740] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:36.472087 22928 consensus_queue.cc:260] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.472858 22928 raft_consensus.cc:3060] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.474958 23004 raft_consensus.cc:2468] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 4.
I20260709 12:15:36.475724 22820 leader_election.cc:304] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:36.476329 23233 raft_consensus.cc:2804] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:36.476770 23233 raft_consensus.cc:697] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 4 LEADER]: Becoming Leader. State: Replica: 23e6751435fb4899b4271bfccb192385, State: Running, Role: LEADER
I20260709 12:15:36.477526 22928 raft_consensus.cc:2468] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23e6751435fb4899b4271bfccb192385 in term 4.
I20260709 12:15:36.477610 23233 consensus_queue.cc:237] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.484704 22750 catalog_manager.cc:5697] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 reported cstate change: term changed from 3 to 4, leader changed from f9d01a4199814e0694db9696be3054c3 (127.22.48.2) to 23e6751435fb4899b4271bfccb192385 (127.22.48.1). New cstate: current_term: 4 leader_uuid: "23e6751435fb4899b4271bfccb192385" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:36.485827 23215 raft_consensus.cc:993] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3: : Instructing follower a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:36.486266 23231 raft_consensus.cc:1081] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Signalling peer a302b1fe229f4823bba82472f7669f86 to start an election
I20260709 12:15:36.487530 23004 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f"
dest_uuid: "a302b1fe229f4823bba82472f7669f86"
 from {username='slave'} at 127.0.0.1:38538
I20260709 12:15:36.487917 23004 raft_consensus.cc:493] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:36.488160 23004 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.492642 23004 raft_consensus.cc:515] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.494057 23004 leader_election.cc:290] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 4 election: Requested vote from peers 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819), f9d01a4199814e0694db9696be3054c3 (127.22.48.2:43063)
I20260709 12:15:36.494622 22854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "23e6751435fb4899b4271bfccb192385"
I20260709 12:15:36.495148 22854 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.495630 22928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "50faeb359c874bd28d57da5acc71007f" candidate_uuid: "a302b1fe229f4823bba82472f7669f86" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f9d01a4199814e0694db9696be3054c3"
I20260709 12:15:36.496117 22928 raft_consensus.cc:3055] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:15:36.496392 22928 raft_consensus.cc:740] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f9d01a4199814e0694db9696be3054c3, State: Running, Role: LEADER
I20260709 12:15:36.497121 22928 consensus_queue.cc:260] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.498426 22928 raft_consensus.cc:3060] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:15:36.501425 22854 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 4.
I20260709 12:15:36.502162 22855 raft_consensus.cc:1240] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Rejecting Update request from peer f9d01a4199814e0694db9696be3054c3 for earlier term 3. Current term is 4. Ops: []
I20260709 12:15:36.502398 22967 leader_election.cc:304] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23e6751435fb4899b4271bfccb192385, a302b1fe229f4823bba82472f7669f86; no voters: 
I20260709 12:15:36.503189 23210 raft_consensus.cc:2804] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:15:36.503859 23210 raft_consensus.cc:697] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 4 LEADER]: Becoming Leader. State: Replica: a302b1fe229f4823bba82472f7669f86, State: Running, Role: LEADER
I20260709 12:15:36.504391 22928 raft_consensus.cc:2468] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a302b1fe229f4823bba82472f7669f86 in term 4.
I20260709 12:15:36.505373 23210 consensus_queue.cc:237] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } }
I20260709 12:15:36.513099 22750 catalog_manager.cc:5697] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 reported cstate change: term changed from 3 to 4, leader changed from f9d01a4199814e0694db9696be3054c3 (127.22.48.2) to a302b1fe229f4823bba82472f7669f86 (127.22.48.3). New cstate: current_term: 4 leader_uuid: "a302b1fe229f4823bba82472f7669f86" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:36.593091 23004 raft_consensus.cc:1275] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:36.594152 23233 consensus_queue.cc:1048] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:36.603379 22928 raft_consensus.cc:1275] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:36.604786 23233 consensus_queue.cc:1048] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:36.742201 23004 raft_consensus.cc:1275] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:36.743752 23234 consensus_queue.cc:1048] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:36.746652 22928 raft_consensus.cc:1275] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:36.749377 23234 consensus_queue.cc:1048] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:36.761214 22855 raft_consensus.cc:1275] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:36.762943 23210 consensus_queue.cc:1048] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:36.774998 22928 raft_consensus.cc:1275] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:36.776326 23253 consensus_queue.cc:1048] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:36.937676 22855 raft_consensus.cc:1275] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:36.938970 23253 consensus_queue.cc:1048] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23e6751435fb4899b4271bfccb192385" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 34819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:36.947345 22928 raft_consensus.cc:1275] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Refusing update from remote peer a302b1fe229f4823bba82472f7669f86: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:36.948699 23241 consensus_queue.cc:1048] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:15:36.984378 23004 raft_consensus.cc:1275] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:36.985742 23232 consensus_queue.cc:1048] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a302b1fe229f4823bba82472f7669f86" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 41289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:36.993834 22928 raft_consensus.cc:1275] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Refusing update from remote peer 23e6751435fb4899b4271bfccb192385: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:15:36.995504 23234 consensus_queue.cc:1048] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9d01a4199814e0694db9696be3054c3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:15:37.028771 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:37.034251 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:37.034756 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:38.035748 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:38.040485 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:38.040901 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:39.041949 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:39.046703 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:39.047101 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:40.048123 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:40.052971 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:40.053401 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:41.054452 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:41.059985 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:41.060451 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:42.061548 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:42.067967 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:42.068374 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:43.089452 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:43.094718 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:43.095055 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:15:43.777725 22783 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 22723
W20260709 12:15:43.778524 22783 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 22786
W20260709 12:15:43.779273 22783 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6000 after lost signal to thread 22879
W20260709 12:15:43.779958 22783 debug-util.cc:398] Leaking SignalData structure 0x7b08001b0100 after lost signal to thread 22954
W20260709 12:15:43.780617 22783 debug-util.cc:398] Leaking SignalData structure 0x7b08000f3d20 after lost signal to thread 23028
I20260709 12:15:44.095990 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:44.101118 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:44.101552 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:45.102995 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:45.108999 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:45.109438 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:46.139196 22720 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:15:46.139806 22720 tablet_server.cc:179] TabletServer@127.22.48.1:0 shutting down...
I20260709 12:15:46.169090 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:46.169935 22720 tablet_replica.cc:333] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385: stopping tablet replica
I20260709 12:15:46.170804 22720 raft_consensus.cc:2243] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.171422 22720 raft_consensus.cc:2272] T 50faeb359c874bd28d57da5acc71007f P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.173970 22720 tablet_replica.cc:333] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385: stopping tablet replica
I20260709 12:15:46.174765 22720 raft_consensus.cc:2243] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.175199 22720 raft_consensus.cc:2272] T 06be7cc62642471f9fb9ea54e5965014 P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.176772 22720 tablet_replica.cc:333] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385: stopping tablet replica
I20260709 12:15:46.177232 22720 raft_consensus.cc:2243] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.178040 22720 raft_consensus.cc:2272] T 8324aaf80dd244bd97b38cc38b3313fe P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.179710 22720 tablet_replica.cc:333] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385: stopping tablet replica
I20260709 12:15:46.180145 22720 raft_consensus.cc:2243] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.180526 22720 raft_consensus.cc:2272] T 7d8d8ab76f294e53964036fe114d52f0 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.182093 22720 tablet_replica.cc:333] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385: stopping tablet replica
I20260709 12:15:46.182638 22720 raft_consensus.cc:2243] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.183054 22720 raft_consensus.cc:2272] T f0b1c182fe0b48e6969e4ffc1b48c0cf P 23e6751435fb4899b4271bfccb192385 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.184612 22720 tablet_replica.cc:333] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385: stopping tablet replica
I20260709 12:15:46.185082 22720 raft_consensus.cc:2243] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.185472 22720 raft_consensus.cc:2272] T d82b7d913c984a6a835e96bd82383cd3 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.187077 22720 tablet_replica.cc:333] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385: stopping tablet replica
I20260709 12:15:46.187541 22720 raft_consensus.cc:2243] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.188285 22720 raft_consensus.cc:2272] T 20f84af7089a463494ee86f95fd98e8a P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.189837 22720 tablet_replica.cc:333] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385: stopping tablet replica
I20260709 12:15:46.190336 22720 raft_consensus.cc:2243] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.191273 22720 raft_consensus.cc:2272] T 3937e63580634894931a96316149504d P 23e6751435fb4899b4271bfccb192385 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.192987 22720 tablet_replica.cc:333] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385: stopping tablet replica
I20260709 12:15:46.193485 22720 raft_consensus.cc:2243] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.193926 22720 raft_consensus.cc:2272] T dd2040e5d0084269bce20a1df98718a5 P 23e6751435fb4899b4271bfccb192385 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:46.215044 22967 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.48.1:34819: connect: Connection refused (error 111)
W20260709 12:15:46.299430 22967 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:34819, user_credentials={real_user=slave}} blocked reactor thread for 84512.2us
W20260709 12:15:46.302681 22967 consensus_peers.cc:597] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 -> Peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Couldn't send request to peer 23e6751435fb4899b4271bfccb192385. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:46.304556 22893 consensus_peers.cc:597] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 -> Peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Couldn't send request to peer 23e6751435fb4899b4271bfccb192385. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:15:46.304915 22893 consensus_peers.cc:597] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 -> Peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Couldn't send request to peer 23e6751435fb4899b4271bfccb192385. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:46.338245 22720 tablet_server.cc:196] TabletServer@127.22.48.1:0 shutdown complete.
I20260709 12:15:46.357704 22720 tablet_server.cc:179] TabletServer@127.22.48.2:0 shutting down...
W20260709 12:15:46.373999 22967 consensus_peers.cc:597] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 -> Peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Couldn't send request to peer 23e6751435fb4899b4271bfccb192385. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:46.387979 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:46.388645 22720 tablet_replica.cc:333] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3: stopping tablet replica
I20260709 12:15:46.389267 22720 raft_consensus.cc:2243] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.389751 22720 raft_consensus.cc:2272] T 50faeb359c874bd28d57da5acc71007f P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.391522 22720 tablet_replica.cc:333] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3: stopping tablet replica
I20260709 12:15:46.392023 22720 raft_consensus.cc:2243] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.392763 22720 raft_consensus.cc:2272] T 06be7cc62642471f9fb9ea54e5965014 P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.394405 22720 tablet_replica.cc:333] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3: stopping tablet replica
I20260709 12:15:46.394868 22720 raft_consensus.cc:2243] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.395565 22720 raft_consensus.cc:2272] T f0b1c182fe0b48e6969e4ffc1b48c0cf P f9d01a4199814e0694db9696be3054c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.397114 22720 tablet_replica.cc:333] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3: stopping tablet replica
I20260709 12:15:46.397643 22720 raft_consensus.cc:2243] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.398196 22720 raft_consensus.cc:2272] T 8324aaf80dd244bd97b38cc38b3313fe P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.400542 22720 tablet_replica.cc:333] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3: stopping tablet replica
I20260709 12:15:46.401089 22720 raft_consensus.cc:2243] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.401537 22720 raft_consensus.cc:2272] T 7d8d8ab76f294e53964036fe114d52f0 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:46.402618 22893 consensus_peers.cc:597] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 -> Peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Couldn't send request to peer 23e6751435fb4899b4271bfccb192385. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:46.403329 22720 tablet_replica.cc:333] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3: stopping tablet replica
I20260709 12:15:46.403816 22720 raft_consensus.cc:2243] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.404218 22720 raft_consensus.cc:2272] T dd2040e5d0084269bce20a1df98718a5 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.405795 22720 tablet_replica.cc:333] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3: stopping tablet replica
I20260709 12:15:46.406329 22720 raft_consensus.cc:2243] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.406713 22720 raft_consensus.cc:2272] T 3937e63580634894931a96316149504d P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.408216 22720 tablet_replica.cc:333] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3: stopping tablet replica
I20260709 12:15:46.408669 22720 raft_consensus.cc:2243] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.409381 22720 raft_consensus.cc:2272] T d82b7d913c984a6a835e96bd82383cd3 P f9d01a4199814e0694db9696be3054c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.410928 22720 tablet_replica.cc:333] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3: stopping tablet replica
I20260709 12:15:46.411358 22720 raft_consensus.cc:2243] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.411748 22720 raft_consensus.cc:2272] T 20f84af7089a463494ee86f95fd98e8a P f9d01a4199814e0694db9696be3054c3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.438334 22720 tablet_server.cc:196] TabletServer@127.22.48.2:0 shutdown complete.
I20260709 12:15:46.459477 22720 tablet_server.cc:179] TabletServer@127.22.48.3:0 shutting down...
I20260709 12:15:46.488317 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:15:46.489055 22720 tablet_replica.cc:333] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86: stopping tablet replica
I20260709 12:15:46.489781 22720 raft_consensus.cc:2243] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.490396 22720 raft_consensus.cc:2272] T 06be7cc62642471f9fb9ea54e5965014 P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.492161 22720 tablet_replica.cc:333] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86: stopping tablet replica
I20260709 12:15:46.492688 22720 raft_consensus.cc:2243] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.493497 22720 raft_consensus.cc:2272] T 50faeb359c874bd28d57da5acc71007f P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.495239 22720 tablet_replica.cc:333] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86: stopping tablet replica
I20260709 12:15:46.495952 22720 raft_consensus.cc:2243] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.496946 22720 raft_consensus.cc:2272] T dd2040e5d0084269bce20a1df98718a5 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.498912 22720 tablet_replica.cc:333] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86: stopping tablet replica
I20260709 12:15:46.499627 22720 raft_consensus.cc:2243] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.500138 22720 raft_consensus.cc:2272] T 3937e63580634894931a96316149504d P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:15:46.500231 22967 consensus_peers.cc:597] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 -> Peer 23e6751435fb4899b4271bfccb192385 (127.22.48.1:34819): Couldn't send request to peer 23e6751435fb4899b4271bfccb192385. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:34819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:15:46.502153 22720 tablet_replica.cc:333] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86: stopping tablet replica
I20260709 12:15:46.502710 22720 raft_consensus.cc:2243] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.503088 22720 raft_consensus.cc:2272] T f0b1c182fe0b48e6969e4ffc1b48c0cf P a302b1fe229f4823bba82472f7669f86 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.505165 22720 tablet_replica.cc:333] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86: stopping tablet replica
I20260709 12:15:46.505630 22720 raft_consensus.cc:2243] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.506039 22720 raft_consensus.cc:2272] T 8324aaf80dd244bd97b38cc38b3313fe P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.507725 22720 tablet_replica.cc:333] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86: stopping tablet replica
I20260709 12:15:46.508170 22720 raft_consensus.cc:2243] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.508872 22720 raft_consensus.cc:2272] T 7d8d8ab76f294e53964036fe114d52f0 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.510667 22720 tablet_replica.cc:333] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86: stopping tablet replica
I20260709 12:15:46.511104 22720 raft_consensus.cc:2243] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.511456 22720 raft_consensus.cc:2272] T d82b7d913c984a6a835e96bd82383cd3 P a302b1fe229f4823bba82472f7669f86 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.513048 22720 tablet_replica.cc:333] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86: stopping tablet replica
I20260709 12:15:46.513460 22720 raft_consensus.cc:2243] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:15:46.514258 22720 raft_consensus.cc:2272] T 20f84af7089a463494ee86f95fd98e8a P a302b1fe229f4823bba82472f7669f86 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.540992 22720 tablet_server.cc:196] TabletServer@127.22.48.3:0 shutdown complete.
I20260709 12:15:46.559150 22720 master.cc:562] Master@127.22.48.62:34129 shutting down...
I20260709 12:15:46.756752 22720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:15:46.757308 22720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:15:46.757587 22720 tablet_replica.cc:333] T 00000000000000000000000000000000 P a42eb2a847ae428b999ca36f6229af89: stopping tablet replica
I20260709 12:15:46.793780 22720 master.cc:584] Master@127.22.48.62:34129 shutdown complete.
23e6751435fb4899b4271bfccb192385  4
a302b1fe229f4823bba82472f7669f86  1
f9d01a4199814e0694db9696be3054c3  4
23e6751435fb4899b4271bfccb192385  3
a302b1fe229f4823bba82472f7669f86  3
f9d01a4199814e0694db9696be3054c3  3
23e6751435fb4899b4271bfccb192385  0
a302b1fe229f4823bba82472f7669f86  1
f9d01a4199814e0694db9696be3054c3  8
23e6751435fb4899b4271bfccb192385  3
a302b1fe229f4823bba82472f7669f86  3
f9d01a4199814e0694db9696be3054c3  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (32049 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:15:46.835049 22720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.48.62:37891
I20260709 12:15:46.836144 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:46.841836 23281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:46.841862 23282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:46.842557 23284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:46.843873 22720 server_base.cc:1061] running on GCE node
I20260709 12:15:46.844969 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:46.845168 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:46.845343 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599346845309 us; error 0 us; skew 500 ppm
I20260709 12:15:46.845885 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:46.848206 22720 webserver.cc:533] Webserver started at http://127.22.48.62:43051/ using document root <none> and password file <none>
I20260709 12:15:46.848693 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:46.848881 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:46.849164 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:46.850261 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/master-0-root/instance:
uuid: "2615e14d4918460bac9c5d4bde803d5e"
format_stamp: "Formatted at 2026-07-09 12:15:46 on dist-test-slave-044g"
I20260709 12:15:46.854393 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.002s
I20260709 12:15:46.857478 23289 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:46.858213 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:15:46.858534 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/master-0-root
uuid: "2615e14d4918460bac9c5d4bde803d5e"
format_stamp: "Formatted at 2026-07-09 12:15:46 on dist-test-slave-044g"
I20260709 12:15:46.858811 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:46.887460 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:46.888655 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:46.926533 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.62:37891
I20260709 12:15:46.926651 23340 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.62:37891 every 8 connection(s)
I20260709 12:15:46.930263 23341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:46.939358 23341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e: Bootstrap starting.
I20260709 12:15:46.943873 23341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:46.947973 23341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e: No bootstrap required, opened a new log
I20260709 12:15:46.950011 23341 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2615e14d4918460bac9c5d4bde803d5e" member_type: VOTER }
I20260709 12:15:46.950445 23341 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:46.950718 23341 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2615e14d4918460bac9c5d4bde803d5e, State: Initialized, Role: FOLLOWER
I20260709 12:15:46.951284 23341 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2615e14d4918460bac9c5d4bde803d5e" member_type: VOTER }
I20260709 12:15:46.951740 23341 raft_consensus.cc:399] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:46.951956 23341 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:46.952258 23341 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:46.956041 23341 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2615e14d4918460bac9c5d4bde803d5e" member_type: VOTER }
I20260709 12:15:46.956539 23341 leader_election.cc:304] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2615e14d4918460bac9c5d4bde803d5e; no voters: 
I20260709 12:15:46.957667 23341 leader_election.cc:290] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:46.958112 23344 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:46.959544 23344 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 1 LEADER]: Becoming Leader. State: Replica: 2615e14d4918460bac9c5d4bde803d5e, State: Running, Role: LEADER
I20260709 12:15:46.960587 23341 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:46.960321 23344 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2615e14d4918460bac9c5d4bde803d5e" member_type: VOTER }
I20260709 12:15:46.965893 23345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2615e14d4918460bac9c5d4bde803d5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2615e14d4918460bac9c5d4bde803d5e" member_type: VOTER } }
I20260709 12:15:46.966015 23346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2615e14d4918460bac9c5d4bde803d5e. Latest consensus state: current_term: 1 leader_uuid: "2615e14d4918460bac9c5d4bde803d5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2615e14d4918460bac9c5d4bde803d5e" member_type: VOTER } }
I20260709 12:15:46.966841 23345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:46.966912 23346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:46.971316 23352 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:46.979102 23352 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:46.980063 22720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:46.987713 23352 catalog_manager.cc:1383] Generated new cluster ID: 7910124980274b6d9f90f72975ac7d46
I20260709 12:15:46.987983 23352 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:47.001104 23352 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:47.002336 23352 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:47.024199 23352 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e: Generated new TSK 0
I20260709 12:15:47.024848 23352 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:47.046904 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:47.052925 23362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:47.053488 23363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:47.055258 23365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:47.055910 22720 server_base.cc:1061] running on GCE node
I20260709 12:15:47.056843 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:47.057015 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:47.057143 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599347057132 us; error 0 us; skew 500 ppm
I20260709 12:15:47.057579 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:47.059639 22720 webserver.cc:533] Webserver started at http://127.22.48.1:37991/ using document root <none> and password file <none>
I20260709 12:15:47.060161 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:47.060369 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:47.060669 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:47.061645 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-0-root/instance:
uuid: "e048b79057924ccca0baab8fe12044ce"
format_stamp: "Formatted at 2026-07-09 12:15:47 on dist-test-slave-044g"
I20260709 12:15:47.065876 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:15:47.070465 23370 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:47.071201 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:15:47.071481 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "e048b79057924ccca0baab8fe12044ce"
format_stamp: "Formatted at 2026-07-09 12:15:47 on dist-test-slave-044g"
I20260709 12:15:47.071789 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:47.086155 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:47.087426 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:47.088836 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:47.091077 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:47.091248 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:47.091547 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:47.091698 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:47.132032 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:33805
I20260709 12:15:47.132164 23432 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:33805 every 8 connection(s)
I20260709 12:15:47.136852 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:47.143950 23437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:47.145448 23438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:47.149113 23440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:47.149994 22720 server_base.cc:1061] running on GCE node
I20260709 12:15:47.151068 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:47.151263 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:47.151398 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599347151386 us; error 0 us; skew 500 ppm
I20260709 12:15:47.151889 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:47.154521 22720 webserver.cc:533] Webserver started at http://127.22.48.2:37547/ using document root <none> and password file <none>
I20260709 12:15:47.155189 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:47.155464 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:47.155836 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:47.156333 23433 heartbeater.cc:344] Connected to a master server at 127.22.48.62:37891
I20260709 12:15:47.156690 23433 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:47.157245 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-1-root/instance:
uuid: "a5346be8645344efa916bcdedbd48506"
format_stamp: "Formatted at 2026-07-09 12:15:47 on dist-test-slave-044g"
I20260709 12:15:47.157374 23433 heartbeater.cc:507] Master 127.22.48.62:37891 requested a full tablet report, sending...
I20260709 12:15:47.159610 23306 ts_manager.cc:194] Registered new tserver with Master: e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805)
I20260709 12:15:47.161360 23306 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52074
I20260709 12:15:47.162737 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:15:47.167143 23445 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:47.167989 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:15:47.168294 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-1-root
uuid: "a5346be8645344efa916bcdedbd48506"
format_stamp: "Formatted at 2026-07-09 12:15:47 on dist-test-slave-044g"
I20260709 12:15:47.168607 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:47.191349 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:47.192653 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:47.194429 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:47.197224 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:47.197477 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:47.197769 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:47.197960 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:47.238642 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.2:44351
I20260709 12:15:47.238739 23507 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.2:44351 every 8 connection(s)
I20260709 12:15:47.243710 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:47.252184 23511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:47.253639 23512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:47.255344 23514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:47.255820 22720 server_base.cc:1061] running on GCE node
I20260709 12:15:47.256264 23508 heartbeater.cc:344] Connected to a master server at 127.22.48.62:37891
I20260709 12:15:47.256623 23508 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:47.256814 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:47.257109 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:47.257336 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599347257298 us; error 0 us; skew 500 ppm
I20260709 12:15:47.257390 23508 heartbeater.cc:507] Master 127.22.48.62:37891 requested a full tablet report, sending...
I20260709 12:15:47.258018 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:47.259745 23306 ts_manager.cc:194] Registered new tserver with Master: a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:47.260882 22720 webserver.cc:533] Webserver started at http://127.22.48.3:44983/ using document root <none> and password file <none>
I20260709 12:15:47.261612 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:47.261693 23306 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52090
I20260709 12:15:47.261938 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:47.262352 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:47.263582 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-2-root/instance:
uuid: "6cc6fba807e74046badb06e86f611d79"
format_stamp: "Formatted at 2026-07-09 12:15:47 on dist-test-slave-044g"
I20260709 12:15:47.268091 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:15:47.271250 23519 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:47.272053 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:15:47.272336 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-2-root
uuid: "6cc6fba807e74046badb06e86f611d79"
format_stamp: "Formatted at 2026-07-09 12:15:47 on dist-test-slave-044g"
I20260709 12:15:47.272619 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599314612061-22720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:47.289970 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:47.291184 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:47.292567 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:47.294689 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:47.294914 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:47.295156 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:47.295325 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:47.336005 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.3:35931
I20260709 12:15:47.336091 23581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.3:35931 every 8 connection(s)
I20260709 12:15:47.349191 23582 heartbeater.cc:344] Connected to a master server at 127.22.48.62:37891
I20260709 12:15:47.349493 23582 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:47.350132 23582 heartbeater.cc:507] Master 127.22.48.62:37891 requested a full tablet report, sending...
I20260709 12:15:47.351972 23306 ts_manager.cc:194] Registered new tserver with Master: 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:47.352531 22720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01332801s
I20260709 12:15:47.353214 23306 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52094
I20260709 12:15:47.377978 23306 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52108:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:47.380892 23306 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:47.452266 23398 tablet_service.cc:1511] Processing CreateTablet for tablet 6dff593d4f044a21954fb45490f55e56 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:47.453686 23398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dff593d4f044a21954fb45490f55e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.459066 23547 tablet_service.cc:1511] Processing CreateTablet for tablet 6dff593d4f044a21954fb45490f55e56 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:47.458827 23397 tablet_service.cc:1511] Processing CreateTablet for tablet 0708a3af0e494288b53cc43384360235 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:47.459678 23396 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf3f51a53d94dd98c6d258272f77cab (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:47.460395 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dff593d4f044a21954fb45490f55e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.460455 23397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0708a3af0e494288b53cc43384360235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.461169 23396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf3f51a53d94dd98c6d258272f77cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.470921 23546 tablet_service.cc:1511] Processing CreateTablet for tablet 0708a3af0e494288b53cc43384360235 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:47.473121 23546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0708a3af0e494288b53cc43384360235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.486922 23545 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf3f51a53d94dd98c6d258272f77cab (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:47.488242 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf3f51a53d94dd98c6d258272f77cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.488593 23398 tablet_service.cc:1511] Processing CreateTablet for tablet 9d63f6dacc4a490d81e50a13d5bfd3f4 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:47.489771 23398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d63f6dacc4a490d81e50a13d5bfd3f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.493251 23597 tablet_bootstrap.cc:492] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:47.503993 23544 tablet_service.cc:1511] Processing CreateTablet for tablet 9d63f6dacc4a490d81e50a13d5bfd3f4 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:47.505316 23544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d63f6dacc4a490d81e50a13d5bfd3f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.509086 23471 tablet_service.cc:1511] Processing CreateTablet for tablet 8bf3f51a53d94dd98c6d258272f77cab (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:15:47.510056 23597 tablet_bootstrap.cc:654] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.511431 23470 tablet_service.cc:1511] Processing CreateTablet for tablet 9d63f6dacc4a490d81e50a13d5bfd3f4 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:15:47.513676 23472 tablet_service.cc:1511] Processing CreateTablet for tablet 0708a3af0e494288b53cc43384360235 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:15:47.514938 23473 tablet_service.cc:1511] Processing CreateTablet for tablet 6dff593d4f044a21954fb45490f55e56 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:15:47.516341 23598 tablet_bootstrap.cc:492] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:47.516345 23471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bf3f51a53d94dd98c6d258272f77cab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.522670 23473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dff593d4f044a21954fb45490f55e56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.522816 23598 tablet_bootstrap.cc:654] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.525347 23597 tablet_bootstrap.cc:492] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:47.525821 23597 ts_tablet_manager.cc:1403] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.034s	user 0.003s	sys 0.008s
I20260709 12:15:47.526664 23470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d63f6dacc4a490d81e50a13d5bfd3f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.526979 23397 tablet_service.cc:1511] Processing CreateTablet for tablet 98be6ad6b8a64b97b6f28d84c9b93a0f (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:47.528213 23397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98be6ad6b8a64b97b6f28d84c9b93a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.528702 23472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0708a3af0e494288b53cc43384360235. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.529444 23597 raft_consensus.cc:359] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.530390 23597 raft_consensus.cc:385] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.530761 23597 raft_consensus.cc:740] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.531659 23597 consensus_queue.cc:260] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.534632 23598 tablet_bootstrap.cc:492] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:47.535234 23598 ts_tablet_manager.cc:1403] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 12:15:47.537729 23469 tablet_service.cc:1511] Processing CreateTablet for tablet 98be6ad6b8a64b97b6f28d84c9b93a0f (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:47.538261 23598 raft_consensus.cc:359] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:47.539036 23469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98be6ad6b8a64b97b6f28d84c9b93a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.538980 23598 raft_consensus.cc:385] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.538911 23545 tablet_service.cc:1511] Processing CreateTablet for tablet 98be6ad6b8a64b97b6f28d84c9b93a0f (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:15:47.539511 23598 raft_consensus.cc:740] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.540138 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98be6ad6b8a64b97b6f28d84c9b93a0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.540181 23396 tablet_service.cc:1511] Processing CreateTablet for tablet fe7f4d82700a48c0b9d3863b7f792069 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:47.540367 23598 consensus_queue.cc:260] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:47.541604 23396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7f4d82700a48c0b9d3863b7f792069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.550912 23598 ts_tablet_manager.cc:1434] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:15:47.551641 23582 heartbeater.cc:499] Master 127.22.48.62:37891 was elected leader, sending a full tablet report...
I20260709 12:15:47.558385 23597 ts_tablet_manager.cc:1434] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.008s
I20260709 12:15:47.559128 23433 heartbeater.cc:499] Master 127.22.48.62:37891 was elected leader, sending a full tablet report...
I20260709 12:15:47.560202 23468 tablet_service.cc:1511] Processing CreateTablet for tablet fe7f4d82700a48c0b9d3863b7f792069 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:47.561553 23468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7f4d82700a48c0b9d3863b7f792069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.561828 23597 tablet_bootstrap.cc:492] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:47.562588 23598 tablet_bootstrap.cc:492] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:47.568320 23597 tablet_bootstrap.cc:654] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.569460 23598 tablet_bootstrap.cc:654] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.580544 23545 tablet_service.cc:1511] Processing CreateTablet for tablet fe7f4d82700a48c0b9d3863b7f792069 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:15:47.581964 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe7f4d82700a48c0b9d3863b7f792069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.582976 23395 tablet_service.cc:1511] Processing CreateTablet for tablet 3098152d3a704d1ebb8ef931f977ffcd (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:47.584249 23395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3098152d3a704d1ebb8ef931f977ffcd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:47.589833 23583 tablet.cc:2406] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:47.591955 23467 tablet_service.cc:1511] Processing CreateTablet for tablet 3098152d3a704d1ebb8ef931f977ffcd (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:47.593470 23467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3098152d3a704d1ebb8ef931f977ffcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.593592 23544 tablet_service.cc:1511] Processing CreateTablet for tablet 3098152d3a704d1ebb8ef931f977ffcd (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:15:47.594975 23544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3098152d3a704d1ebb8ef931f977ffcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.607735 23397 tablet_service.cc:1511] Processing CreateTablet for tablet 023ea87276fc42b6b04bdc5dbcb7358a (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:47.609071 23397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023ea87276fc42b6b04bdc5dbcb7358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.623015 23466 tablet_service.cc:1511] Processing CreateTablet for tablet 023ea87276fc42b6b04bdc5dbcb7358a (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:47.624363 23466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023ea87276fc42b6b04bdc5dbcb7358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.633584 23598 tablet_bootstrap.cc:492] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:47.634212 23598 ts_tablet_manager.cc:1403] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.004s
I20260709 12:15:47.635311 23605 tablet_bootstrap.cc:492] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:47.639384 23598 raft_consensus.cc:359] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.641922 23605 tablet_bootstrap.cc:654] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.642071 23598 raft_consensus.cc:385] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.648780 23545 tablet_service.cc:1511] Processing CreateTablet for tablet 023ea87276fc42b6b04bdc5dbcb7358a (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:15:47.650100 23545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 023ea87276fc42b6b04bdc5dbcb7358a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.645004 23597 tablet_bootstrap.cc:492] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:47.654757 23597 ts_tablet_manager.cc:1403] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.093s	user 0.035s	sys 0.019s
I20260709 12:15:47.652074 23395 tablet_service.cc:1511] Processing CreateTablet for tablet 9357adf84b6f4c37a1a768c8e8b9b0cb (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:47.653149 23547 tablet_service.cc:1511] Processing CreateTablet for tablet 9357adf84b6f4c37a1a768c8e8b9b0cb (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:47.657541 23547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9357adf84b6f4c37a1a768c8e8b9b0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.657702 23597 raft_consensus.cc:359] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:47.658615 23597 raft_consensus.cc:385] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.658963 23597 raft_consensus.cc:740] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.659839 23597 consensus_queue.cc:260] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:47.653295 23466 tablet_service.cc:1511] Processing CreateTablet for tablet 9357adf84b6f4c37a1a768c8e8b9b0cb (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:15:47.661706 23466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9357adf84b6f4c37a1a768c8e8b9b0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.649075 23598 raft_consensus.cc:740] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.667201 23598 consensus_queue.cc:260] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.668840 23395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9357adf84b6f4c37a1a768c8e8b9b0cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.670027 23598 ts_tablet_manager.cc:1434] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:15:47.673097 23598 tablet_bootstrap.cc:492] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:47.675287 23597 ts_tablet_manager.cc:1434] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:15:47.680368 23605 tablet_bootstrap.cc:492] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:47.680819 23605 ts_tablet_manager.cc:1403] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.026s
I20260709 12:15:47.681913 23597 tablet_bootstrap.cc:492] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:47.683164 23605 raft_consensus.cc:359] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.683702 23605 raft_consensus.cc:385] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.683954 23605 raft_consensus.cc:740] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.684592 23605 consensus_queue.cc:260] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.686416 23508 heartbeater.cc:499] Master 127.22.48.62:37891 was elected leader, sending a full tablet report...
I20260709 12:15:47.686929 23605 ts_tablet_manager.cc:1434] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:15:47.687789 23605 tablet_bootstrap.cc:492] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:47.690021 23601 raft_consensus.cc:493] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.690490 23601 raft_consensus.cc:515] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.691470 23597 tablet_bootstrap.cc:654] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.693017 23601 leader_election.cc:290] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:47.694388 23397 tablet_service.cc:1511] Processing CreateTablet for tablet 787328b1966f4827915c13adb93726c4 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:47.694795 23467 tablet_service.cc:1511] Processing CreateTablet for tablet 787328b1966f4827915c13adb93726c4 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:47.695490 23598 tablet_bootstrap.cc:654] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.695662 23397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787328b1966f4827915c13adb93726c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.696089 23467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787328b1966f4827915c13adb93726c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.694731 23605 tablet_bootstrap.cc:654] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.702620 23544 tablet_service.cc:1511] Processing CreateTablet for tablet 787328b1966f4827915c13adb93726c4 (DEFAULT_TABLE table=test-workload [id=c71b5a1304cb452187dbb1b9ee0a8d8f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:15:47.703799 23544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 787328b1966f4827915c13adb93726c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:47.752591 23598 tablet_bootstrap.cc:492] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:47.753175 23598 ts_tablet_manager.cc:1403] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.080s	user 0.026s	sys 0.029s
I20260709 12:15:47.757025 23598 raft_consensus.cc:359] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.758051 23598 raft_consensus.cc:385] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.758528 23598 raft_consensus.cc:740] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.759706 23598 consensus_queue.cc:260] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.769238 23598 ts_tablet_manager.cc:1434] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:15:47.770351 23598 tablet_bootstrap.cc:492] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:47.773324 23605 tablet_bootstrap.cc:492] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:47.773921 23605 ts_tablet_manager.cc:1403] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.086s	user 0.009s	sys 0.025s
I20260709 12:15:47.775008 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
W20260709 12:15:47.777253 23373 leader_election.cc:343] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.777866 23605 raft_consensus.cc:359] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.778681 23605 raft_consensus.cc:385] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.779033 23605 raft_consensus.cc:740] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.779528 23598 tablet_bootstrap.cc:654] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.779953 23605 consensus_queue.cc:260] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.782155 23605 ts_tablet_manager.cc:1434] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:15:47.783128 23605 tablet_bootstrap.cc:492] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:47.789554 23605 tablet_bootstrap.cc:654] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.790441 23597 tablet_bootstrap.cc:492] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:47.790974 23597 ts_tablet_manager.cc:1403] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.110s	user 0.043s	sys 0.037s
I20260709 12:15:47.792092 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:47.792762 23557 raft_consensus.cc:2468] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 0.
I20260709 12:15:47.794078 23373 leader_election.cc:304] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: a5346be8645344efa916bcdedbd48506
I20260709 12:15:47.793916 23597 raft_consensus.cc:359] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.794718 23597 raft_consensus.cc:385] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.795011 23597 raft_consensus.cc:740] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.795264 23601 raft_consensus.cc:2804] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.795608 23601 raft_consensus.cc:493] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.795926 23601 raft_consensus.cc:3060] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.795847 23597 consensus_queue.cc:260] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.801067 23605 tablet_bootstrap.cc:492] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:47.801513 23605 ts_tablet_manager.cc:1403] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:15:47.801774 23598 tablet_bootstrap.cc:492] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:47.802229 23598 ts_tablet_manager.cc:1403] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.004s
I20260709 12:15:47.804420 23605 raft_consensus.cc:359] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.805277 23605 raft_consensus.cc:385] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.804996 23598 raft_consensus.cc:359] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.805681 23605 raft_consensus.cc:740] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.805859 23598 raft_consensus.cc:385] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.805022 23601 raft_consensus.cc:515] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.806154 23597 ts_tablet_manager.cc:1434] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.009s
I20260709 12:15:47.806236 23598 raft_consensus.cc:740] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.807281 23598 consensus_queue.cc:260] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.807848 23601 leader_election.cc:290] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 election: Requested vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:47.808537 23605 consensus_queue.cc:260] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.808923 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:47.809494 23557 raft_consensus.cc:3060] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.810783 23605 ts_tablet_manager.cc:1434] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:15:47.811774 23605 tablet_bootstrap.cc:492] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:47.816498 23557 raft_consensus.cc:2468] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 1.
I20260709 12:15:47.816670 23598 ts_tablet_manager.cc:1434] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:15:47.817803 23598 tablet_bootstrap.cc:492] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:47.818203 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:47.818562 23373 leader_election.cc:304] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
W20260709 12:15:47.819476 23373 leader_election.cc:343] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:47.819518 23601 raft_consensus.cc:2804] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.807363 23597 tablet_bootstrap.cc:492] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:47.820116 23601 raft_consensus.cc:697] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:15:47.821672 23601 consensus_queue.cc:237] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.818245 23605 tablet_bootstrap.cc:654] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.825788 23598 tablet_bootstrap.cc:654] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.827106 23597 tablet_bootstrap.cc:654] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.838466 23303 catalog_manager.cc:5697] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 0 to 1, leader changed from <none> to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 1 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:47.840446 23598 tablet_bootstrap.cc:492] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:47.842636 23598 ts_tablet_manager.cc:1403] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.004s
I20260709 12:15:47.845405 23598 raft_consensus.cc:359] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.846102 23598 raft_consensus.cc:385] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.846397 23598 raft_consensus.cc:740] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.847114 23598 consensus_queue.cc:260] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.849997 23605 tablet_bootstrap.cc:492] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:47.850512 23605 ts_tablet_manager.cc:1403] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.001s
I20260709 12:15:47.852491 23605 raft_consensus.cc:359] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:47.853009 23605 raft_consensus.cc:385] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.853293 23605 raft_consensus.cc:740] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.853937 23605 consensus_queue.cc:260] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:47.854776 23602 raft_consensus.cc:493] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.855232 23602 raft_consensus.cc:515] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.856606 23605 ts_tablet_manager.cc:1434] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:15:47.857610 23605 tablet_bootstrap.cc:492] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:47.861025 23602 leader_election.cc:290] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:47.863026 23598 ts_tablet_manager.cc:1434] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:15:47.864017 23598 tablet_bootstrap.cc:492] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:47.864631 23605 tablet_bootstrap.cc:654] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.872224 23598 tablet_bootstrap.cc:654] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.872856 23602 raft_consensus.cc:493] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.873463 23602 raft_consensus.cc:515] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:47.876176 23602 leader_election.cc:290] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:47.884898 23605 tablet_bootstrap.cc:492] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:47.885638 23605 ts_tablet_manager.cc:1403] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.002s
I20260709 12:15:47.889379 23605 raft_consensus.cc:359] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.900240 23597 tablet_bootstrap.cc:492] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:47.900965 23597 ts_tablet_manager.cc:1403] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.094s	user 0.049s	sys 0.027s
I20260709 12:15:47.897351 23605 raft_consensus.cc:385] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.904352 23605 raft_consensus.cc:740] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.908715 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be6ad6b8a64b97b6f28d84c9b93a0f" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:47.908277 23605 consensus_queue.cc:260] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.911535 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be6ad6b8a64b97b6f28d84c9b93a0f" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:47.912104 23483 raft_consensus.cc:2468] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
I20260709 12:15:47.907130 23597 raft_consensus.cc:359] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.913223 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:47.913574 23597 raft_consensus.cc:385] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.913437 23522 leader_election.cc:304] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: 
I20260709 12:15:47.913859 23482 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
I20260709 12:15:47.913921 23597 raft_consensus.cc:740] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.914780 23597 consensus_queue.cc:260] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.915364 23522 leader_election.cc:304] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: 
I20260709 12:15:47.915766 23408 raft_consensus.cc:2468] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
I20260709 12:15:47.916261 23602 raft_consensus.cc:2804] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.916611 23602 raft_consensus.cc:493] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.916963 23602 raft_consensus.cc:3060] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.917239 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:47.917884 23407 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
I20260709 12:15:47.919054 23597 ts_tablet_manager.cc:1434] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:15:47.919684 23598 tablet_bootstrap.cc:492] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:47.920047 23597 tablet_bootstrap.cc:492] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:47.920131 23598 ts_tablet_manager.cc:1403] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.023s
I20260709 12:15:47.923061 23598 raft_consensus.cc:359] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.923785 23598 raft_consensus.cc:385] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.924122 23598 raft_consensus.cc:740] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.923988 23602 raft_consensus.cc:515] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.924947 23598 consensus_queue.cc:260] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.927127 23597 tablet_bootstrap.cc:654] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.927871 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be6ad6b8a64b97b6f28d84c9b93a0f" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:47.928632 23482 raft_consensus.cc:3060] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.933041 23625 raft_consensus.cc:2804] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:47.935186 23625 raft_consensus.cc:493] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:47.935633 23625 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.934846 23598 ts_tablet_manager.cc:1434] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:15:47.936762 23598 tablet_bootstrap.cc:492] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:47.913244 23605 ts_tablet_manager.cc:1434] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 12:15:47.938069 23605 tablet_bootstrap.cc:492] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:47.945087 23605 tablet_bootstrap.cc:654] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.938400 23602 leader_election.cc:290] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:47.936764 23482 raft_consensus.cc:2468] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 1.
I20260709 12:15:47.946112 23598 tablet_bootstrap.cc:654] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.946592 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be6ad6b8a64b97b6f28d84c9b93a0f" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:47.947399 23408 raft_consensus.cc:3060] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.949568 23522 leader_election.cc:304] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: 
I20260709 12:15:47.950446 23602 raft_consensus.cc:2804] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.950892 23602 raft_consensus.cc:697] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:47.951696 23602 consensus_queue.cc:237] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.956276 23597 tablet_bootstrap.cc:492] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:47.957707 23597 ts_tablet_manager.cc:1403] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.038s	user 0.023s	sys 0.008s
I20260709 12:15:47.958106 23625 raft_consensus.cc:515] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:47.958705 23605 tablet_bootstrap.cc:492] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:47.959190 23605 ts_tablet_manager.cc:1403] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.008s
I20260709 12:15:47.960726 23625 leader_election.cc:290] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:47.961328 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:47.961810 23482 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.963260 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:47.964010 23407 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:47.965963 23598 tablet_bootstrap.cc:492] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:47.966419 23598 ts_tablet_manager.cc:1403] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.002s
I20260709 12:15:47.968444 23482 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 1.
I20260709 12:15:47.969246 23598 raft_consensus.cc:359] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.969641 23522 leader_election.cc:304] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: 
I20260709 12:15:47.970116 23598 raft_consensus.cc:385] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.970438 23598 raft_consensus.cc:740] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.971158 23598 consensus_queue.cc:260] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
W20260709 12:15:47.972805 23354 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:47.973362 23598 ts_tablet_manager.cc:1434] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:15:47.973980 23625 raft_consensus.cc:2804] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:47.974336 23598 tablet_bootstrap.cc:492] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:47.974817 23625 raft_consensus.cc:697] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:47.975697 23625 consensus_queue.cc:237] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:47.976383 23408 raft_consensus.cc:2468] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 1.
I20260709 12:15:47.964025 23605 raft_consensus.cc:359] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.979914 23605 raft_consensus.cc:385] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.980326 23605 raft_consensus.cc:740] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.981153 23598 tablet_bootstrap.cc:654] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.981290 23605 consensus_queue.cc:260] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.961033 23597 raft_consensus.cc:359] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.982501 23597 raft_consensus.cc:385] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:47.982894 23597 raft_consensus.cc:740] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:47.984009 23597 consensus_queue.cc:260] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:47.985855 23407 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 1.
I20260709 12:15:47.986981 23597 ts_tablet_manager.cc:1434] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 12:15:47.988095 23597 tablet_bootstrap.cc:492] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:47.989073 23605 ts_tablet_manager.cc:1434] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:15:47.990046 23605 tablet_bootstrap.cc:492] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:47.995972 23597 tablet_bootstrap.cc:654] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.998824 23605 tablet_bootstrap.cc:654] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:47.998893 23607 raft_consensus.cc:493] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:47.999528 23607 raft_consensus.cc:515] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.003886 23620 raft_consensus.cc:493] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.004448 23620 raft_consensus.cc:515] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.009707 23601 raft_consensus.cc:493] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.010335 23601 raft_consensus.cc:515] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.012362 23601 leader_election.cc:290] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.012859 23605 tablet_bootstrap.cc:492] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:48.013304 23605 ts_tablet_manager.cc:1403] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.006s
I20260709 12:15:48.013772 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:48.014993 23305 catalog_manager.cc:5697] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.016116 23482 raft_consensus.cc:2468] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 0.
I20260709 12:15:48.016244 23605 raft_consensus.cc:359] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.016954 23605 raft_consensus.cc:385] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.017416 23605 raft_consensus.cc:740] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.017864 23373 leader_election.cc:304] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.015342 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.018335 23605 consensus_queue.cc:260] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.019213 23557 raft_consensus.cc:2468] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 0.
I20260709 12:15:48.020215 23607 leader_election.cc:290] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.028756 23620 leader_election.cc:290] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:48.028967 23605 ts_tablet_manager.cc:1434] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 12:15:48.030860 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
W20260709 12:15:48.032531 23520 leader_election.cc:343] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.033321 23601 raft_consensus.cc:2804] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.033522 23605 tablet_bootstrap.cc:492] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:48.033887 23601 raft_consensus.cc:493] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.034456 23601 raft_consensus.cc:3060] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.039773 23605 tablet_bootstrap.cc:654] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.043965 23605 tablet_bootstrap.cc:492] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:48.044338 23605 ts_tablet_manager.cc:1403] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.011s	user 0.003s	sys 0.006s
I20260709 12:15:48.046066 23605 raft_consensus.cc:359] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.046597 23605 raft_consensus.cc:385] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.047008 23605 raft_consensus.cc:740] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.047894 23605 consensus_queue.cc:260] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.060492 23605 ts_tablet_manager.cc:1434] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:15:48.060446 23306 catalog_manager.cc:5697] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.073848 23605 tablet_bootstrap.cc:492] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:48.082998 23605 tablet_bootstrap.cc:654] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.097251 23636 raft_consensus.cc:493] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.098119 23636 raft_consensus.cc:515] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.097375 23601 raft_consensus.cc:515] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.101385 23636 leader_election.cc:290] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.104664 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:48.105430 23482 raft_consensus.cc:3060] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.105964 23605 tablet_bootstrap.cc:492] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:48.106559 23605 ts_tablet_manager.cc:1403] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.012s
I20260709 12:15:48.109923 23605 raft_consensus.cc:359] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.111088 23605 raft_consensus.cc:385] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.111503 23605 raft_consensus.cc:740] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.112500 23605 consensus_queue.cc:260] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.119485 23605 ts_tablet_manager.cc:1434] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:15:48.120826 23605 tablet_bootstrap.cc:492] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506: Bootstrap starting.
I20260709 12:15:48.128216 23605 tablet_bootstrap.cc:654] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.135170 23597 tablet_bootstrap.cc:492] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:48.135170 23598 tablet_bootstrap.cc:492] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:48.135926 23598 ts_tablet_manager.cc:1403] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.162s	user 0.061s	sys 0.061s
I20260709 12:15:48.135926 23597 ts_tablet_manager.cc:1403] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.148s	user 0.063s	sys 0.058s
I20260709 12:15:48.137825 23605 tablet_bootstrap.cc:492] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506: No bootstrap required, opened a new log
I20260709 12:15:48.138265 23605 ts_tablet_manager.cc:1403] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:15:48.138619 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:48.138665 23598 raft_consensus.cc:359] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.139415 23598 raft_consensus.cc:385] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.139322 23483 raft_consensus.cc:2468] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
I20260709 12:15:48.139744 23598 raft_consensus.cc:740] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.140439 23522 leader_election.cc:304] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.140551 23598 consensus_queue.cc:260] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.140731 23605 raft_consensus.cc:359] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.141479 23605 raft_consensus.cc:385] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.141681 23625 raft_consensus.cc:2804] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.141799 23605 raft_consensus.cc:740] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.142061 23625 raft_consensus.cc:493] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.141919 23597 raft_consensus.cc:359] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.142493 23625 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.142750 23598 ts_tablet_manager.cc:1434] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:15:48.142680 23597 raft_consensus.cc:385] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.142637 23605 consensus_queue.cc:260] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.143168 23597 raft_consensus.cc:740] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.143787 23598 tablet_bootstrap.cc:492] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:48.144022 23597 consensus_queue.cc:260] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.144719 23605 ts_tablet_manager.cc:1434] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:15:48.148746 23597 ts_tablet_manager.cc:1434] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:15:48.149564 23598 tablet_bootstrap.cc:654] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.149659 23597 tablet_bootstrap.cc:492] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:48.161367 23597 tablet_bootstrap.cc:654] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.161216 23625 raft_consensus.cc:515] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.164309 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce"
W20260709 12:15:48.165769 23520 leader_election.cc:343] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.166814 23625 leader_election.cc:290] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:48.167884 23598 tablet_bootstrap.cc:492] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:48.168346 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:48.168833 23598 ts_tablet_manager.cc:1403] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.006s
I20260709 12:15:48.168990 23483 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.117569 23482 raft_consensus.cc:2468] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 1.
I20260709 12:15:48.172633 23598 raft_consensus.cc:359] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.173467 23598 raft_consensus.cc:385] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.173759 23373 leader_election.cc:304] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.173911 23598 raft_consensus.cc:740] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.175302 23615 raft_consensus.cc:2804] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.175068 23598 consensus_queue.cc:260] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.177325 23598 ts_tablet_manager.cc:1434] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:15:48.177897 23597 tablet_bootstrap.cc:492] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:48.178256 23598 tablet_bootstrap.cc:492] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79: Bootstrap starting.
I20260709 12:15:48.178520 23597 ts_tablet_manager.cc:1403] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.003s
I20260709 12:15:48.181197 23636 raft_consensus.cc:493] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.181514 23597 raft_consensus.cc:359] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.181813 23636 raft_consensus.cc:515] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.182325 23597 raft_consensus.cc:385] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.182664 23597 raft_consensus.cc:740] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.183995 23598 tablet_bootstrap.cc:654] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.183596 23597 consensus_queue.cc:260] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.184051 23636 leader_election.cc:290] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.185475 23620 raft_consensus.cc:493] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.185945 23620 raft_consensus.cc:515] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.188201 23620 leader_election.cc:290] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:48.189744 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:48.190470 23407 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
I20260709 12:15:48.190948 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:48.191502 23557 raft_consensus.cc:3060] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.193747 23597 ts_tablet_manager.cc:1434] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 12:15:48.194653 23520 leader_election.cc:304] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.195963 23597 tablet_bootstrap.cc:492] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:48.196861 23483 raft_consensus.cc:2468] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 1.
I20260709 12:15:48.200590 23620 raft_consensus.cc:2804] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.208101 23522 leader_election.cc:304] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.208420 23620 raft_consensus.cc:493] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.208822 23620 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.209388 23625 raft_consensus.cc:2804] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.209908 23625 raft_consensus.cc:697] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:48.210922 23625 consensus_queue.cc:237] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.212055 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:48.212780 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:48.204537 23598 tablet_bootstrap.cc:492] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79: No bootstrap required, opened a new log
I20260709 12:15:48.205365 23601 leader_election.cc:290] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 election: Requested vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.205928 23597 tablet_bootstrap.cc:654] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.206202 23556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.214905 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:48.206768 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.207814 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.215543 23406 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 0.
I20260709 12:15:48.215778 23555 raft_consensus.cc:2393] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5346be8645344efa916bcdedbd48506 in current term 1: Already voted for candidate e048b79057924ccca0baab8fe12044ce in this term.
I20260709 12:15:48.208223 23615 raft_consensus.cc:697] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:15:48.201000 23557 raft_consensus.cc:2468] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 1.
I20260709 12:15:48.202226 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:48.214396 23598 ts_tablet_manager.cc:1403] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79: Time spent bootstrapping tablet: real 0.036s	user 0.023s	sys 0.003s
I20260709 12:15:48.218152 23446 leader_election.cc:304] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.218724 23602 raft_consensus.cc:493] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.219154 23602 raft_consensus.cc:515] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.220786 23602 leader_election.cc:290] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:48.220902 23598 raft_consensus.cc:359] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.221808 23598 raft_consensus.cc:385] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.221771 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:48.222824 23598 raft_consensus.cc:740] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.223812 23406 raft_consensus.cc:2468] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
I20260709 12:15:48.224792 23598 consensus_queue.cc:260] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.218274 23615 consensus_queue.cc:237] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.226465 23520 leader_election.cc:304] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.227494 23602 raft_consensus.cc:2804] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.227877 23602 raft_consensus.cc:493] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.228201 23602 raft_consensus.cc:3060] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.231726 23598 ts_tablet_manager.cc:1434] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:15:48.224529 23482 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
I20260709 12:15:48.235440 23636 raft_consensus.cc:2804] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.236925 23602 raft_consensus.cc:515] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.239270 23636 raft_consensus.cc:493] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.239939 23636 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.240931 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:48.241513 23406 raft_consensus.cc:3060] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.246758 23642 consensus_queue.cc:1048] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:48.249986 23406 raft_consensus.cc:2468] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 1.
I20260709 12:15:48.254345 23602 leader_election.cc:290] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:48.255476 23448 leader_election.cc:304] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5346be8645344efa916bcdedbd48506; no voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.257238 23520 leader_election.cc:304] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.258352 23620 raft_consensus.cc:515] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.259800 23597 tablet_bootstrap.cc:492] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:48.259655 23554 raft_consensus.cc:2393] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5346be8645344efa916bcdedbd48506 in current term 1: Already voted for candidate 6cc6fba807e74046badb06e86f611d79 in this term.
I20260709 12:15:48.264380 23446 leader_election.cc:304] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5346be8645344efa916bcdedbd48506; no voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.265465 23607 raft_consensus.cc:2749] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.260329 23597 ts_tablet_manager.cc:1403] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.004s
I20260709 12:15:48.259641 23602 raft_consensus.cc:2804] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.269212 23607 raft_consensus.cc:493] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.270251 23607 raft_consensus.cc:515] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.272270 23607 leader_election.cc:290] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.273502 23607 raft_consensus.cc:3060] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.274088 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:48.275408 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:48.276309 23407 raft_consensus.cc:2393] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a5346be8645344efa916bcdedbd48506 in current term 1: Already voted for candidate 6cc6fba807e74046badb06e86f611d79 in this term.
I20260709 12:15:48.276273 23406 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.272413 23636 raft_consensus.cc:515] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.270262 23303 catalog_manager.cc:5697] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 0 to 1, leader changed from <none> to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 1 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.280081 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:48.269419 23597 raft_consensus.cc:359] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.281693 23597 raft_consensus.cc:385] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.282032 23597 raft_consensus.cc:740] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.282084 23636 leader_election.cc:290] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.282968 23597 consensus_queue.cc:260] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.284484 23597 ts_tablet_manager.cc:1434] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:15:48.285179 23597 tablet_bootstrap.cc:492] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:48.286556 23602 raft_consensus.cc:697] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:48.275372 23620 leader_election.cc:290] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:48.285939 23406 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 1.
I20260709 12:15:48.287533 23602 consensus_queue.cc:237] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.288960 23520 leader_election.cc:304] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.290151 23620 raft_consensus.cc:2804] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.291258 23620 raft_consensus.cc:697] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:48.293460 23607 raft_consensus.cc:2749] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.294788 23304 catalog_manager.cc:5697] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } }
W20260709 12:15:48.296128 23448 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:35931, user_credentials={real_user=slave}} blocked reactor thread for 66779.8us
I20260709 12:15:48.299088 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.301703 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:48.304314 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:48.304684 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:48.304932 23482 raft_consensus.cc:2468] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
I20260709 12:15:48.293030 23620 consensus_queue.cc:237] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.306600 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:48.307389 23483 raft_consensus.cc:2393] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6cc6fba807e74046badb06e86f611d79 in current term 1: Already voted for candidate a5346be8645344efa916bcdedbd48506 in this term.
I20260709 12:15:48.308919 23448 leader_election.cc:304] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5346be8645344efa916bcdedbd48506; no voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.310487 23448 leader_election.cc:304] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a5346be8645344efa916bcdedbd48506; no voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.311365 23649 raft_consensus.cc:3060] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.320052 23649 raft_consensus.cc:2749] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.320717 23607 raft_consensus.cc:2749] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.332844 23649 raft_consensus.cc:493] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.333621 23649 raft_consensus.cc:515] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.338217 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ea87276fc42b6b04bdc5dbcb7358a" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:48.339077 23406 raft_consensus.cc:2468] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 0.
I20260709 12:15:48.340771 23446 leader_election.cc:304] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.341856 23607 raft_consensus.cc:2804] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.342376 23607 raft_consensus.cc:493] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.342787 23607 raft_consensus.cc:3060] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.346671 23636 raft_consensus.cc:493] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.347303 23636 raft_consensus.cc:515] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.356627 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9357adf84b6f4c37a1a768c8e8b9b0cb" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
W20260709 12:15:48.359663 23446 leader_election.cc:343] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.359776 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9357adf84b6f4c37a1a768c8e8b9b0cb" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.349990 23636 leader_election.cc:290] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.360626 23557 raft_consensus.cc:2468] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 0.
I20260709 12:15:48.362879 23448 leader_election.cc:304] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.364632 23636 raft_consensus.cc:2804] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.365443 23636 raft_consensus.cc:493] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.366016 23636 raft_consensus.cc:3060] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.368420 23648 raft_consensus.cc:493] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.369062 23648 raft_consensus.cc:515] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.373598 23625 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:48.373685 23642 consensus_queue.cc:1048] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:48.378362 23648 leader_election.cc:290] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:48.379063 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787328b1966f4827915c13adb93726c4" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce" is_pre_election: true
I20260709 12:15:48.383904 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787328b1966f4827915c13adb93726c4" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:48.385692 23481 raft_consensus.cc:2468] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 0.
W20260709 12:15:48.385890 23520 leader_election.cc:343] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.387176 23522 leader_election.cc:304] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.388911 23625 raft_consensus.cc:2804] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:48.389254 23625 raft_consensus.cc:493] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:48.389604 23625 raft_consensus.cc:3060] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.417750 23607 raft_consensus.cc:515] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.418150 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ea87276fc42b6b04bdc5dbcb7358a" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.419167 23557 raft_consensus.cc:2468] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 0.
I20260709 12:15:48.424718 23597 tablet_bootstrap.cc:654] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.405041 23636 raft_consensus.cc:515] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.411748 23649 leader_election.cc:290] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.430881 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ea87276fc42b6b04bdc5dbcb7358a" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:48.431565 23406 raft_consensus.cc:3060] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.440407 23625 raft_consensus.cc:515] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.446098 23636 leader_election.cc:290] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.447034 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9357adf84b6f4c37a1a768c8e8b9b0cb" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:48.451768 23602 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:48.452173 23446 leader_election.cc:343] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.497676 23625 leader_election.cc:290] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:48.499521 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ea87276fc42b6b04bdc5dbcb7358a" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:48.500308 23554 raft_consensus.cc:3060] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.500602 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787328b1966f4827915c13adb93726c4" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:48.501180 23481 raft_consensus.cc:3060] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.495689 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9357adf84b6f4c37a1a768c8e8b9b0cb" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:48.502727 23557 raft_consensus.cc:3060] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.492743 23607 leader_election.cc:290] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.496325 23407 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787328b1966f4827915c13adb93726c4" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:48.507196 23481 raft_consensus.cc:2468] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 1.
I20260709 12:15:48.508358 23625 consensus_queue.cc:1048] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:15:48.508522 23520 leader_election.cc:343] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:48.509585 23522 leader_election.cc:304] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.515321 23406 raft_consensus.cc:2468] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 1.
I20260709 12:15:48.516494 23446 leader_election.cc:304] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.517511 23607 raft_consensus.cc:2804] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.519783 23607 raft_consensus.cc:697] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 1 LEADER]: Becoming Leader. State: Replica: a5346be8645344efa916bcdedbd48506, State: Running, Role: LEADER
I20260709 12:15:48.520699 23607 consensus_queue.cc:237] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.523214 23642 raft_consensus.cc:493] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.523660 23642 raft_consensus.cc:515] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.511529 23625 raft_consensus.cc:2804] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.527204 23625 raft_consensus.cc:697] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:48.528762 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:48.529511 23483 raft_consensus.cc:2393] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e048b79057924ccca0baab8fe12044ce in current term 1: Already voted for candidate 6cc6fba807e74046badb06e86f611d79 in this term.
I20260709 12:15:48.529394 23555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.528333 23625 consensus_queue.cc:237] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.535919 23642 leader_election.cc:290] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.537856 23373 leader_election.cc:304] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e048b79057924ccca0baab8fe12044ce; no voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506
I20260709 12:15:48.539489 23642 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.524499 23554 raft_consensus.cc:2468] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 1.
I20260709 12:15:48.552592 23642 raft_consensus.cc:2749] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.555253 23597 tablet_bootstrap.cc:492] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:48.555711 23597 ts_tablet_manager.cc:1403] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.271s	user 0.013s	sys 0.000s
I20260709 12:15:48.555591 23602 consensus_queue.cc:1048] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.558173 23597 raft_consensus.cc:359] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.558835 23597 raft_consensus.cc:385] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.559155 23597 raft_consensus.cc:740] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.562728 23557 raft_consensus.cc:2468] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 1.
I20260709 12:15:48.563951 23448 leader_election.cc:304] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.562903 23303 catalog_manager.cc:5697] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.564723 23636 raft_consensus.cc:2804] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:48.565308 23636 raft_consensus.cc:697] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 1 LEADER]: Becoming Leader. State: Replica: a5346be8645344efa916bcdedbd48506, State: Running, Role: LEADER
I20260709 12:15:48.566164 23636 consensus_queue.cc:237] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.571573 23303 catalog_manager.cc:5697] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.572680 23304 catalog_manager.cc:5697] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5346be8645344efa916bcdedbd48506 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "a5346be8645344efa916bcdedbd48506" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.559932 23597 consensus_queue.cc:260] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.573498 23303 catalog_manager.cc:5697] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:48.578162 23597 ts_tablet_manager.cc:1434] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:15:48.579157 23597 tablet_bootstrap.cc:492] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce: Bootstrap starting.
I20260709 12:15:48.584375 23597 tablet_bootstrap.cc:654] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:48.589864 23597 tablet_bootstrap.cc:492] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce: No bootstrap required, opened a new log
I20260709 12:15:48.590328 23597 ts_tablet_manager.cc:1403] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:15:48.592957 23597 raft_consensus.cc:359] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.594787 23597 raft_consensus.cc:385] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:48.595088 23597 raft_consensus.cc:740] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Initialized, Role: FOLLOWER
I20260709 12:15:48.595770 23597 consensus_queue.cc:260] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.597805 23597 ts_tablet_manager.cc:1434] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:15:48.601727 23602 consensus_queue.cc:1048] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.603631 23306 catalog_manager.cc:5697] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 reported cstate change: term changed from 0 to 1, leader changed from <none> to a5346be8645344efa916bcdedbd48506 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "a5346be8645344efa916bcdedbd48506" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.613031 23620 consensus_queue.cc:1048] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.639585 23642 consensus_queue.cc:1048] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.654597 23642 consensus_queue.cc:1048] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.655189 23557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
mode: GRACEFUL
new_leader_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:44464
I20260709 12:15:48.655880 23557 raft_consensus.cc:606] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Received request to transfer leadership to TS e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.661605 23642 raft_consensus.cc:493] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.662551 23642 raft_consensus.cc:515] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.665618 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9357adf84b6f4c37a1a768c8e8b9b0cb" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:48.667449 23601 raft_consensus.cc:493] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:48.667963 23601 raft_consensus.cc:515] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.670064 23601 leader_election.cc:290] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.672627 23554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
mode: GRACEFUL
new_leader_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:44464
I20260709 12:15:48.672820 23642 leader_election.cc:290] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.673178 23554 raft_consensus.cc:606] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Received request to transfer leadership to TS e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.673143 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787328b1966f4827915c13adb93726c4" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5346be8645344efa916bcdedbd48506" is_pre_election: true
I20260709 12:15:48.673967 23481 raft_consensus.cc:2393] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e048b79057924ccca0baab8fe12044ce in current term 1: Already voted for candidate 6cc6fba807e74046badb06e86f611d79 in this term.
I20260709 12:15:48.672847 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "787328b1966f4827915c13adb93726c4" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.676476 23373 leader_election.cc:304] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e048b79057924ccca0baab8fe12044ce; no voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506
I20260709 12:15:48.677520 23642 raft_consensus.cc:3060] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.677556 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9357adf84b6f4c37a1a768c8e8b9b0cb" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6cc6fba807e74046badb06e86f611d79" is_pre_election: true
I20260709 12:15:48.683236 23554 raft_consensus.cc:2393] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e048b79057924ccca0baab8fe12044ce in current term 1: Already voted for candidate a5346be8645344efa916bcdedbd48506 in this term.
I20260709 12:15:48.684684 23642 raft_consensus.cc:2749] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.684715 23373 leader_election.cc:304] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e048b79057924ccca0baab8fe12044ce; no voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506
I20260709 12:15:48.684960 23620 consensus_queue.cc:1048] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.685758 23642 raft_consensus.cc:3060] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:48.689730 23554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98be6ad6b8a64b97b6f28d84c9b93a0f"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
mode: GRACEFUL
new_leader_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:44464
I20260709 12:15:48.690348 23554 raft_consensus.cc:606] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Received request to transfer leadership to TS e048b79057924ccca0baab8fe12044ce
I20260709 12:15:48.691892 23642 raft_consensus.cc:2749] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:48.697340 23554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
mode: GRACEFUL
new_leader_uuid: "a5346be8645344efa916bcdedbd48506"
 from {username='slave'} at 127.0.0.1:44464
I20260709 12:15:48.698000 23554 raft_consensus.cc:606] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Received request to transfer leadership to TS a5346be8645344efa916bcdedbd48506
I20260709 12:15:48.700291 23625 consensus_queue.cc:1048] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.708523 23620 raft_consensus.cc:993] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79: : Instructing follower e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:15:48.708722 23557 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
mode: GRACEFUL
new_leader_uuid: "a5346be8645344efa916bcdedbd48506"
 from {username='slave'} at 127.0.0.1:44464
I20260709 12:15:48.708959 23620 raft_consensus.cc:1081] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Signalling peer e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:15:48.709285 23557 raft_consensus.cc:606] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Received request to transfer leadership to TS a5346be8645344efa916bcdedbd48506
I20260709 12:15:48.711347 23406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:33256
I20260709 12:15:48.711915 23406 raft_consensus.cc:493] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:48.712286 23406 raft_consensus.cc:3060] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.717694 23406 raft_consensus.cc:515] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.719333 23406 leader_election.cc:290] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 2 election: Requested vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.720232 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:48.720178 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d63f6dacc4a490d81e50a13d5bfd3f4" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:48.720849 23481 raft_consensus.cc:3060] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.720909 23557 raft_consensus.cc:3055] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:48.721336 23557 raft_consensus.cc:740] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:48.722185 23557 consensus_queue.cc:260] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.723445 23557 raft_consensus.cc:3060] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.727753 23481 raft_consensus.cc:2468] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 2.
I20260709 12:15:48.728889 23373 leader_election.cc:304] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.729652 23615 raft_consensus.cc:2804] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:48.730113 23615 raft_consensus.cc:697] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:15:48.730674 23557 raft_consensus.cc:2468] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 2.
I20260709 12:15:48.730912 23615 consensus_queue.cc:237] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.731379 23648 consensus_queue.cc:1048] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.738257 23306 catalog_manager.cc:5697] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 1 to 2, leader changed from 6cc6fba807e74046badb06e86f611d79 (127.22.48.3) to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 2 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.740932 23620 consensus_queue.cc:1048] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.750430 23620 raft_consensus.cc:993] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79: : Instructing follower a5346be8645344efa916bcdedbd48506 to start an election
I20260709 12:15:48.750871 23602 raft_consensus.cc:1081] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Signalling peer a5346be8645344efa916bcdedbd48506 to start an election
I20260709 12:15:48.752658 23482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069"
dest_uuid: "a5346be8645344efa916bcdedbd48506"
 from {username='slave'} at 127.0.0.1:48976
I20260709 12:15:48.753219 23482 raft_consensus.cc:493] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:48.753598 23482 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.758575 23482 raft_consensus.cc:515] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.760983 23482 leader_election.cc:290] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 2 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:48.761214 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:48.761611 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:48.761894 23406 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.762193 23557 raft_consensus.cc:3055] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:48.762606 23557 raft_consensus.cc:740] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:48.763396 23557 consensus_queue.cc:260] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.764575 23557 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:48.766937 23406 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 2.
I20260709 12:15:48.767885 23446 leader_election.cc:304] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:48.768544 23607 raft_consensus.cc:2804] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:48.769014 23607 raft_consensus.cc:697] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Becoming Leader. State: Replica: a5346be8645344efa916bcdedbd48506, State: Running, Role: LEADER
I20260709 12:15:48.769311 23557 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 2.
I20260709 12:15:48.769862 23607 consensus_queue.cc:237] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:48.775797 23306 catalog_manager.cc:5697] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 reported cstate change: term changed from 1 to 2, leader changed from 6cc6fba807e74046badb06e86f611d79 (127.22.48.3) to a5346be8645344efa916bcdedbd48506 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "a5346be8645344efa916bcdedbd48506" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:48.939049 23607 consensus_queue.cc:1048] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.949635 23649 consensus_queue.cc:1048] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.952917 23649 consensus_queue.cc:1048] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.963325 23636 consensus_queue.cc:1048] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:48.999212 23620 raft_consensus.cc:993] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79: : Instructing follower a5346be8645344efa916bcdedbd48506 to start an election
I20260709 12:15:48.999626 23602 raft_consensus.cc:1081] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Signalling peer a5346be8645344efa916bcdedbd48506 to start an election
I20260709 12:15:49.001017 23482 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd"
dest_uuid: "a5346be8645344efa916bcdedbd48506"
 from {username='slave'} at 127.0.0.1:48976
I20260709 12:15:49.001528 23482 raft_consensus.cc:493] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:49.001832 23482 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.006647 23482 raft_consensus.cc:515] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:49.008919 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:49.009446 23482 leader_election.cc:290] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 2 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:49.009531 23406 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.010720 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:49.011286 23557 raft_consensus.cc:3055] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:49.011279 23602 consensus_queue.cc:1048] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:49.011745 23557 raft_consensus.cc:740] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:49.012686 23557 consensus_queue.cc:260] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:49.013962 23557 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.016637 23406 raft_consensus.cc:2468] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 2.
I20260709 12:15:49.017896 23446 leader_election.cc:304] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:49.018756 23636 raft_consensus.cc:2804] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:49.019205 23636 raft_consensus.cc:697] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Becoming Leader. State: Replica: a5346be8645344efa916bcdedbd48506, State: Running, Role: LEADER
I20260709 12:15:49.020102 23636 consensus_queue.cc:237] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:49.022526 23557 raft_consensus.cc:2468] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 2.
I20260709 12:15:49.025211 23602 consensus_queue.cc:1048] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:49.029937 23304 catalog_manager.cc:5697] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 reported cstate change: term changed from 1 to 2, leader changed from 6cc6fba807e74046badb06e86f611d79 (127.22.48.3) to a5346be8645344efa916bcdedbd48506 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "a5346be8645344efa916bcdedbd48506" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.078502 23625 raft_consensus.cc:993] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79: : Instructing follower e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:15:49.078976 23602 raft_consensus.cc:1081] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Signalling peer e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:15:49.080444 23406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:33256
I20260709 12:15:49.081015 23406 raft_consensus.cc:493] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:49.081388 23406 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.086880 23406 raft_consensus.cc:515] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:49.088382 23406 leader_election.cc:290] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 2 election: Requested vote from peers 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:49.089396 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:49.089612 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:49.089924 23557 raft_consensus.cc:3055] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:49.090157 23482 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.090267 23557 raft_consensus.cc:740] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:49.091034 23557 consensus_queue.cc:260] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:49.091920 23557 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.095062 23482 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 2.
I20260709 12:15:49.096176 23373 leader_election.cc:304] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:49.096496 23557 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 2.
I20260709 12:15:49.097033 23642 raft_consensus.cc:2804] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:49.097494 23642 raft_consensus.cc:697] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:15:49.098181 23642 consensus_queue.cc:237] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:49.104146 23304 catalog_manager.cc:5697] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 1 to 2, leader changed from 6cc6fba807e74046badb06e86f611d79 (127.22.48.3) to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 2 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.119445 23625 raft_consensus.cc:993] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79: : Instructing follower e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:15:49.119911 23602 raft_consensus.cc:1081] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Signalling peer e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:15:49.121284 23406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98be6ad6b8a64b97b6f28d84c9b93a0f"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:33256
I20260709 12:15:49.121744 23406 raft_consensus.cc:493] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:49.122056 23406 raft_consensus.cc:3060] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.126600 23406 raft_consensus.cc:515] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:49.128144 23406 leader_election.cc:290] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 2 election: Requested vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:15:49.129127 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be6ad6b8a64b97b6f28d84c9b93a0f" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:49.129696 23482 raft_consensus.cc:3060] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.130079 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98be6ad6b8a64b97b6f28d84c9b93a0f" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:15:49.130693 23557 raft_consensus.cc:3055] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:49.130987 23557 raft_consensus.cc:740] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:49.131763 23557 consensus_queue.cc:260] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:49.132717 23557 raft_consensus.cc:3060] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:49.134239 23482 raft_consensus.cc:2468] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 2.
I20260709 12:15:49.135259 23373 leader_election.cc:304] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:49.136132 23642 raft_consensus.cc:2804] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:49.136554 23642 raft_consensus.cc:697] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:15:49.137264 23642 consensus_queue.cc:237] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:49.138444 23557 raft_consensus.cc:2468] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 2.
I20260709 12:15:49.143896 23304 catalog_manager.cc:5697] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 1 to 2, leader changed from 6cc6fba807e74046badb06e86f611d79 (127.22.48.3) to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 2 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:49.150871 23406 raft_consensus.cc:1275] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Refusing update from remote peer a5346be8645344efa916bcdedbd48506: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.152135 23636 consensus_queue.cc:1048] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.159536 23557 raft_consensus.cc:1275] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Refusing update from remote peer a5346be8645344efa916bcdedbd48506: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.161320 23649 consensus_queue.cc:1048] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.237365 23482 raft_consensus.cc:1275] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.238776 23642 consensus_queue.cc:1048] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.246979 23557 raft_consensus.cc:1275] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.249562 23615 consensus_queue.cc:1048] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:49.430217 23406 raft_consensus.cc:1275] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Refusing update from remote peer a5346be8645344efa916bcdedbd48506: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.431645 23649 consensus_queue.cc:1048] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.439929 23557 raft_consensus.cc:1275] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Refusing update from remote peer a5346be8645344efa916bcdedbd48506: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.441515 23607 consensus_queue.cc:1048] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.581391 23557 raft_consensus.cc:1275] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.582541 23615 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.590559 23482 raft_consensus.cc:1275] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.591930 23642 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.638062 23557 raft_consensus.cc:1275] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.639384 23642 consensus_queue.cc:1048] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:49.649202 23481 raft_consensus.cc:1275] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:49.652809 23686 consensus_queue.cc:1048] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:15:51.435160 23337 debug-util.cc:398] Leaking SignalData structure 0x7b0800050140 after lost signal to thread 22723
W20260709 12:15:51.435830 23337 debug-util.cc:398] Leaking SignalData structure 0x7b0800050820 after lost signal to thread 23340
W20260709 12:15:51.436573 23337 debug-util.cc:398] Leaking SignalData structure 0x7b080009d680 after lost signal to thread 23432
W20260709 12:15:51.437295 23337 debug-util.cc:398] Leaking SignalData structure 0x7b080009fba0 after lost signal to thread 23507
W20260709 12:15:51.437925 23337 debug-util.cc:398] Leaking SignalData structure 0x7b0800135580 after lost signal to thread 23581
I20260709 12:15:51.776201 22720 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:15:51.777021 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:51.796088 23406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0708a3af0e494288b53cc43384360235"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
mode: GRACEFUL
new_leader_uuid: "6cc6fba807e74046badb06e86f611d79"
 from {username='slave'} at 127.0.0.1:33266
I20260709 12:15:51.796622 23406 raft_consensus.cc:606] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Received request to transfer leadership to TS 6cc6fba807e74046badb06e86f611d79
I20260709 12:15:51.798990 23406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
mode: GRACEFUL
new_leader_uuid: "6cc6fba807e74046badb06e86f611d79"
 from {username='slave'} at 127.0.0.1:33266
I20260709 12:15:51.799487 23406 raft_consensus.cc:606] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Received request to transfer leadership to TS 6cc6fba807e74046badb06e86f611d79
I20260709 12:15:51.800415 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:51.800854 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:51.843041 23691 raft_consensus.cc:993] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce: : Instructing follower 6cc6fba807e74046badb06e86f611d79 to start an election
I20260709 12:15:51.843511 23686 raft_consensus.cc:1081] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Signalling peer 6cc6fba807e74046badb06e86f611d79 to start an election
I20260709 12:15:51.844993 23557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0708a3af0e494288b53cc43384360235"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
 from {username='slave'} at 127.0.0.1:44450
I20260709 12:15:51.845533 23557 raft_consensus.cc:493] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:51.845863 23557 raft_consensus.cc:3060] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.850751 23557 raft_consensus.cc:515] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:51.852861 23557 leader_election.cc:290] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 2 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:51.853226 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:51.853487 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:51.853893 23406 raft_consensus.cc:3055] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:51.854075 23481 raft_consensus.cc:3060] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.854332 23406 raft_consensus.cc:740] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:15:51.855216 23406 consensus_queue.cc:260] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:51.856530 23406 raft_consensus.cc:3060] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:51.859403 23481 raft_consensus.cc:2468] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 2.
I20260709 12:15:51.860740 23522 leader_election.cc:304] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: 
I20260709 12:15:51.861650 23688 raft_consensus.cc:2804] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:51.864070 23406 raft_consensus.cc:2468] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 2.
I20260709 12:15:51.865054 23688 raft_consensus.cc:697] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 2 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:51.866108 23688 consensus_queue.cc:237] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:15:51.878206 23304 catalog_manager.cc:5697] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 1 to 2, leader changed from e048b79057924ccca0baab8fe12044ce (127.22.48.1) to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:52.134982 23691 raft_consensus.cc:993] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce: : Instructing follower 6cc6fba807e74046badb06e86f611d79 to start an election
I20260709 12:15:52.135450 23686 raft_consensus.cc:1081] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Signalling peer 6cc6fba807e74046badb06e86f611d79 to start an election
I20260709 12:15:52.137010 23557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
 from {username='slave'} at 127.0.0.1:44450
I20260709 12:15:52.137454 23557 raft_consensus.cc:493] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:52.137810 23557 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:52.142019 23557 raft_consensus.cc:515] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:52.143642 23557 leader_election.cc:290] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 3 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:15:52.144389 23406 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:15:52.144963 23406 raft_consensus.cc:3055] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:52.145280 23406 raft_consensus.cc:740] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:15:52.145605 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:15:52.146185 23481 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:52.146051 23406 consensus_queue.cc:260] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:52.147302 23406 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:52.155616 23406 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 3.
I20260709 12:15:52.153620 23481 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 3.
I20260709 12:15:52.157176 23520 leader_election.cc:304] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:15:52.158316 23688 raft_consensus.cc:2804] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:52.158792 23688 raft_consensus.cc:697] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 3 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:15:52.159591 23688 consensus_queue.cc:237] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:15:52.167191 23304 catalog_manager.cc:5697] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 2 to 3, leader changed from e048b79057924ccca0baab8fe12044ce (127.22.48.1) to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 3 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.383236 23406 raft_consensus.cc:1275] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Refusing update from remote peer 6cc6fba807e74046badb06e86f611d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:52.384557 23688 consensus_queue.cc:1048] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:52.399080 23481 raft_consensus.cc:1275] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Refusing update from remote peer 6cc6fba807e74046badb06e86f611d79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:52.409121 23692 consensus_queue.cc:1048] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:52.737187 23406 raft_consensus.cc:1275] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Refusing update from remote peer 6cc6fba807e74046badb06e86f611d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:52.738667 23703 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:52.747648 23481 raft_consensus.cc:1275] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Refusing update from remote peer 6cc6fba807e74046badb06e86f611d79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:52.749221 23702 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:52.801993 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:52.810738 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:52.811141 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:53.812079 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:53.818250 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:53.818795 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:54.958755 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:54.966133 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:54.966609 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:15:55.444309 23504 debug-util.cc:398] Leaking SignalData structure 0x7b08000fc200 after lost signal to thread 22723
W20260709 12:15:55.445238 23504 debug-util.cc:398] Leaking SignalData structure 0x7b08000fc8e0 after lost signal to thread 23340
W20260709 12:15:55.446226 23504 debug-util.cc:398] Leaking SignalData structure 0x7b08000f1540 after lost signal to thread 23432
W20260709 12:15:55.447134 23504 debug-util.cc:398] Leaking SignalData structure 0x7b08000b75e0 after lost signal to thread 23507
W20260709 12:15:55.447961 23504 debug-util.cc:398] Leaking SignalData structure 0x7b0800097840 after lost signal to thread 23581
I20260709 12:15:55.967595 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:55.973208 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:55.973699 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:56.974619 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:56.979859 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:56.980254 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:57.981143 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:57.986809 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:57.987231 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:58.988386 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:58.995404 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:58.995826 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:59.996981 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:00.004215 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:00.004709 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:01.005604 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:01.011445 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:01.011925 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:02.049916 22720 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:16:02.055650 23554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
mode: GRACEFUL
new_leader_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:44464
I20260709 12:16:02.056504 23554 raft_consensus.cc:606] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 3 LEADER]: Received request to transfer leadership to TS e048b79057924ccca0baab8fe12044ce
I20260709 12:16:02.062485 23554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0708a3af0e494288b53cc43384360235"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
mode: GRACEFUL
new_leader_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:44464
I20260709 12:16:02.063073 23554 raft_consensus.cc:606] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 2 LEADER]: Received request to transfer leadership to TS e048b79057924ccca0baab8fe12044ce
I20260709 12:16:02.088879 23482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069"
dest_uuid: "a5346be8645344efa916bcdedbd48506"
mode: GRACEFUL
new_leader_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:48942
I20260709 12:16:02.089437 23482 raft_consensus.cc:606] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Received request to transfer leadership to TS e048b79057924ccca0baab8fe12044ce
I20260709 12:16:02.094362 23482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd"
dest_uuid: "a5346be8645344efa916bcdedbd48506"
mode: GRACEFUL
new_leader_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:48942
I20260709 12:16:02.094856 23482 raft_consensus.cc:606] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Received request to transfer leadership to TS e048b79057924ccca0baab8fe12044ce
I20260709 12:16:02.099547 23482 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "023ea87276fc42b6b04bdc5dbcb7358a"
dest_uuid: "a5346be8645344efa916bcdedbd48506"
mode: GRACEFUL
new_leader_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:48942
I20260709 12:16:02.100051 23482 raft_consensus.cc:606] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 1 LEADER]: Received request to transfer leadership to TS e048b79057924ccca0baab8fe12044ce
I20260709 12:16:02.315758 23727 raft_consensus.cc:993] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506: : Instructing follower e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.316274 23721 raft_consensus.cc:1081] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 1 LEADER]: Signalling peer e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.317735 23408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "023ea87276fc42b6b04bdc5dbcb7358a"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:33264
I20260709 12:16:02.318192 23408 raft_consensus.cc:493] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.318543 23408 raft_consensus.cc:3060] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.324311 23408 raft_consensus.cc:515] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.325974 23408 leader_election.cc:290] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 2 election: Requested vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:16:02.327023 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ea87276fc42b6b04bdc5dbcb7358a" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:16:02.327142 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "023ea87276fc42b6b04bdc5dbcb7358a" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:16:02.327766 23481 raft_consensus.cc:3055] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:02.327800 23554 raft_consensus.cc:3060] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.328224 23481 raft_consensus.cc:740] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Running, Role: LEADER
I20260709 12:16:02.329097 23481 consensus_queue.cc:260] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.330514 23481 raft_consensus.cc:3060] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:02.333700 23728 raft_consensus.cc:993] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79: : Instructing follower e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.334257 23723 raft_consensus.cc:1081] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 2 LEADER]: Signalling peer e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.334733 23554 raft_consensus.cc:2468] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 2.
I20260709 12:16:02.335731 23408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0708a3af0e494288b53cc43384360235"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:33256
I20260709 12:16:02.335976 23373 leader_election.cc:304] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:16:02.336274 23408 raft_consensus.cc:493] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.336681 23408 raft_consensus.cc:3060] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.336834 23722 raft_consensus.cc:2804] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:02.337180 23481 raft_consensus.cc:2468] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 2.
I20260709 12:16:02.339138 23722 raft_consensus.cc:697] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:16:02.340013 23722 consensus_queue.cc:237] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.342056 23408 raft_consensus.cc:515] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.344328 23408 leader_election.cc:290] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 3 election: Requested vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:16:02.345515 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:16:02.345760 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0708a3af0e494288b53cc43384360235" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:16:02.346027 23481 raft_consensus.cc:3060] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.346298 23554 raft_consensus.cc:3055] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.346633 23554 raft_consensus.cc:740] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:16:02.347404 23554 consensus_queue.cc:260] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.348510 23554 raft_consensus.cc:3060] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.352638 23554 raft_consensus.cc:2468] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 3.
I20260709 12:16:02.352651 23481 raft_consensus.cc:2468] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 3.
I20260709 12:16:02.353641 23373 leader_election.cc:304] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:16:02.352933 23304 catalog_manager.cc:5697] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 1 to 2, leader changed from a5346be8645344efa916bcdedbd48506 (127.22.48.2) to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 2 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.354341 23722 raft_consensus.cc:2804] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.354831 23722 raft_consensus.cc:697] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:16:02.355605 23722 consensus_queue.cc:237] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.371766 23304 catalog_manager.cc:5697] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 2 to 3, leader changed from 6cc6fba807e74046badb06e86f611d79 (127.22.48.3) to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 3 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.407601 23727 raft_consensus.cc:993] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506: : Instructing follower e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.408079 23727 raft_consensus.cc:1081] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Signalling peer e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.409552 23408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:33264
I20260709 12:16:02.410116 23408 raft_consensus.cc:493] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.410547 23408 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.415535 23408 raft_consensus.cc:515] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.417057 23408 leader_election.cc:290] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 3 election: Requested vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:16:02.417727 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:16:02.417894 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:16:02.418330 23481 raft_consensus.cc:3055] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.418416 23554 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.418608 23481 raft_consensus.cc:740] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Running, Role: LEADER
I20260709 12:16:02.419368 23481 consensus_queue.cc:260] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.420176 23481 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.422544 23554 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 3.
I20260709 12:16:02.423316 23373 leader_election.cc:304] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:16:02.423915 23722 raft_consensus.cc:2804] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.424276 23722 raft_consensus.cc:697] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:16:02.424558 23481 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 3.
I20260709 12:16:02.424993 23722 consensus_queue.cc:237] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.431981 23304 catalog_manager.cc:5697] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 2 to 3, leader changed from a5346be8645344efa916bcdedbd48506 (127.22.48.2) to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 3 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.473780 23721 raft_consensus.cc:993] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506: : Instructing follower e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.474327 23721 raft_consensus.cc:1081] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Signalling peer e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.475965 23408 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:33264
I20260709 12:16:02.476172 23728 raft_consensus.cc:993] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79: : Instructing follower e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.476545 23408 raft_consensus.cc:493] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.476675 23723 raft_consensus.cc:1081] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 3 LEADER]: Signalling peer e048b79057924ccca0baab8fe12044ce to start an election
I20260709 12:16:02.476971 23408 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.478404 23406 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
 from {username='slave'} at 127.0.0.1:33256
I20260709 12:16:02.478895 23406 raft_consensus.cc:493] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:02.479215 23406 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:02.484102 23408 raft_consensus.cc:515] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.485512 23406 raft_consensus.cc:515] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:16:02.486196 23408 leader_election.cc:290] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 3 election: Requested vote from peers a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:16:02.487278 23406 leader_election.cc:290] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 4 election: Requested vote from peers 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:16:02.487314 23481 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:16:02.488046 23481 raft_consensus.cc:3055] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:02.488332 23557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:16:02.488547 23482 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:16:02.488904 23557 raft_consensus.cc:3055] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:02.489109 23482 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:02.489049 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "e048b79057924ccca0baab8fe12044ce" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:16:02.488399 23481 raft_consensus.cc:740] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a5346be8645344efa916bcdedbd48506, State: Running, Role: LEADER
I20260709 12:16:02.489261 23557 raft_consensus.cc:740] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:16:02.489735 23554 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.490319 23557 consensus_queue.cc:260] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:16:02.490334 23481 consensus_queue.cc:260] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.491637 23557 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:02.491690 23481 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:02.495893 23554 raft_consensus.cc:2468] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 3.
I20260709 12:16:02.496214 23482 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 4.
I20260709 12:16:02.497486 23373 leader_election.cc:304] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:16:02.497936 23481 raft_consensus.cc:2468] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 3.
I20260709 12:16:02.498126 23557 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e048b79057924ccca0baab8fe12044ce in term 4.
I20260709 12:16:02.498256 23722 raft_consensus.cc:2804] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:02.498369 23373 leader_election.cc:304] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a5346be8645344efa916bcdedbd48506, e048b79057924ccca0baab8fe12044ce; no voters: 
I20260709 12:16:02.498821 23722 raft_consensus.cc:697] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:16:02.499496 23722 consensus_queue.cc:237] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:02.499769 23729 raft_consensus.cc:2804] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:02.500245 23729 raft_consensus.cc:697] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 4 LEADER]: Becoming Leader. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:16:02.500918 23729 consensus_queue.cc:237] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:16:02.509290 23304 catalog_manager.cc:5697] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 2 to 3, leader changed from a5346be8645344efa916bcdedbd48506 (127.22.48.2) to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 3 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.510464 23304 catalog_manager.cc:5697] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce reported cstate change: term changed from 3 to 4, leader changed from 6cc6fba807e74046badb06e86f611d79 (127.22.48.3) to e048b79057924ccca0baab8fe12044ce (127.22.48.1). New cstate: current_term: 4 leader_uuid: "e048b79057924ccca0baab8fe12044ce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:02.809715 23481 raft_consensus.cc:1275] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.811242 23729 consensus_queue.cc:1048] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:02.822381 23557 raft_consensus.cc:1275] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:02.823757 23722 consensus_queue.cc:1048] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:02.856326 23557 raft_consensus.cc:1275] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:02.857654 23729 consensus_queue.cc:1048] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:02.860162 23481 raft_consensus.cc:1275] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:02.861676 23729 consensus_queue.cc:1048] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:02.902791 23557 raft_consensus.cc:1275] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:02.904070 23729 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:02.917629 23481 raft_consensus.cc:1275] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:02.919018 23737 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:02.971064 23481 raft_consensus.cc:1275] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:02.972462 23729 consensus_queue.cc:1048] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:02.973629 23554 raft_consensus.cc:1275] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:02.974980 23729 consensus_queue.cc:1048] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:03.010082 23482 raft_consensus.cc:1275] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:03.011407 23729 consensus_queue.cc:1048] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:03.020323 23554 raft_consensus.cc:1275] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Refusing update from remote peer e048b79057924ccca0baab8fe12044ce: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:03.022434 23722 consensus_queue.cc:1048] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:05.140447 22720 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:16:05.141223 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.148396 23406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
mode: GRACEFUL
new_leader_uuid: "6cc6fba807e74046badb06e86f611d79"
 from {username='slave'} at 127.0.0.1:33266
I20260709 12:16:05.149128 23406 raft_consensus.cc:606] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Received request to transfer leadership to TS 6cc6fba807e74046badb06e86f611d79
I20260709 12:16:05.151525 23406 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
mode: GRACEFUL
new_leader_uuid: "6cc6fba807e74046badb06e86f611d79"
 from {username='slave'} at 127.0.0.1:33266
I20260709 12:16:05.151925 23406 raft_consensus.cc:606] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 4 LEADER]: Received request to transfer leadership to TS 6cc6fba807e74046badb06e86f611d79
I20260709 12:16:05.154431 23408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
mode: GRACEFUL
new_leader_uuid: "a5346be8645344efa916bcdedbd48506"
 from {username='slave'} at 127.0.0.1:33266
I20260709 12:16:05.154908 23408 raft_consensus.cc:606] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Received request to transfer leadership to TS a5346be8645344efa916bcdedbd48506
I20260709 12:16:05.157271 23408 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069"
dest_uuid: "e048b79057924ccca0baab8fe12044ce"
mode: GRACEFUL
new_leader_uuid: "a5346be8645344efa916bcdedbd48506"
 from {username='slave'} at 127.0.0.1:33266
I20260709 12:16:05.157658 23408 raft_consensus.cc:606] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Received request to transfer leadership to TS a5346be8645344efa916bcdedbd48506
I20260709 12:16:05.158617 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:05.159080 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:05.300926 23748 raft_consensus.cc:993] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce: : Instructing follower a5346be8645344efa916bcdedbd48506 to start an election
I20260709 12:16:05.301489 23754 raft_consensus.cc:1081] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Signalling peer a5346be8645344efa916bcdedbd48506 to start an election
I20260709 12:16:05.302935 23483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab"
dest_uuid: "a5346be8645344efa916bcdedbd48506"
 from {username='slave'} at 127.0.0.1:48966
I20260709 12:16:05.303428 23483 raft_consensus.cc:493] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.303773 23483 raft_consensus.cc:3060] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.309072 23483 raft_consensus.cc:515] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:05.311836 23483 leader_election.cc:290] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 2 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:16:05.312741 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:16:05.313120 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bf3f51a53d94dd98c6d258272f77cab" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:16:05.313606 23554 raft_consensus.cc:3060] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.313563 23408 raft_consensus.cc:3055] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:05.314069 23408 raft_consensus.cc:740] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:16:05.315037 23408 consensus_queue.cc:260] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:05.316437 23408 raft_consensus.cc:3060] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:05.320663 23554 raft_consensus.cc:2468] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 2.
I20260709 12:16:05.321913 23448 leader_election.cc:304] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: 
I20260709 12:16:05.322671 23721 raft_consensus.cc:2804] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:05.323103 23408 raft_consensus.cc:2468] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 2.
I20260709 12:16:05.323734 23721 raft_consensus.cc:697] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Becoming Leader. State: Replica: a5346be8645344efa916bcdedbd48506, State: Running, Role: LEADER
I20260709 12:16:05.324622 23721 consensus_queue.cc:237] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:05.331481 23304 catalog_manager.cc:5697] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 reported cstate change: term changed from 1 to 2, leader changed from e048b79057924ccca0baab8fe12044ce (127.22.48.1) to a5346be8645344efa916bcdedbd48506 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "a5346be8645344efa916bcdedbd48506" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.341287 23748 raft_consensus.cc:993] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce: : Instructing follower a5346be8645344efa916bcdedbd48506 to start an election
I20260709 12:16:05.341723 23754 raft_consensus.cc:1081] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Signalling peer a5346be8645344efa916bcdedbd48506 to start an election
I20260709 12:16:05.343230 23483 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069"
dest_uuid: "a5346be8645344efa916bcdedbd48506"
 from {username='slave'} at 127.0.0.1:48966
I20260709 12:16:05.343732 23483 raft_consensus.cc:493] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.344034 23483 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.348609 23483 raft_consensus.cc:515] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:05.350466 23483 leader_election.cc:290] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 4 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), 6cc6fba807e74046badb06e86f611d79 (127.22.48.3:35931)
I20260709 12:16:05.350912 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:16:05.350953 23554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe7f4d82700a48c0b9d3863b7f792069" candidate_uuid: "a5346be8645344efa916bcdedbd48506" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6cc6fba807e74046badb06e86f611d79"
I20260709 12:16:05.351612 23408 raft_consensus.cc:3055] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:05.351640 23554 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.351966 23408 raft_consensus.cc:740] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:16:05.352643 23408 consensus_queue.cc:260] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:05.353456 23408 raft_consensus.cc:3060] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.355783 23554 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 4.
I20260709 12:16:05.356658 23448 leader_election.cc:304] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: 
I20260709 12:16:05.357254 23721 raft_consensus.cc:2804] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:05.357528 23408 raft_consensus.cc:2468] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a5346be8645344efa916bcdedbd48506 in term 4.
I20260709 12:16:05.357638 23721 raft_consensus.cc:697] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 4 LEADER]: Becoming Leader. State: Replica: a5346be8645344efa916bcdedbd48506, State: Running, Role: LEADER
I20260709 12:16:05.358543 23721 consensus_queue.cc:237] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:05.364540 23304 catalog_manager.cc:5697] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 reported cstate change: term changed from 3 to 4, leader changed from e048b79057924ccca0baab8fe12044ce (127.22.48.1) to a5346be8645344efa916bcdedbd48506 (127.22.48.2). New cstate: current_term: 4 leader_uuid: "a5346be8645344efa916bcdedbd48506" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.592129 23754 raft_consensus.cc:993] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce: : Instructing follower 6cc6fba807e74046badb06e86f611d79 to start an election
I20260709 12:16:05.592582 23754 raft_consensus.cc:1081] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Signalling peer 6cc6fba807e74046badb06e86f611d79 to start an election
I20260709 12:16:05.593966 23554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
 from {username='slave'} at 127.0.0.1:44450
I20260709 12:16:05.594606 23554 raft_consensus.cc:493] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.594877 23554 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.598783 23554 raft_consensus.cc:515] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:05.600481 23554 leader_election.cc:290] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 4 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:16:05.601219 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:16:05.601522 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3098152d3a704d1ebb8ef931f977ffcd" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:16:05.601747 23408 raft_consensus.cc:3055] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:05.602052 23408 raft_consensus.cc:740] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:16:05.602036 23483 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.602834 23408 consensus_queue.cc:260] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:05.603648 23408 raft_consensus.cc:3060] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:05.606839 23483 raft_consensus.cc:2468] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 4.
I20260709 12:16:05.607435 23408 raft_consensus.cc:2468] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 4.
I20260709 12:16:05.608182 23522 leader_election.cc:304] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: 
I20260709 12:16:05.609303 23723 raft_consensus.cc:2804] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:05.610641 23723 raft_consensus.cc:697] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 4 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:16:05.611557 23723 consensus_queue.cc:237] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } }
I20260709 12:16:05.618974 23304 catalog_manager.cc:5697] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 3 to 4, leader changed from e048b79057924ccca0baab8fe12044ce (127.22.48.1) to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 4 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:05.718189 23748 raft_consensus.cc:993] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce: : Instructing follower 6cc6fba807e74046badb06e86f611d79 to start an election
I20260709 12:16:05.718633 23748 raft_consensus.cc:1081] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 4 LEADER]: Signalling peer 6cc6fba807e74046badb06e86f611d79 to start an election
I20260709 12:16:05.720118 23554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56"
dest_uuid: "6cc6fba807e74046badb06e86f611d79"
 from {username='slave'} at 127.0.0.1:44450
I20260709 12:16:05.720675 23554 raft_consensus.cc:493] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:05.720995 23554 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:05.725034 23554 raft_consensus.cc:515] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:16:05.726500 23554 leader_election.cc:290] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 5 election: Requested vote from peers e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805), a5346be8645344efa916bcdedbd48506 (127.22.48.2:44351)
I20260709 12:16:05.727240 23408 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e048b79057924ccca0baab8fe12044ce"
I20260709 12:16:05.727509 23483 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dff593d4f044a21954fb45490f55e56" candidate_uuid: "6cc6fba807e74046badb06e86f611d79" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a5346be8645344efa916bcdedbd48506"
I20260709 12:16:05.727772 23408 raft_consensus.cc:3055] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:05.727990 23483 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:05.728132 23408 raft_consensus.cc:740] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e048b79057924ccca0baab8fe12044ce, State: Running, Role: LEADER
I20260709 12:16:05.728961 23408 consensus_queue.cc:260] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:16:05.730082 23408 raft_consensus.cc:3060] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:05.732728 23483 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 5.
I20260709 12:16:05.733682 23522 leader_election.cc:304] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6cc6fba807e74046badb06e86f611d79, a5346be8645344efa916bcdedbd48506; no voters: 
I20260709 12:16:05.734381 23723 raft_consensus.cc:2804] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:05.734776 23723 raft_consensus.cc:697] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 5 LEADER]: Becoming Leader. State: Replica: 6cc6fba807e74046badb06e86f611d79, State: Running, Role: LEADER
I20260709 12:16:05.734786 23408 raft_consensus.cc:2468] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6cc6fba807e74046badb06e86f611d79 in term 5.
I20260709 12:16:05.735780 23723 consensus_queue.cc:237] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } }
I20260709 12:16:05.739933 23554 raft_consensus.cc:1275] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Refusing update from remote peer a5346be8645344efa916bcdedbd48506: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:05.741102 23757 consensus_queue.cc:1048] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:05.742515 23408 raft_consensus.cc:1275] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Refusing update from remote peer a5346be8645344efa916bcdedbd48506: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.743813 23757 consensus_queue.cc:1048] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:05.743876 23304 catalog_manager.cc:5697] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 reported cstate change: term changed from 4 to 5, leader changed from e048b79057924ccca0baab8fe12044ce (127.22.48.1) to 6cc6fba807e74046badb06e86f611d79 (127.22.48.3). New cstate: current_term: 5 leader_uuid: "6cc6fba807e74046badb06e86f611d79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:05.765722 23557 raft_consensus.cc:1275] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Refusing update from remote peer a5346be8645344efa916bcdedbd48506: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:05.768332 23721 consensus_queue.cc:1048] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6cc6fba807e74046badb06e86f611d79" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 35931 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:05.774791 23408 raft_consensus.cc:1275] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Refusing update from remote peer a5346be8645344efa916bcdedbd48506: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:05.777170 23769 consensus_queue.cc:1048] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:05.991922 23483 raft_consensus.cc:1275] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Refusing update from remote peer 6cc6fba807e74046badb06e86f611d79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:05.993139 23723 consensus_queue.cc:1048] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:06.002243 23408 raft_consensus.cc:1275] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Refusing update from remote peer 6cc6fba807e74046badb06e86f611d79: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:06.003857 23723 consensus_queue.cc:1048] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:06.121766 23408 raft_consensus.cc:1275] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 5 FOLLOWER]: Refusing update from remote peer 6cc6fba807e74046badb06e86f611d79: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:06.123209 23779 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e048b79057924ccca0baab8fe12044ce" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:06.132769 23483 raft_consensus.cc:1275] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 5 FOLLOWER]: Refusing update from remote peer 6cc6fba807e74046badb06e86f611d79: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:06.134516 23779 consensus_queue.cc:1048] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5346be8645344efa916bcdedbd48506" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:06.160035 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:06.165575 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:06.166056 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:07.167160 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:07.172842 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:07.173276 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:08.174216 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:08.179654 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:08.180084 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:09.181002 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:09.188565 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:09.189072 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:10.190079 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:10.195354 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:10.195775 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:11.196704 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:11.202526 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:11.202986 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:12.203902 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:12.209461 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:12.209838 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:13.210763 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:13.216569 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:13.217006 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:14.217952 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:14.224936 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:14.225392 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:15.262074 22720 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:16:15.262717 22720 tablet_server.cc:179] TabletServer@127.22.48.1:0 shutting down...
I20260709 12:16:15.298123 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:15.298966 22720 tablet_replica.cc:333] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.299813 22720 raft_consensus.cc:2243] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.300534 22720 raft_consensus.cc:2272] T 9357adf84b6f4c37a1a768c8e8b9b0cb P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.302759 22720 tablet_replica.cc:333] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.303400 22720 raft_consensus.cc:2243] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.304209 22720 raft_consensus.cc:2272] T 023ea87276fc42b6b04bdc5dbcb7358a P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.306242 22720 tablet_replica.cc:333] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.306815 22720 raft_consensus.cc:2243] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.307750 22720 raft_consensus.cc:2272] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.309651 22720 tablet_replica.cc:333] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.310156 22720 raft_consensus.cc:2243] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.310761 22720 raft_consensus.cc:2272] T fe7f4d82700a48c0b9d3863b7f792069 P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.312667 22720 tablet_replica.cc:333] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.313361 22720 raft_consensus.cc:2243] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.314221 22720 raft_consensus.cc:2272] T 98be6ad6b8a64b97b6f28d84c9b93a0f P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:15.315320 23446 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
I20260709 12:16:15.316366 22720 tablet_replica.cc:333] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.316985 22720 raft_consensus.cc:2243] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.317924 22720 raft_consensus.cc:2272] T 0708a3af0e494288b53cc43384360235 P e048b79057924ccca0baab8fe12044ce [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:15.318907 23446 consensus_peers.cc:597] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 -> Peer e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805): Couldn't send request to peer e048b79057924ccca0baab8fe12044ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:15.320204 22720 tablet_replica.cc:333] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.320984 22720 raft_consensus.cc:2243] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.321493 22720 raft_consensus.cc:2272] T 3098152d3a704d1ebb8ef931f977ffcd P e048b79057924ccca0baab8fe12044ce [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:15.323469 23446 consensus_peers.cc:597] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 -> Peer e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805): Couldn't send request to peer e048b79057924ccca0baab8fe12044ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:15.323601 22720 tablet_replica.cc:333] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.324182 22720 raft_consensus.cc:2243] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.324638 22720 raft_consensus.cc:2272] T 6dff593d4f044a21954fb45490f55e56 P e048b79057924ccca0baab8fe12044ce [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.326527 22720 tablet_replica.cc:333] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.327054 22720 raft_consensus.cc:2243] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.327507 22720 raft_consensus.cc:2272] T 787328b1966f4827915c13adb93726c4 P e048b79057924ccca0baab8fe12044ce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.329493 22720 tablet_replica.cc:333] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce: stopping tablet replica
I20260709 12:16:15.329970 22720 raft_consensus.cc:2243] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.330497 22720 raft_consensus.cc:2272] T 8bf3f51a53d94dd98c6d258272f77cab P e048b79057924ccca0baab8fe12044ce [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:15.339061 23520 consensus_peers.cc:597] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 -> Peer e048b79057924ccca0baab8fe12044ce (127.22.48.1:33805): Couldn't send request to peer e048b79057924ccca0baab8fe12044ce. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:15.362478 22720 tablet_server.cc:196] TabletServer@127.22.48.1:0 shutdown complete.
I20260709 12:16:15.384670 22720 tablet_server.cc:179] TabletServer@127.22.48.2:0 shutting down...
I20260709 12:16:15.409722 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:15.410627 22720 tablet_replica.cc:333] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.411550 22720 raft_consensus.cc:2243] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.412607 22720 raft_consensus.cc:2272] T 9357adf84b6f4c37a1a768c8e8b9b0cb P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.414484 22720 tablet_replica.cc:333] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.415038 22720 raft_consensus.cc:2243] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.415534 22720 raft_consensus.cc:2272] T 023ea87276fc42b6b04bdc5dbcb7358a P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.417397 22720 tablet_replica.cc:333] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.417897 22720 raft_consensus.cc:2243] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.418349 22720 raft_consensus.cc:2272] T 787328b1966f4827915c13adb93726c4 P a5346be8645344efa916bcdedbd48506 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.419943 22720 tablet_replica.cc:333] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.420421 22720 raft_consensus.cc:2243] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.421236 22720 raft_consensus.cc:2272] T 8bf3f51a53d94dd98c6d258272f77cab P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.423008 22720 tablet_replica.cc:333] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.423494 22720 raft_consensus.cc:2243] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.423931 22720 raft_consensus.cc:2272] T 3098152d3a704d1ebb8ef931f977ffcd P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.425595 22720 tablet_replica.cc:333] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.426080 22720 raft_consensus.cc:2243] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.426568 22720 raft_consensus.cc:2272] T 6dff593d4f044a21954fb45490f55e56 P a5346be8645344efa916bcdedbd48506 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.428196 22720 tablet_replica.cc:333] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.428665 22720 raft_consensus.cc:2243] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.429149 22720 raft_consensus.cc:2272] T 98be6ad6b8a64b97b6f28d84c9b93a0f P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.430907 22720 tablet_replica.cc:333] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.431417 22720 raft_consensus.cc:2243] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.431808 22720 raft_consensus.cc:2272] T 0708a3af0e494288b53cc43384360235 P a5346be8645344efa916bcdedbd48506 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.433380 22720 tablet_replica.cc:333] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.433840 22720 raft_consensus.cc:2243] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.434296 22720 raft_consensus.cc:2272] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P a5346be8645344efa916bcdedbd48506 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.435830 22720 tablet_replica.cc:333] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506: stopping tablet replica
I20260709 12:16:15.436264 22720 raft_consensus.cc:2243] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.437038 22720 raft_consensus.cc:2272] T fe7f4d82700a48c0b9d3863b7f792069 P a5346be8645344efa916bcdedbd48506 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.483606 22720 tablet_server.cc:196] TabletServer@127.22.48.2:0 shutdown complete.
I20260709 12:16:15.502614 22720 tablet_server.cc:179] TabletServer@127.22.48.3:0 shutting down...
I20260709 12:16:15.532326 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:15.533012 22720 tablet_replica.cc:333] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.533852 22720 raft_consensus.cc:2243] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.534416 22720 raft_consensus.cc:2272] T 9357adf84b6f4c37a1a768c8e8b9b0cb P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.536254 22720 tablet_replica.cc:333] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.536767 22720 raft_consensus.cc:2243] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.537171 22720 raft_consensus.cc:2272] T 023ea87276fc42b6b04bdc5dbcb7358a P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.538873 22720 tablet_replica.cc:333] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.539345 22720 raft_consensus.cc:2243] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.539829 22720 raft_consensus.cc:2272] T fe7f4d82700a48c0b9d3863b7f792069 P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.541323 22720 tablet_replica.cc:333] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.541770 22720 raft_consensus.cc:2243] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.542187 22720 raft_consensus.cc:2272] T 0708a3af0e494288b53cc43384360235 P 6cc6fba807e74046badb06e86f611d79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.543881 22720 tablet_replica.cc:333] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.544345 22720 raft_consensus.cc:2243] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.544772 22720 raft_consensus.cc:2272] T 98be6ad6b8a64b97b6f28d84c9b93a0f P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.546623 22720 tablet_replica.cc:333] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.547111 22720 raft_consensus.cc:2243] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.547549 22720 raft_consensus.cc:2272] T 9d63f6dacc4a490d81e50a13d5bfd3f4 P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.549068 22720 tablet_replica.cc:333] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.549537 22720 raft_consensus.cc:2243] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.550351 22720 raft_consensus.cc:2272] T 787328b1966f4827915c13adb93726c4 P 6cc6fba807e74046badb06e86f611d79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.551990 22720 tablet_replica.cc:333] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.552445 22720 raft_consensus.cc:2243] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:15.553020 22720 raft_consensus.cc:2272] T 8bf3f51a53d94dd98c6d258272f77cab P 6cc6fba807e74046badb06e86f611d79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.554842 22720 tablet_replica.cc:333] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.555341 22720 raft_consensus.cc:2243] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.556106 22720 raft_consensus.cc:2272] T 3098152d3a704d1ebb8ef931f977ffcd P 6cc6fba807e74046badb06e86f611d79 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.557785 22720 tablet_replica.cc:333] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79: stopping tablet replica
I20260709 12:16:15.558260 22720 raft_consensus.cc:2243] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.559129 22720 raft_consensus.cc:2272] T 6dff593d4f044a21954fb45490f55e56 P 6cc6fba807e74046badb06e86f611d79 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.590130 22720 tablet_server.cc:196] TabletServer@127.22.48.3:0 shutdown complete.
I20260709 12:16:15.610389 22720 master.cc:562] Master@127.22.48.62:37891 shutting down...
I20260709 12:16:15.635766 22720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:15.636407 22720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:15.636750 22720 tablet_replica.cc:333] T 00000000000000000000000000000000 P 2615e14d4918460bac9c5d4bde803d5e: stopping tablet replica
I20260709 12:16:15.676340 22720 master.cc:584] Master@127.22.48.62:37891 shutdown complete.
6cc6fba807e74046badb06e86f611d79  1
a5346be8645344efa916bcdedbd48506  4
e048b79057924ccca0baab8fe12044ce  5
6cc6fba807e74046badb06e86f611d79  3
a5346be8645344efa916bcdedbd48506  4
e048b79057924ccca0baab8fe12044ce  3
6cc6fba807e74046badb06e86f611d79  1
a5346be8645344efa916bcdedbd48506  1
e048b79057924ccca0baab8fe12044ce  8
6cc6fba807e74046badb06e86f611d79  3
a5346be8645344efa916bcdedbd48506  3
e048b79057924ccca0baab8fe12044ce  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28883 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:16:15.718648 22720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.48.62:36189
I20260709 12:16:15.719761 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:15.725045 23794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.725396 23795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.726614 23797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:15.727739 22720 server_base.cc:1061] running on GCE node
I20260709 12:16:15.728686 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:15.728883 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:15.729048 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599375729033 us; error 0 us; skew 500 ppm
I20260709 12:16:15.729620 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:15.731992 22720 webserver.cc:533] Webserver started at http://127.22.48.62:42557/ using document root <none> and password file <none>
I20260709 12:16:15.732472 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:15.732659 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:15.732941 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:15.734045 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/master-0-root/instance:
uuid: "b335f82e70ec42589bee8577eecf648f"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-044g"
I20260709 12:16:15.738404 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:15.741562 23802 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.742432 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:15.742676 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/master-0-root
uuid: "b335f82e70ec42589bee8577eecf648f"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-044g"
I20260709 12:16:15.742911 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:15.758819 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:15.759954 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:15.798415 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.62:36189
I20260709 12:16:15.798583 23853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.62:36189 every 8 connection(s)
I20260709 12:16:15.802250 23854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:15.812237 23854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Bootstrap starting.
I20260709 12:16:15.817188 23854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:15.821688 23854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: No bootstrap required, opened a new log
I20260709 12:16:15.823851 23854 raft_consensus.cc:359] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b335f82e70ec42589bee8577eecf648f" member_type: VOTER }
I20260709 12:16:15.824273 23854 raft_consensus.cc:385] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:15.824541 23854 raft_consensus.cc:740] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b335f82e70ec42589bee8577eecf648f, State: Initialized, Role: FOLLOWER
I20260709 12:16:15.825090 23854 consensus_queue.cc:260] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b335f82e70ec42589bee8577eecf648f" member_type: VOTER }
I20260709 12:16:15.825560 23854 raft_consensus.cc:399] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:15.825760 23854 raft_consensus.cc:493] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:15.826061 23854 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:15.832211 23854 raft_consensus.cc:515] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b335f82e70ec42589bee8577eecf648f" member_type: VOTER }
I20260709 12:16:15.832921 23854 leader_election.cc:304] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b335f82e70ec42589bee8577eecf648f; no voters: 
I20260709 12:16:15.834529 23854 leader_election.cc:290] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:15.835155 23857 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:15.836712 23857 raft_consensus.cc:697] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 1 LEADER]: Becoming Leader. State: Replica: b335f82e70ec42589bee8577eecf648f, State: Running, Role: LEADER
I20260709 12:16:15.837551 23854 sys_catalog.cc:565] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:15.837459 23857 consensus_queue.cc:237] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b335f82e70ec42589bee8577eecf648f" member_type: VOTER }
I20260709 12:16:15.842468 23859 sys_catalog.cc:455] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [sys.catalog]: SysCatalogTable state changed. Reason: New leader b335f82e70ec42589bee8577eecf648f. Latest consensus state: current_term: 1 leader_uuid: "b335f82e70ec42589bee8577eecf648f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b335f82e70ec42589bee8577eecf648f" member_type: VOTER } }
I20260709 12:16:15.843221 23859 sys_catalog.cc:458] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:15.845089 23866 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:15.845104 23858 sys_catalog.cc:455] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b335f82e70ec42589bee8577eecf648f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b335f82e70ec42589bee8577eecf648f" member_type: VOTER } }
I20260709 12:16:15.845845 23858 sys_catalog.cc:458] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:15.850122 23866 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:15.854499 22720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:15.859043 23866 catalog_manager.cc:1383] Generated new cluster ID: 757609d78d4642a783e10b135a6c22af
I20260709 12:16:15.859333 23866 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:15.882308 23866 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:15.883586 23866 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:15.894795 23866 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Generated new TSK 0
I20260709 12:16:15.895395 23866 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:15.921113 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:15.928099 23875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:15.929503 23876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:15.930943 22720 server_base.cc:1061] running on GCE node
W20260709 12:16:15.931496 23878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:15.932466 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:15.932713 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:15.932946 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599375932920 us; error 0 us; skew 500 ppm
I20260709 12:16:15.933485 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:15.935973 22720 webserver.cc:533] Webserver started at http://127.22.48.1:38459/ using document root <none> and password file <none>
I20260709 12:16:15.936492 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:15.936717 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:15.937032 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:15.938175 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/instance:
uuid: "0829ddf18f07439086398756b9c6d216"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-044g"
I20260709 12:16:15.943013 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:15.946509 23883 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.947280 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:15.947567 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "0829ddf18f07439086398756b9c6d216"
format_stamp: "Formatted at 2026-07-09 12:16:15 on dist-test-slave-044g"
I20260709 12:16:15.947907 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:15.964807 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:15.966074 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:15.967579 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:15.969825 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:15.970054 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:15.970484 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:15.970700 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.012569 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:35685
I20260709 12:16:16.012669 23945 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:35685 every 8 connection(s)
I20260709 12:16:16.017778 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:16.026059 23950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.027878 23951 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.031174 23953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:16.031200 22720 server_base.cc:1061] running on GCE node
I20260709 12:16:16.032212 23946 heartbeater.cc:344] Connected to a master server at 127.22.48.62:36189
I20260709 12:16:16.032574 23946 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:16.033265 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:16:16.033324 23946 heartbeater.cc:507] Master 127.22.48.62:36189 requested a full tablet report, sending...
W20260709 12:16:16.033574 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:16.033826 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599376033804 us; error 0 us; skew 500 ppm
I20260709 12:16:16.034498 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:16.035974 23819 ts_manager.cc:194] Registered new tserver with Master: 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:16.037148 22720 webserver.cc:533] Webserver started at http://127.22.48.2:35113/ using document root <none> and password file <none>
I20260709 12:16:16.037635 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:16.037832 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:16.038105 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:16.038147 23819 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39282
I20260709 12:16:16.039601 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/instance:
uuid: "ef0dd15ac654478b8371c22b8909240e"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-044g"
I20260709 12:16:16.044063 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:16:16.047536 23958 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.048740 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:16:16.049140 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root
uuid: "ef0dd15ac654478b8371c22b8909240e"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-044g"
I20260709 12:16:16.049404 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:16.061580 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:16.062829 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:16.064271 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:16.066835 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:16.067059 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.067294 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:16.067462 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.109656 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.2:43801
I20260709 12:16:16.109760 24020 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.2:43801 every 8 connection(s)
I20260709 12:16:16.114373 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:16.121148 24024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.121747 24025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:16.124346 24027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:16.125129 22720 server_base.cc:1061] running on GCE node
I20260709 12:16:16.125820 24021 heartbeater.cc:344] Connected to a master server at 127.22.48.62:36189
I20260709 12:16:16.126163 24021 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:16.126129 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:16.126583 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:16.126762 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599376126726 us; error 0 us; skew 500 ppm
I20260709 12:16:16.127105 24021 heartbeater.cc:507] Master 127.22.48.62:36189 requested a full tablet report, sending...
I20260709 12:16:16.127360 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:16.129207 23819 ts_manager.cc:194] Registered new tserver with Master: ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:16.130117 22720 webserver.cc:533] Webserver started at http://127.22.48.3:46255/ using document root <none> and password file <none>
I20260709 12:16:16.130568 23819 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39296
I20260709 12:16:16.130640 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:16.130935 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:16.131217 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:16.132445 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/instance:
uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-044g"
I20260709 12:16:16.136853 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:16:16.140225 24032 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.141062 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:16.141371 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root
uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
format_stamp: "Formatted at 2026-07-09 12:16:16 on dist-test-slave-044g"
I20260709 12:16:16.141664 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:16.159219 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:16.160531 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:16.161953 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:16.164147 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:16.164379 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.164624 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:16.164801 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:16.204181 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.3:42409
I20260709 12:16:16.204274 24094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.3:42409 every 8 connection(s)
I20260709 12:16:16.218323 24095 heartbeater.cc:344] Connected to a master server at 127.22.48.62:36189
I20260709 12:16:16.218726 24095 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:16.219460 24095 heartbeater.cc:507] Master 127.22.48.62:36189 requested a full tablet report, sending...
I20260709 12:16:16.221342 23819 ts_manager.cc:194] Registered new tserver with Master: a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:16.221937 22720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014679307s
I20260709 12:16:16.223196 23819 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39310
I20260709 12:16:16.251153 23819 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39326:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:16.257220 23819 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:16.444273 23911 tablet_service.cc:1511] Processing CreateTablet for tablet 432ae242d4354d208df9f37d432ef3f7 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:16.445712 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432ae242d4354d208df9f37d432ef3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.462707 23910 tablet_service.cc:1511] Processing CreateTablet for tablet 3e002c45f325450c832f48fca5627fcd (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:16.464066 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e002c45f325450c832f48fca5627fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.464174 23982 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6dc6b578324215a52f1a0a5f46c3d4 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:16.465595 23982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6dc6b578324215a52f1a0a5f46c3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.465525 23986 tablet_service.cc:1511] Processing CreateTablet for tablet 432ae242d4354d208df9f37d432ef3f7 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:16.466856 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432ae242d4354d208df9f37d432ef3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.467430 23981 tablet_service.cc:1511] Processing CreateTablet for tablet 8132db9882c041d1845d0a8815c39788 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:16.468730 23981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8132db9882c041d1845d0a8815c39788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.471410 23980 tablet_service.cc:1511] Processing CreateTablet for tablet 9f761e3dc48440849d367f5e28b48adb (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:16.472740 23980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f761e3dc48440849d367f5e28b48adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.472534 23984 tablet_service.cc:1511] Processing CreateTablet for tablet 7e53ff7433274cdf9c150f141d03e1f5 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:16.474083 23984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e53ff7433274cdf9c150f141d03e1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.478320 23908 tablet_service.cc:1511] Processing CreateTablet for tablet 1a27cf3ad031452fa9b230da94f82f48 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:16.475178 23979 tablet_service.cc:1511] Processing CreateTablet for tablet 33e9bcdb00ec45229c3b370172970a07 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:16.479549 23908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a27cf3ad031452fa9b230da94f82f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.479803 23979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e9bcdb00ec45229c3b370172970a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.475735 23983 tablet_service.cc:1511] Processing CreateTablet for tablet 1a27cf3ad031452fa9b230da94f82f48 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:16.476150 23909 tablet_service.cc:1511] Processing CreateTablet for tablet 7e53ff7433274cdf9c150f141d03e1f5 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:16.483212 23909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e53ff7433274cdf9c150f141d03e1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.483242 23983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a27cf3ad031452fa9b230da94f82f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.471411 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 3e002c45f325450c832f48fca5627fcd (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:16.487031 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e002c45f325450c832f48fca5627fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.487581 23978 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccb15a6c98843f3836da9918c1195dc (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:16.489032 23978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccb15a6c98843f3836da9918c1195dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.492136 23977 tablet_service.cc:1511] Processing CreateTablet for tablet ac7e870c1a4544099414fa4aae03e1c2 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:16.493592 23977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7e870c1a4544099414fa4aae03e1c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.504314 23907 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6dc6b578324215a52f1a0a5f46c3d4 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:16.505694 23907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6dc6b578324215a52f1a0a5f46c3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.512187 23906 tablet_service.cc:1511] Processing CreateTablet for tablet 8132db9882c041d1845d0a8815c39788 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:16.513566 23906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8132db9882c041d1845d0a8815c39788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.526554 24060 tablet_service.cc:1511] Processing CreateTablet for tablet 432ae242d4354d208df9f37d432ef3f7 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:16.528105 24060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432ae242d4354d208df9f37d432ef3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.529875 24051 tablet_service.cc:1511] Processing CreateTablet for tablet ac7e870c1a4544099414fa4aae03e1c2 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:16.532162 24051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7e870c1a4544099414fa4aae03e1c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.534560 24057 tablet_service.cc:1511] Processing CreateTablet for tablet 1a27cf3ad031452fa9b230da94f82f48 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:16.533365 24059 tablet_service.cc:1511] Processing CreateTablet for tablet 3e002c45f325450c832f48fca5627fcd (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:16.536126 24057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a27cf3ad031452fa9b230da94f82f48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.536830 24059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e002c45f325450c832f48fca5627fcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.533371 24053 tablet_service.cc:1511] Processing CreateTablet for tablet 33e9bcdb00ec45229c3b370172970a07 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:16.539920 24053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e9bcdb00ec45229c3b370172970a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.539517 24055 tablet_service.cc:1511] Processing CreateTablet for tablet 8132db9882c041d1845d0a8815c39788 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:16.534654 24054 tablet_service.cc:1511] Processing CreateTablet for tablet 9f761e3dc48440849d367f5e28b48adb (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:16.545778 23980 tablet_service.cc:1511] Processing CreateTablet for tablet e905a7d4b6d64ec49ad9485c349179cb (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:16.546345 24056 tablet_service.cc:1511] Processing CreateTablet for tablet 5c6dc6b578324215a52f1a0a5f46c3d4 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:16.547008 23980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e905a7d4b6d64ec49ad9485c349179cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.532140 24052 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccb15a6c98843f3836da9918c1195dc (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:16.532140 24058 tablet_service.cc:1511] Processing CreateTablet for tablet 7e53ff7433274cdf9c150f141d03e1f5 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:16.554253 24055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8132db9882c041d1845d0a8815c39788. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.557778 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6dc6b578324215a52f1a0a5f46c3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.558609 24058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e53ff7433274cdf9c150f141d03e1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.561439 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0df8b4c2674e279e8740ab00a67267 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:16.562426 24054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f761e3dc48440849d367f5e28b48adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.562745 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0df8b4c2674e279e8740ab00a67267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.566661 24052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccb15a6c98843f3836da9918c1195dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.577528 23980 tablet_service.cc:1511] Processing CreateTablet for tablet 295a8f22b14a4f92b8abb10a4a03e184 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:16.578861 23980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295a8f22b14a4f92b8abb10a4a03e184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.586545 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 2b80ceeebb5c4f0aaaecd9da202550b0 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:16.588263 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b80ceeebb5c4f0aaaecd9da202550b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.606889 23985 tablet_service.cc:1511] Processing CreateTablet for tablet def9be339f8f4adc820a6a1320fec425 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:16.608340 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def9be339f8f4adc820a6a1320fec425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.610580 23982 tablet_service.cc:1511] Processing CreateTablet for tablet f58a6c8f74504786b09cf0261ea665c7 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:16.617018 24109 tablet_bootstrap.cc:492] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:16.612025 23982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58a6c8f74504786b09cf0261ea665c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.632018 23911 tablet_service.cc:1511] Processing CreateTablet for tablet 33e9bcdb00ec45229c3b370172970a07 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:16.633759 23905 tablet_service.cc:1511] Processing CreateTablet for tablet ac7e870c1a4544099414fa4aae03e1c2 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:16.636685 23904 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0df8b4c2674e279e8740ab00a67267 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:16.637276 23903 tablet_service.cc:1511] Processing CreateTablet for tablet 295a8f22b14a4f92b8abb10a4a03e184 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:16.639935 23902 tablet_service.cc:1511] Processing CreateTablet for tablet 2b80ceeebb5c4f0aaaecd9da202550b0 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:16.655583 23907 tablet_service.cc:1511] Processing CreateTablet for tablet 5ccb15a6c98843f3836da9918c1195dc (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:16.656818 24109 tablet_bootstrap.cc:654] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.657759 23910 tablet_service.cc:1511] Processing CreateTablet for tablet 9f761e3dc48440849d367f5e28b48adb (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:16.691323 23980 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9f2592cbef4c2d92a345546231175a (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:16.692701 23980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9f2592cbef4c2d92a345546231175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.695999 23909 tablet_service.cc:1511] Processing CreateTablet for tablet e905a7d4b6d64ec49ad9485c349179cb (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:16.697221 23909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e905a7d4b6d64ec49ad9485c349179cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.697870 23906 tablet_service.cc:1511] Processing CreateTablet for tablet def9be339f8f4adc820a6a1320fec425 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:16.699112 23906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def9be339f8f4adc820a6a1320fec425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.707774 24052 tablet_service.cc:1511] Processing CreateTablet for tablet 295a8f22b14a4f92b8abb10a4a03e184 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:16.709246 24052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295a8f22b14a4f92b8abb10a4a03e184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.660157 24054 tablet_service.cc:1511] Processing CreateTablet for tablet 9a0df8b4c2674e279e8740ab00a67267 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:16.712180 24054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0df8b4c2674e279e8740ab00a67267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.714480 23981 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9a767edf8b423cb0ef561b055f670a (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:16.715798 23981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9a767edf8b423cb0ef561b055f670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.674155 23979 tablet_service.cc:1511] Processing CreateTablet for tablet 0caf361b460241abb91679f8f8b6e7e4 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:16.717782 23979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0caf361b460241abb91679f8f8b6e7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.718377 23986 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb39e36ee084608a322a8fa84ccde2d (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:16.719594 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb39e36ee084608a322a8fa84ccde2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.730957 23983 tablet_service.cc:1511] Processing CreateTablet for tablet a3da07aaa60743c193b387e6a20fc83b (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:16.732744 23982 tablet_service.cc:1511] Processing CreateTablet for tablet da0449b96d0e4a57b82ad92e05c4cea7 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:16.733521 23908 tablet_service.cc:1511] Processing CreateTablet for tablet f58a6c8f74504786b09cf0261ea665c7 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:16.734012 23982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0449b96d0e4a57b82ad92e05c4cea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.734726 23908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58a6c8f74504786b09cf0261ea665c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.739264 23903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 295a8f22b14a4f92b8abb10a4a03e184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.740741 24051 tablet_service.cc:1511] Processing CreateTablet for tablet e905a7d4b6d64ec49ad9485c349179cb (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:16.740933 24057 tablet_service.cc:1511] Processing CreateTablet for tablet def9be339f8f4adc820a6a1320fec425 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:16.741974 24051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e905a7d4b6d64ec49ad9485c349179cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.737896 23977 tablet_service.cc:1511] Processing CreateTablet for tablet 1298b4797007440ca5cc586fd47928e8 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:16.755702 24110 tablet_bootstrap.cc:492] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:16.750722 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f761e3dc48440849d367f5e28b48adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.756613 23907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccb15a6c98843f3836da9918c1195dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.758551 23902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b80ceeebb5c4f0aaaecd9da202550b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.759581 23904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0df8b4c2674e279e8740ab00a67267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.762633 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7e870c1a4544099414fa4aae03e1c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.763286 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e9bcdb00ec45229c3b370172970a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.738116 24055 tablet_service.cc:1511] Processing CreateTablet for tablet 2b80ceeebb5c4f0aaaecd9da202550b0 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:16.768250 24059 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9f2592cbef4c2d92a345546231175a (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:16.769789 24057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def9be339f8f4adc820a6a1320fec425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.770848 24060 tablet_service.cc:1511] Processing CreateTablet for tablet 0caf361b460241abb91679f8f8b6e7e4 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:16.772116 24060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0caf361b460241abb91679f8f8b6e7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.774802 24059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9f2592cbef4c2d92a345546231175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.778384 23983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da07aaa60743c193b387e6a20fc83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.778585 24055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b80ceeebb5c4f0aaaecd9da202550b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.771767 24053 tablet_service.cc:1511] Processing CreateTablet for tablet f58a6c8f74504786b09cf0261ea665c7 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:16.784238 23984 tablet_service.cc:1511] Processing CreateTablet for tablet 9661e61546884b0aa0c1e828cd13e76e (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:16.784806 24110 tablet_bootstrap.cc:654] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.785625 23984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9661e61546884b0aa0c1e828cd13e76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.785734 24111 tablet_bootstrap.cc:492] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:16.787357 23986 tablet_service.cc:1511] Processing CreateTablet for tablet 368f96220d5b4469885774acf06e4475 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:16.790628 23977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1298b4797007440ca5cc586fd47928e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.791539 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368f96220d5b4469885774acf06e4475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.788125 24058 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb39e36ee084608a322a8fa84ccde2d (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:16.784243 23978 tablet_service.cc:1511] Processing CreateTablet for tablet 238addf610d94f84b346a29e1e4b0e52 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:16.803411 23978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238addf610d94f84b346a29e1e4b0e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.805732 23982 tablet_service.cc:1511] Processing CreateTablet for tablet ea2fd010d40d4400b7b9f1b9cca54a0c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:16.806980 23982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2fd010d40d4400b7b9f1b9cca54a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.811810 24056 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9a767edf8b423cb0ef561b055f670a (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:16.813400 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9a767edf8b423cb0ef561b055f670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.820904 23909 tablet_service.cc:1511] Processing CreateTablet for tablet 5e9f2592cbef4c2d92a345546231175a (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:16.840451 24054 tablet_service.cc:1511] Processing CreateTablet for tablet a3da07aaa60743c193b387e6a20fc83b (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:16.841185 23909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e9f2592cbef4c2d92a345546231175a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.815107 24053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58a6c8f74504786b09cf0261ea665c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.829370 24109 tablet_bootstrap.cc:492] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:16.848431 24109 ts_tablet_manager.cc:1403] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.232s	user 0.010s	sys 0.015s
W20260709 12:16:16.850788 23867 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:16.851646 24058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb39e36ee084608a322a8fa84ccde2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.790078 23985 tablet_service.cc:1511] Processing CreateTablet for tablet bdddb53d197e4af78460302ce75bc88c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:16.823539 23980 tablet_service.cc:1511] Processing CreateTablet for tablet 10cd478aa7e9411bba254e94713f91de (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:16.860721 24054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da07aaa60743c193b387e6a20fc83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.864020 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdddb53d197e4af78460302ce75bc88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.866353 23980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cd478aa7e9411bba254e94713f91de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.891680 24111 tablet_bootstrap.cc:654] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:16.903383 24109 raft_consensus.cc:359] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:16.909641 24109 raft_consensus.cc:385] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.918099 24109 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.920455 23984 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc5fe36cbf643f18c228bc420036e0c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:16.922008 23984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc5fe36cbf643f18c228bc420036e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.921880 23979 tablet_service.cc:1511] Processing CreateTablet for tablet 6869b2949cb848a79c8263a5be455d66 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:16.906800 24110 tablet_bootstrap.cc:492] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:16.923418 24110 ts_tablet_manager.cc:1403] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.170s	user 0.009s	sys 0.011s
I20260709 12:16:16.930908 23903 tablet_service.cc:1511] Processing CreateTablet for tablet 0caf361b460241abb91679f8f8b6e7e4 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:16.932199 23903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0caf361b460241abb91679f8f8b6e7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.940923 24052 tablet_service.cc:1511] Processing CreateTablet for tablet da0449b96d0e4a57b82ad92e05c4cea7 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:16.943745 24111 tablet_bootstrap.cc:492] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:16.944200 24111 ts_tablet_manager.cc:1403] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.159s	user 0.006s	sys 0.010s
I20260709 12:16:16.944413 24059 tablet_service.cc:1511] Processing CreateTablet for tablet 1298b4797007440ca5cc586fd47928e8 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:16.945772 24110 raft_consensus.cc:359] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:16.946564 24110 raft_consensus.cc:385] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.946899 24110 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.947758 24110 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:16.948591 24051 tablet_service.cc:1511] Processing CreateTablet for tablet 238addf610d94f84b346a29e1e4b0e52 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:16.951412 23979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6869b2949cb848a79c8263a5be455d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.953429 23982 tablet_service.cc:1511] Processing CreateTablet for tablet e22d6a51d8e04f7bbcad59376624aa20 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:16.962122 23982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22d6a51d8e04f7bbcad59376624aa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.961936 24057 tablet_service.cc:1511] Processing CreateTablet for tablet 368f96220d5b4469885774acf06e4475 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:16.962369 23911 tablet_service.cc:1511] Processing CreateTablet for tablet a3da07aaa60743c193b387e6a20fc83b (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:16.963645 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da07aaa60743c193b387e6a20fc83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.965448 24111 raft_consensus.cc:359] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:16.966462 24111 raft_consensus.cc:385] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:16.966564 23906 tablet_service.cc:1511] Processing CreateTablet for tablet 2e9a767edf8b423cb0ef561b055f670a (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:16.967759 23906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9a767edf8b423cb0ef561b055f670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.968011 23907 tablet_service.cc:1511] Processing CreateTablet for tablet da0449b96d0e4a57b82ad92e05c4cea7 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:16.969260 23907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0449b96d0e4a57b82ad92e05c4cea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.966912 24111 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:16.971349 23905 tablet_service.cc:1511] Processing CreateTablet for tablet 1298b4797007440ca5cc586fd47928e8 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:16.972623 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1298b4797007440ca5cc586fd47928e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.953976 24109 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:16.978647 24052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0449b96d0e4a57b82ad92e05c4cea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.979276 24057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368f96220d5b4469885774acf06e4475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.980365 23984 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3cbce810b542c7b032e8cbe30abbfd (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:16.981249 24059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1298b4797007440ca5cc586fd47928e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.981608 23984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3cbce810b542c7b032e8cbe30abbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.984918 23908 tablet_service.cc:1511] Processing CreateTablet for tablet 9661e61546884b0aa0c1e828cd13e76e (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:16.986560 24051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238addf610d94f84b346a29e1e4b0e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.987721 24060 tablet_service.cc:1511] Processing CreateTablet for tablet bdddb53d197e4af78460302ce75bc88c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:16.989030 24060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdddb53d197e4af78460302ce75bc88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.973696 24111 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:16.977911 23902 tablet_service.cc:1511] Processing CreateTablet for tablet 238addf610d94f84b346a29e1e4b0e52 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:16.993934 23910 tablet_service.cc:1511] Processing CreateTablet for tablet 368f96220d5b4469885774acf06e4475 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:16.955623 23904 tablet_service.cc:1511] Processing CreateTablet for tablet 2fb39e36ee084608a322a8fa84ccde2d (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:16.986228 23908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9661e61546884b0aa0c1e828cd13e76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.998581 23902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238addf610d94f84b346a29e1e4b0e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.954810 24055 tablet_service.cc:1511] Processing CreateTablet for tablet 9661e61546884b0aa0c1e828cd13e76e (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:16.999971 24055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9661e61546884b0aa0c1e828cd13e76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.005438 23909 tablet_service.cc:1511] Processing CreateTablet for tablet bdddb53d197e4af78460302ce75bc88c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:17.006438 23978 tablet_service.cc:1511] Processing CreateTablet for tablet 0740227aa014467da8e8269927b1cfda (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:17.018783 23978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0740227aa014467da8e8269927b1cfda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:16.991768 23983 tablet_service.cc:1511] Processing CreateTablet for tablet eac75053172041f285deb68d4418ed57 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:17.021872 24054 tablet_service.cc:1511] Processing CreateTablet for tablet ea2fd010d40d4400b7b9f1b9cca54a0c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:17.025234 24095 heartbeater.cc:499] Master 127.22.48.62:36189 was elected leader, sending a full tablet report...
I20260709 12:16:17.025729 23904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb39e36ee084608a322a8fa84ccde2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.039211 23981 tablet_service.cc:1511] Processing CreateTablet for tablet c59becc061884c78add6c7ec0be6583c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:17.040623 23981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59becc061884c78add6c7ec0be6583c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.040746 23946 heartbeater.cc:499] Master 127.22.48.62:36189 was elected leader, sending a full tablet report...
I20260709 12:16:17.044291 24058 tablet_service.cc:1511] Processing CreateTablet for tablet 10cd478aa7e9411bba254e94713f91de (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:17.045603 24058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cd478aa7e9411bba254e94713f91de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.048065 24111 ts_tablet_manager.cc:1434] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.103s	user 0.014s	sys 0.002s
I20260709 12:16:17.043386 23980 tablet_service.cc:1511] Processing CreateTablet for tablet 371c317c26eb44cd875c5925f4b31bd6 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:17.049624 23980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371c317c26eb44cd875c5925f4b31bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.058947 24111 tablet_bootstrap.cc:492] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:17.059410 24110 ts_tablet_manager.cc:1434] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.136s	user 0.008s	sys 0.007s
I20260709 12:16:17.062865 23909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdddb53d197e4af78460302ce75bc88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.069562 24109 ts_tablet_manager.cc:1434] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.221s	user 0.023s	sys 0.013s
I20260709 12:16:17.070250 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368f96220d5b4469885774acf06e4475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.028858 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 6850e6a4a82a49d689423ed8fb40c891 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:17.073031 24109 tablet_bootstrap.cc:492] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:17.079142 24109 tablet_bootstrap.cc:654] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.082916 24054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2fd010d40d4400b7b9f1b9cca54a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.064293 23906 tablet_service.cc:1511] Processing CreateTablet for tablet ea2fd010d40d4400b7b9f1b9cca54a0c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:17.065243 23903 tablet_service.cc:1511] Processing CreateTablet for tablet 6869b2949cb848a79c8263a5be455d66 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:17.089412 23903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6869b2949cb848a79c8263a5be455d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.089990 24053 tablet_service.cc:1511] Processing CreateTablet for tablet 6869b2949cb848a79c8263a5be455d66 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:17.091216 24053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6869b2949cb848a79c8263a5be455d66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.096038 23986 tablet_service.cc:1511] Processing CreateTablet for tablet 84a22fee7e714048af4a1d40001e99de (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:17.097344 24057 tablet_service.cc:1511] Processing CreateTablet for tablet e22d6a51d8e04f7bbcad59376624aa20 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:17.098600 23906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2fd010d40d4400b7b9f1b9cca54a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.102579 24056 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc5fe36cbf643f18c228bc420036e0c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:17.104355 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc5fe36cbf643f18c228bc420036e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.104693 23977 tablet_service.cc:1511] Processing CreateTablet for tablet ccf053e06f514bffaa9c442a8ea2c144 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:17.116252 23977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf053e06f514bffaa9c442a8ea2c144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.116878 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a22fee7e714048af4a1d40001e99de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.118549 23983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac75053172041f285deb68d4418ed57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.123517 23911 tablet_service.cc:1511] Processing CreateTablet for tablet 0740227aa014467da8e8269927b1cfda (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:17.124886 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0740227aa014467da8e8269927b1cfda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.127027 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6850e6a4a82a49d689423ed8fb40c891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.134881 24021 heartbeater.cc:499] Master 127.22.48.62:36189 was elected leader, sending a full tablet report...
I20260709 12:16:17.139833 24111 tablet_bootstrap.cc:654] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.143740 23910 tablet_service.cc:1511] Processing CreateTablet for tablet 10cd478aa7e9411bba254e94713f91de (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:17.144906 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cd478aa7e9411bba254e94713f91de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.146634 24110 tablet_bootstrap.cc:492] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:17.149636 24051 tablet_service.cc:1511] Processing CreateTablet for tablet eac75053172041f285deb68d4418ed57 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:17.162429 24057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22d6a51d8e04f7bbcad59376624aa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.170441 24115 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.170933 24115 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.173486 24115 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:17.177625 23902 tablet_service.cc:1511] Processing CreateTablet for tablet 8dc5fe36cbf643f18c228bc420036e0c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:17.182862 23907 tablet_service.cc:1511] Processing CreateTablet for tablet e22d6a51d8e04f7bbcad59376624aa20 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:17.184128 23907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22d6a51d8e04f7bbcad59376624aa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.185045 23908 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3cbce810b542c7b032e8cbe30abbfd (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:17.183429 23910 tablet_service.cc:1511] Processing CreateTablet for tablet eac75053172041f285deb68d4418ed57 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:17.187958 24051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac75053172041f285deb68d4418ed57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.198442 23903 tablet_service.cc:1511] Processing CreateTablet for tablet 6850e6a4a82a49d689423ed8fb40c891 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:17.204851 24059 tablet_service.cc:1511] Processing CreateTablet for tablet 8b3cbce810b542c7b032e8cbe30abbfd (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:17.204964 24052 tablet_service.cc:1511] Processing CreateTablet for tablet 0740227aa014467da8e8269927b1cfda (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:17.206832 24059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3cbce810b542c7b032e8cbe30abbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.210894 24055 tablet_service.cc:1511] Processing CreateTablet for tablet c59becc061884c78add6c7ec0be6583c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:17.186228 23908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3cbce810b542c7b032e8cbe30abbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.227540 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac75053172041f285deb68d4418ed57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.244554 23902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc5fe36cbf643f18c228bc420036e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.247160 23903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6850e6a4a82a49d689423ed8fb40c891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.278513 24055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59becc061884c78add6c7ec0be6583c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.279536 24052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0740227aa014467da8e8269927b1cfda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.310875 24117 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.311633 24117 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.330791 24111 tablet_bootstrap.cc:492] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:17.331391 24111 ts_tablet_manager.cc:1403] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.273s	user 0.027s	sys 0.026s
I20260709 12:16:17.335394 24109 tablet_bootstrap.cc:492] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:17.335907 24109 ts_tablet_manager.cc:1403] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.263s	user 0.024s	sys 0.038s
I20260709 12:16:17.342039 24058 tablet_service.cc:1511] Processing CreateTablet for tablet 6850e6a4a82a49d689423ed8fb40c891 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:17.343922 24058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6850e6a4a82a49d689423ed8fb40c891. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:17.346591 23804 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 159036us
I20260709 12:16:17.352934 24052 tablet_service.cc:1511] Processing CreateTablet for tablet 371c317c26eb44cd875c5925f4b31bd6 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:17.354310 24052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371c317c26eb44cd875c5925f4b31bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.358426 23906 tablet_service.cc:1511] Processing CreateTablet for tablet c59becc061884c78add6c7ec0be6583c (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:17.359846 23906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c59becc061884c78add6c7ec0be6583c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.360447 24110 tablet_bootstrap.cc:654] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:17.370651 23806 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 165869us
I20260709 12:16:17.381971 24117 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:17.383328 24116 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.383793 24116 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.386199 24116 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:17.387275 24109 raft_consensus.cc:359] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.388084 24109 raft_consensus.cc:385] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.388463 24109 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.389289 24109 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.403492 23905 tablet_service.cc:1511] Processing CreateTablet for tablet 371c317c26eb44cd875c5925f4b31bd6 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:17.411742 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371c317c26eb44cd875c5925f4b31bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.405198 23909 tablet_service.cc:1511] Processing CreateTablet for tablet 84a22fee7e714048af4a1d40001e99de (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:17.415172 23909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a22fee7e714048af4a1d40001e99de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.423327 23986 tablet_service.cc:1511] Processing CreateTablet for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:17.424755 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.430614 24111 raft_consensus.cc:359] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.454819 24111 raft_consensus.cc:385] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.455159 24111 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.455931 24111 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.463172 23908 tablet_service.cc:1511] Processing CreateTablet for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:17.463701 24060 tablet_service.cc:1511] Processing CreateTablet for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:17.464462 23908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.464843 24060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.466463 23904 tablet_service.cc:1511] Processing CreateTablet for tablet ccf053e06f514bffaa9c442a8ea2c144 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:17.466749 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:17.467000 24054 tablet_service.cc:1511] Processing CreateTablet for tablet ccf053e06f514bffaa9c442a8ea2c144 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:17.467690 23904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf053e06f514bffaa9c442a8ea2c144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.468220 24054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf053e06f514bffaa9c442a8ea2c144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.468256 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:17.469887 23887 leader_election.cc:343] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:17.470861 23887 leader_election.cc:343] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.471267 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:17.471179 24052 tablet_service.cc:1511] Processing CreateTablet for tablet 84a22fee7e714048af4a1d40001e99de (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:17.472035 24115 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.472364 24052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a22fee7e714048af4a1d40001e99de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.458173 24111 ts_tablet_manager.cc:1434] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.126s	user 0.007s	sys 0.001s
I20260709 12:16:17.480005 24111 tablet_bootstrap.cc:492] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:17.492142 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:16:17.493727 24034 leader_election.cc:343] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.500144 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:17.491281 23903 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2e07822f804c3c9a8ff2c0177d5d72 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:16:17.501415 23960 leader_election.cc:343] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.502053 23903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2e07822f804c3c9a8ff2c0177d5d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.502543 24109 ts_tablet_manager.cc:1434] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.166s	user 0.007s	sys 0.002s
I20260709 12:16:17.503284 24109 tablet_bootstrap.cc:492] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:17.508417 24109 tablet_bootstrap.cc:654] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.509379 23983 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2e07822f804c3c9a8ff2c0177d5d72 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:17.510761 23983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2e07822f804c3c9a8ff2c0177d5d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.518339 23977 tablet_service.cc:1511] Processing CreateTablet for tablet ea07088f87a54d2194bc706db4279d24 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:17.519635 23977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea07088f87a54d2194bc706db4279d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.521173 24110 tablet_bootstrap.cc:492] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:17.521755 24110 ts_tablet_manager.cc:1403] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.375s	user 0.012s	sys 0.014s
I20260709 12:16:17.525811 24110 raft_consensus.cc:359] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.526944 24110 raft_consensus.cc:385] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.527384 24110 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.527335 24059 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2e07822f804c3c9a8ff2c0177d5d72 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:17.531380 24110 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.544694 23910 tablet_service.cc:1511] Processing CreateTablet for tablet ea07088f87a54d2194bc706db4279d24 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:17.558925 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea07088f87a54d2194bc706db4279d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.561945 24058 tablet_service.cc:1511] Processing CreateTablet for tablet ea07088f87a54d2194bc706db4279d24 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:17.563243 24058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea07088f87a54d2194bc706db4279d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.563977 23980 tablet_service.cc:1511] Processing CreateTablet for tablet b36a4b120beb473694980945af8d8909 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:17.565192 23980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36a4b120beb473694980945af8d8909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.567229 24110 ts_tablet_manager.cc:1434] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.001s
I20260709 12:16:17.568131 24110 tablet_bootstrap.cc:492] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:17.567754 23911 tablet_service.cc:1511] Processing CreateTablet for tablet b36a4b120beb473694980945af8d8909 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:17.568964 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36a4b120beb473694980945af8d8909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.575474 24056 tablet_service.cc:1511] Processing CreateTablet for tablet b36a4b120beb473694980945af8d8909 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:17.575834 24055 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac362fb6ce545719be79028c2676d8f (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:17.571722 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac362fb6ce545719be79028c2676d8f (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:17.577396 23902 tablet_service.cc:1511] Processing CreateTablet for tablet 2a33810a45fd4e70b0d4411b8c0afdd6 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:17.574047 23909 tablet_service.cc:1511] Processing CreateTablet for tablet 8ac362fb6ce545719be79028c2676d8f (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:17.588454 24055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac362fb6ce545719be79028c2676d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.590893 23902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a33810a45fd4e70b0d4411b8c0afdd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.591487 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36a4b120beb473694980945af8d8909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.598538 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac362fb6ce545719be79028c2676d8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.602787 24059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2e07822f804c3c9a8ff2c0177d5d72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.613157 23909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ac362fb6ce545719be79028c2676d8f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:17.615913 24022 tablet.cc:2406] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:17.617533 23979 tablet_service.cc:1511] Processing CreateTablet for tablet 2a33810a45fd4e70b0d4411b8c0afdd6 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:17.608804 24111 tablet_bootstrap.cc:654] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.619820 23979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a33810a45fd4e70b0d4411b8c0afdd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.621865 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:17.622159 24109 tablet_bootstrap.cc:492] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:17.623191 24109 ts_tablet_manager.cc:1403] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.120s	user 0.034s	sys 0.049s
I20260709 12:16:17.626046 24109 raft_consensus.cc:359] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.626853 24109 raft_consensus.cc:385] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.627159 24109 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.627863 24109 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:17.632038 23962 leader_election.cc:343] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.632587 23962 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:17.635790 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:17.636799 24117 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:17.637539 24036 leader_election.cc:343] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.640202 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:17.641281 24116 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.636158 24109 ts_tablet_manager.cc:1434] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:16:17.645134 24109 tablet_bootstrap.cc:492] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:17.652649 24060 tablet_service.cc:1511] Processing CreateTablet for tablet 2a33810a45fd4e70b0d4411b8c0afdd6 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:17.653891 24060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a33810a45fd4e70b0d4411b8c0afdd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.674104 23906 tablet_service.cc:1511] Processing CreateTablet for tablet 15e681cfd0fe4e6f9e747ba4c2345a95 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:17.675719 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 15e681cfd0fe4e6f9e747ba4c2345a95 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:17.676946 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e681cfd0fe4e6f9e747ba4c2345a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.677496 24058 tablet_service.cc:1511] Processing CreateTablet for tablet 15e681cfd0fe4e6f9e747ba4c2345a95 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:17.658207 24110 tablet_bootstrap.cc:654] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.678126 23911 tablet_service.cc:1511] Processing CreateTablet for tablet d7f76f3699ab4bae8da2e38abd9f9348 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:17.679847 24058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e681cfd0fe4e6f9e747ba4c2345a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.685066 23977 tablet_service.cc:1511] Processing CreateTablet for tablet d7f76f3699ab4bae8da2e38abd9f9348 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:17.686223 23977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f76f3699ab4bae8da2e38abd9f9348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.692094 24109 tablet_bootstrap.cc:654] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.693943 23905 tablet_service.cc:1511] Processing CreateTablet for tablet 675e57b981c1430ba502ba18c21dd0a4 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:17.695223 23905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675e57b981c1430ba502ba18c21dd0a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.699913 23906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15e681cfd0fe4e6f9e747ba4c2345a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.700469 24116 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.700960 24116 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.702455 24111 tablet_bootstrap.cc:492] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:17.702591 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f76f3699ab4bae8da2e38abd9f9348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.702984 24111 ts_tablet_manager.cc:1403] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.223s	user 0.006s	sys 0.006s
I20260709 12:16:17.705792 24111 raft_consensus.cc:359] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.706480 24111 raft_consensus.cc:385] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.706615 24115 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.706799 24111 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.707166 24115 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.707376 24056 tablet_service.cc:1511] Processing CreateTablet for tablet d7f76f3699ab4bae8da2e38abd9f9348 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:17.707661 24111 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.709784 24115 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:17.710687 24116 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:17.712175 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:17.713400 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:17.715209 23995 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:17.716470 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:17.716480 24036 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:17.716462 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:17.717430 24116 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:17.717605 23887 leader_election.cc:343] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.717818 24116 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.718135 24116 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:17.718477 24034 leader_election.cc:343] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:17.720484 23887 leader_election.cc:343] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.720961 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:17.721892 23903 tablet_service.cc:1511] Processing CreateTablet for tablet 04e684c6cc9c44a496daa6c45678df59 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:17.722765 24115 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:17.723361 23903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e684c6cc9c44a496daa6c45678df59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.726830 24060 tablet_service.cc:1511] Processing CreateTablet for tablet 392f06df3ae54cb5a9746fdbb980ad3d (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:17.724200 23902 tablet_service.cc:1511] Processing CreateTablet for tablet 392f06df3ae54cb5a9746fdbb980ad3d (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:17.724938 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 392f06df3ae54cb5a9746fdbb980ad3d (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:17.730933 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392f06df3ae54cb5a9746fdbb980ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.724838 24059 tablet_service.cc:1511] Processing CreateTablet for tablet 675e57b981c1430ba502ba18c21dd0a4 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:17.731485 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f76f3699ab4bae8da2e38abd9f9348. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.740442 23902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392f06df3ae54cb5a9746fdbb980ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.741601 23910 tablet_service.cc:1511] Processing CreateTablet for tablet 4db304f4ee46489296e4f0f6b21cac26 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:17.742865 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db304f4ee46489296e4f0f6b21cac26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.745783 24059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675e57b981c1430ba502ba18c21dd0a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.746047 23980 tablet_service.cc:1511] Processing CreateTablet for tablet 04e684c6cc9c44a496daa6c45678df59 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:17.746367 24055 tablet_service.cc:1511] Processing CreateTablet for tablet 04e684c6cc9c44a496daa6c45678df59 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:17.747460 23980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e684c6cc9c44a496daa6c45678df59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.747601 24055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e684c6cc9c44a496daa6c45678df59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.748394 24060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392f06df3ae54cb5a9746fdbb980ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.763724 23979 tablet_service.cc:1511] Processing CreateTablet for tablet 675e57b981c1430ba502ba18c21dd0a4 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:17.765102 23979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675e57b981c1430ba502ba18c21dd0a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.766769 23985 tablet_service.cc:1511] Processing CreateTablet for tablet 4db304f4ee46489296e4f0f6b21cac26 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:17.769307 24053 tablet_service.cc:1511] Processing CreateTablet for tablet 4db304f4ee46489296e4f0f6b21cac26 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:17.770720 23909 tablet_service.cc:1511] Processing CreateTablet for tablet 91e7023603694b9d8a378858f72b4532 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:17.771842 24053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db304f4ee46489296e4f0f6b21cac26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.771997 23909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e7023603694b9d8a378858f72b4532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.775009 23985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db304f4ee46489296e4f0f6b21cac26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.783016 23986 tablet_service.cc:1511] Processing CreateTablet for tablet 91e7023603694b9d8a378858f72b4532 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:17.784255 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e7023603694b9d8a378858f72b4532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.784166 23904 tablet_service.cc:1511] Processing CreateTablet for tablet 5db9cea3b8f64883a51327db383cd13e (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:17.785403 23904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db9cea3b8f64883a51327db383cd13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.792301 23908 tablet_service.cc:1511] Processing CreateTablet for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:17.793969 23908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.795894 23907 tablet_service.cc:1511] Processing CreateTablet for tablet 49b6c160a80f417b89957aa0a1f5dd34 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:17.797049 23907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b6c160a80f417b89957aa0a1f5dd34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.808357 24109 tablet_bootstrap.cc:492] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:17.808842 24109 ts_tablet_manager.cc:1403] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.164s	user 0.017s	sys 0.001s
I20260709 12:16:17.811717 24109 raft_consensus.cc:359] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.812412 24109 raft_consensus.cc:385] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.812708 24109 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.813472 24109 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.815575 24109 ts_tablet_manager.cc:1434] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:16:17.817847 24109 tablet_bootstrap.cc:492] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:17.824368 23983 tablet_service.cc:1511] Processing CreateTablet for tablet 5db9cea3b8f64883a51327db383cd13e (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:17.825700 23983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db9cea3b8f64883a51327db383cd13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.824389 24110 tablet_bootstrap.cc:492] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:17.827221 24054 tablet_service.cc:1511] Processing CreateTablet for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:17.827659 24110 ts_tablet_manager.cc:1403] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.260s	user 0.015s	sys 0.012s
I20260709 12:16:17.828456 24054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.831334 23982 tablet_service.cc:1511] Processing CreateTablet for tablet 49b6c160a80f417b89957aa0a1f5dd34 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:17.832516 23982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b6c160a80f417b89957aa0a1f5dd34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.825728 24052 tablet_service.cc:1511] Processing CreateTablet for tablet 5db9cea3b8f64883a51327db383cd13e (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:17.834349 24116 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.835197 24052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db9cea3b8f64883a51327db383cd13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.837437 24116 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:17.837628 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:17.838176 23995 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.838586 24051 tablet_service.cc:1511] Processing CreateTablet for tablet 49b6c160a80f417b89957aa0a1f5dd34 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:17.839876 23984 tablet_service.cc:1511] Processing CreateTablet for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:17.841050 23984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.842841 24051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 49b6c160a80f417b89957aa0a1f5dd34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.843510 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:16:17.846100 24034 leader_election.cc:343] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.838584 24110 raft_consensus.cc:359] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.847070 24110 raft_consensus.cc:385] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:17.847365 24110 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:17.847513 24060 tablet_service.cc:1511] Processing CreateTablet for tablet 91e7023603694b9d8a378858f72b4532 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
W20260709 12:16:17.853118 23867 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:17.868170 23977 tablet_service.cc:1511] Processing CreateTablet for tablet 479416b99927471b8600549d94ad4873 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:17.869889 23995 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:17.848181 24110 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.887404 24110 ts_tablet_manager.cc:1434] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:16:17.887341 24058 tablet_service.cc:1511] Processing CreateTablet for tablet c11fc035985e44dfa44a64cfba349977 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:17.888576 24036 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:16:17.889375 24111 ts_tablet_manager.cc:1434] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.186s	user 0.024s	sys 0.021s
I20260709 12:16:17.890410 24111 tablet_bootstrap.cc:492] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:17.890981 23910 tablet_service.cc:1511] Processing CreateTablet for tablet 58aa4c7f8ec14db884253c7b025e4c26 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:17.877931 24060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e7023603694b9d8a378858f72b4532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.894529 24058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11fc035985e44dfa44a64cfba349977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.880010 23911 tablet_service.cc:1511] Processing CreateTablet for tablet 479416b99927471b8600549d94ad4873 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:17.897027 23911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479416b99927471b8600549d94ad4873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.898494 23983 tablet_service.cc:1511] Processing CreateTablet for tablet c11fc035985e44dfa44a64cfba349977 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:17.880484 24109 tablet_bootstrap.cc:654] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.906730 23910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58aa4c7f8ec14db884253c7b025e4c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.910346 24137 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:17.913525 24137 raft_consensus.cc:697] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:17.914589 24110 tablet_bootstrap.cc:492] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:17.882234 23907 tablet_service.cc:1511] Processing CreateTablet for tablet c11fc035985e44dfa44a64cfba349977 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:17.882952 23977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479416b99927471b8600549d94ad4873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.918143 24137 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.922791 23983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11fc035985e44dfa44a64cfba349977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.927142 23986 tablet_service.cc:1511] Processing CreateTablet for tablet 58aa4c7f8ec14db884253c7b025e4c26 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:17.928553 23986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58aa4c7f8ec14db884253c7b025e4c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.929867 24117 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:17.930380 24117 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.932551 24117 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:17.933746 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:17.934595 24056 tablet_service.cc:1511] Processing CreateTablet for tablet 479416b99927471b8600549d94ad4873 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
W20260709 12:16:17.935240 23962 leader_election.cc:343] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.936064 24056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479416b99927471b8600549d94ad4873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.942070 24111 tablet_bootstrap.cc:654] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.943684 24051 tablet_service.cc:1511] Processing CreateTablet for tablet 58aa4c7f8ec14db884253c7b025e4c26 (DEFAULT_TABLE table=test-workload [id=2f1e12cfa6d149909dc46310e730c2da]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:17.945086 24051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58aa4c7f8ec14db884253c7b025e4c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.947573 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:17.948405 23921 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:17.951871 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:17.953385 24117 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:17.953852 24117 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:17.954263 24117 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.959988 23907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11fc035985e44dfa44a64cfba349977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:17.958729 24110 tablet_bootstrap.cc:654] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:17.969585 24117 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:17.971611 24117 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:17.972333 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:17.972878 23921 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:17.973045 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:16:17.979496 23962 leader_election.cc:343] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:17.976359 23816 catalog_manager.cc:5697] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:17.984609 24109 tablet_bootstrap.cc:492] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:17.985322 24109 ts_tablet_manager.cc:1403] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.168s	user 0.005s	sys 0.027s
I20260709 12:16:17.989085 23921 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:17.990515 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:17.991611 24117 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.001572 24109 raft_consensus.cc:359] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.002323 24109 raft_consensus.cc:385] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.002633 24109 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.005678 24117 raft_consensus.cc:697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:18.008139 24111 tablet_bootstrap.cc:492] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.008612 24111 ts_tablet_manager.cc:1403] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.118s	user 0.024s	sys 0.005s
I20260709 12:16:18.007131 24117 consensus_queue.cc:237] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.011126 24111 raft_consensus.cc:359] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.012533 24111 raft_consensus.cc:385] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.012866 24111 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.013598 24111 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.015769 24111 ts_tablet_manager.cc:1434] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:16:18.016726 24111 tablet_bootstrap.cc:492] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.019927 24110 tablet_bootstrap.cc:492] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.020444 24110 ts_tablet_manager.cc:1403] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.003s
I20260709 12:16:18.012068 24109 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.028107 24109 ts_tablet_manager.cc:1434] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 12:16:18.029177 24109 tablet_bootstrap.cc:492] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.030655 24111 tablet_bootstrap.cc:654] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.037119 24109 tablet_bootstrap.cc:654] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.032866 24137 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.044304 24137 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.046201 24137 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:18.047780 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.047611 24110 raft_consensus.cc:359] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.048379 24110 raft_consensus.cc:385] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.048602 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.048709 24110 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
W20260709 12:16:18.049224 24036 leader_election.cc:343] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:18.049935 24034 leader_election.cc:343] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.049571 24110 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.050369 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:18.051326 24137 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.052640 24110 ts_tablet_manager.cc:1434] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:16:18.053439 24110 tablet_bootstrap.cc:492] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.053073 23817 catalog_manager.cc:5697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.058175 24111 tablet_bootstrap.cc:492] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.058864 24111 ts_tablet_manager.cc:1403] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.005s
I20260709 12:16:18.060693 24110 tablet_bootstrap.cc:654] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.062987 24111 raft_consensus.cc:359] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.064000 24111 raft_consensus.cc:385] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.064405 24111 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.065511 24111 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.069160 24111 ts_tablet_manager.cc:1434] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:16:18.070508 24111 tablet_bootstrap.cc:492] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.071861 24109 tablet_bootstrap.cc:492] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.072407 24109 ts_tablet_manager.cc:1403] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.014s
I20260709 12:16:18.075551 24109 raft_consensus.cc:359] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.076375 24109 raft_consensus.cc:385] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.076738 24109 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.077221 24111 tablet_bootstrap.cc:654] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.077744 24109 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.082764 24137 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.083410 24137 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.086566 24115 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.087358 24137 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:18.087302 24115 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.089039 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.091863 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:18.093948 24036 leader_election.cc:343] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:18.096333 24034 leader_election.cc:343] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.096954 24034 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:18.097153 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.099387 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:18.100210 23887 leader_election.cc:343] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:18.101146 23887 leader_election.cc:343] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.101660 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:18.090193 24115 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.106487 24115 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.105720 24137 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.110144 24109 ts_tablet_manager.cc:1434] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:16:18.116778 24109 tablet_bootstrap.cc:492] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.120292 24110 tablet_bootstrap.cc:492] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.120743 24110 ts_tablet_manager.cc:1403] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.067s	user 0.037s	sys 0.025s
I20260709 12:16:18.123245 24110 raft_consensus.cc:359] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.123858 24110 raft_consensus.cc:385] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.124123 24110 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.124967 24111 tablet_bootstrap.cc:492] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.124747 24110 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.125505 24111 ts_tablet_manager.cc:1403] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.055s	user 0.038s	sys 0.015s
I20260709 12:16:18.125864 24109 tablet_bootstrap.cc:654] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.126834 24110 ts_tablet_manager.cc:1434] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:16:18.128036 24110 tablet_bootstrap.cc:492] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.128696 24111 raft_consensus.cc:359] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.129709 24111 raft_consensus.cc:385] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.130091 24111 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.131296 24111 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.134626 24111 ts_tablet_manager.cc:1434] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.009s	user 0.011s	sys 0.000s
I20260709 12:16:18.135056 24110 tablet_bootstrap.cc:654] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.136125 24111 tablet_bootstrap.cc:492] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.143092 24111 tablet_bootstrap.cc:654] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.145421 24109 tablet_bootstrap.cc:492] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.146020 24109 ts_tablet_manager.cc:1403] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.002s
I20260709 12:16:18.150579 24109 raft_consensus.cc:359] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.151567 24109 raft_consensus.cc:385] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.151942 24109 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.152806 24109 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.154515 24111 tablet_bootstrap.cc:492] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.154999 24111 ts_tablet_manager.cc:1403] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.012s
I20260709 12:16:18.155205 24109 ts_tablet_manager.cc:1434] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:18.157541 24109 tablet_bootstrap.cc:492] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.157891 24110 tablet_bootstrap.cc:492] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.158411 24110 ts_tablet_manager.cc:1403] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.011s
I20260709 12:16:18.157931 24111 raft_consensus.cc:359] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.158826 24111 raft_consensus.cc:385] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.159122 24111 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.160025 24111 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.161396 24110 raft_consensus.cc:359] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.162127 24110 raft_consensus.cc:385] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.162442 24110 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.162634 24111 ts_tablet_manager.cc:1434] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:18.163190 24110 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.163812 24111 tablet_bootstrap.cc:492] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.167840 24110 ts_tablet_manager.cc:1434] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:16:18.168803 24110 tablet_bootstrap.cc:492] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.170430 24117 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.170674 24111 tablet_bootstrap.cc:654] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.170899 24117 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.173089 24117 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.175247 24110 tablet_bootstrap.cc:654] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.175648 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.176079 24109 tablet_bootstrap.cc:654] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:18.179636 23960 leader_election.cc:343] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.176926 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:18.181483 23962 leader_election.cc:343] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.181954 23962 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:18.188822 24109 tablet_bootstrap.cc:492] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.189435 24109 ts_tablet_manager.cc:1403] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.005s
I20260709 12:16:18.190778 24110 tablet_bootstrap.cc:492] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.191298 24110 ts_tablet_manager.cc:1403] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 12:16:18.191696 24117 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.192926 24109 raft_consensus.cc:359] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.194585 24109 raft_consensus.cc:385] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.194331 24110 raft_consensus.cc:359] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.195086 24110 raft_consensus.cc:385] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.195000 24109 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.195472 24110 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.196177 24109 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.196182 24110 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.199442 24109 ts_tablet_manager.cc:1434] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 12:16:18.201426 24110 ts_tablet_manager.cc:1434] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:16:18.202410 24110 tablet_bootstrap.cc:492] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.203714 24109 tablet_bootstrap.cc:492] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.208736 24110 tablet_bootstrap.cc:654] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.211763 24109 tablet_bootstrap.cc:654] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.220813 24110 tablet_bootstrap.cc:492] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.221287 24110 ts_tablet_manager.cc:1403] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.006s
I20260709 12:16:18.222808 24117 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.223300 24117 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.223723 24109 tablet_bootstrap.cc:492] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.224349 24109 ts_tablet_manager.cc:1403] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.005s
I20260709 12:16:18.225409 24117 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.227699 24111 tablet_bootstrap.cc:492] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.227365 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.227365 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.227463 24109 raft_consensus.cc:359] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.228173 24111 ts_tablet_manager.cc:1403] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.065s	user 0.028s	sys 0.032s
I20260709 12:16:18.228343 24109 raft_consensus.cc:385] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.228225 23921 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:18.228713 24109 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
W20260709 12:16:18.229110 23962 leader_election.cc:343] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.229655 23960 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:18.229377 24109 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.230378 24117 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.230794 24117 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.230840 24111 raft_consensus.cc:359] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.231248 24117 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.231554 24111 raft_consensus.cc:385] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.231885 24111 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.231667 24110 raft_consensus.cc:359] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.232358 24110 raft_consensus.cc:385] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.232636 24110 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.232697 24111 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.233410 24110 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.235029 24111 ts_tablet_manager.cc:1434] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:18.236085 24111 tablet_bootstrap.cc:492] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.239061 24117 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.242201 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.243040 24109 ts_tablet_manager.cc:1434] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:16:18.243145 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:16:18.243697 23962 leader_election.cc:343] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.244019 23921 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.244391 24117 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.246815 24109 tablet_bootstrap.cc:492] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.251586 23921 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:18.252722 24110 ts_tablet_manager.cc:1434] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:16:18.252704 23960 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:18.253008 24109 tablet_bootstrap.cc:654] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.253883 24110 tablet_bootstrap.cc:492] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.254582 24111 tablet_bootstrap.cc:654] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.259270 24110 tablet_bootstrap.cc:654] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.261345 24117 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.263028 24117 raft_consensus.cc:697] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:18.264142 24117 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.264882 24109 tablet_bootstrap.cc:492] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.265589 24109 ts_tablet_manager.cc:1403] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.006s
I20260709 12:16:18.268904 24109 raft_consensus.cc:359] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.269766 24109 raft_consensus.cc:385] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.270109 24109 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.270915 24109 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.277984 24110 tablet_bootstrap.cc:492] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.278550 24110 ts_tablet_manager.cc:1403] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 12:16:18.280375 24109 ts_tablet_manager.cc:1434] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:16:18.281328 24109 tablet_bootstrap.cc:492] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.280797 23816 catalog_manager.cc:5697] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.281400 24110 raft_consensus.cc:359] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.282142 24111 tablet_bootstrap.cc:492] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.282258 24110 raft_consensus.cc:385] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.282645 24111 ts_tablet_manager.cc:1403] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.016s
I20260709 12:16:18.282740 24110 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.285207 24111 raft_consensus.cc:359] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.285846 24111 raft_consensus.cc:385] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.286087 24111 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.287123 24109 tablet_bootstrap.cc:654] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.286831 24111 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.292325 24110 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.294359 24110 ts_tablet_manager.cc:1434] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:16:18.296689 24110 tablet_bootstrap.cc:492] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.298712 24111 ts_tablet_manager.cc:1434] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:16:18.303089 24110 tablet_bootstrap.cc:654] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.307761 24111 tablet_bootstrap.cc:492] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.313920 24110 tablet_bootstrap.cc:492] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.314390 24110 ts_tablet_manager.cc:1403] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:16:18.314427 24109 tablet_bootstrap.cc:492] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.314625 24111 tablet_bootstrap.cc:654] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.314890 24109 ts_tablet_manager.cc:1403] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.019s
I20260709 12:16:18.317070 24110 raft_consensus.cc:359] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.317947 24110 raft_consensus.cc:385] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.317575 24109 raft_consensus.cc:359] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.318251 24110 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.318480 24109 raft_consensus.cc:385] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.318802 24109 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.319101 24110 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.319381 24109 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.320322 24111 tablet_bootstrap.cc:492] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.320715 24111 ts_tablet_manager.cc:1403] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:16:18.321450 24109 ts_tablet_manager.cc:1434] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:18.322408 24109 tablet_bootstrap.cc:492] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.323189 24111 raft_consensus.cc:359] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.323812 24111 raft_consensus.cc:385] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.324056 24111 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.324774 24111 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.325224 24110 ts_tablet_manager.cc:1434] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:16:18.327275 24137 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.327705 24137 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.328364 24109 tablet_bootstrap.cc:654] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.329689 24110 tablet_bootstrap.cc:492] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.329815 24137 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:18.331559 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.334085 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.334921 23921 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
W20260709 12:16:18.336448 24036 leader_election.cc:343] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.337661 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:18.338762 24137 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.339120 24110 tablet_bootstrap.cc:654] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.339114 24137 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.339448 24109 tablet_bootstrap.cc:492] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.339650 24137 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.339897 24109 ts_tablet_manager.cc:1403] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:16:18.342536 24109 raft_consensus.cc:359] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.343215 24109 raft_consensus.cc:385] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.343468 24109 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.344249 24109 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.346204 24109 ts_tablet_manager.cc:1434] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:18.346884 24137 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.347435 24109 tablet_bootstrap.cc:492] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.349537 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:18.350172 23921 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.353706 24109 tablet_bootstrap.cc:654] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.357443 23921 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:18.358321 24111 ts_tablet_manager.cc:1434] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:16:18.358697 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:18.359632 24110 tablet_bootstrap.cc:492] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.360076 24110 ts_tablet_manager.cc:1403] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.006s
I20260709 12:16:18.360801 24109 tablet_bootstrap.cc:492] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.361284 24109 ts_tablet_manager.cc:1403] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.004s
I20260709 12:16:18.361377 24116 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.361763 24152 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.362215 24152 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.362779 24110 raft_consensus.cc:359] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.363422 24110 raft_consensus.cc:385] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.363692 24110 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.364322 24152 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.364434 24110 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.365036 24109 raft_consensus.cc:359] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.365991 24109 raft_consensus.cc:385] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.366423 24109 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.367269 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.367805 24111 tablet_bootstrap.cc:492] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.367380 24109 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.367914 24070 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.369264 24110 ts_tablet_manager.cc:1434] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:16:18.369462 24109 ts_tablet_manager.cc:1434] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:18.370160 24110 tablet_bootstrap.cc:492] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.370630 24109 tablet_bootstrap.cc:492] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.376135 24110 tablet_bootstrap.cc:654] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.377874 24109 tablet_bootstrap.cc:654] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.378661 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:18.379617 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:18.379954 24115 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.380302 24115 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.380636 24115 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:18.381003 24036 leader_election.cc:343] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.382016 24137 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:18.384421 24116 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:18.385290 24116 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.388217 24115 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.377882 24111 tablet_bootstrap.cc:654] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.389498 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.392236 23995 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.392416 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:18.392674 24115 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.392957 23996 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.393579 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.394148 24070 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.395538 24110 tablet_bootstrap.cc:492] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.396039 24110 ts_tablet_manager.cc:1403] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.005s
I20260709 12:16:18.398108 24109 tablet_bootstrap.cc:492] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.398695 24109 ts_tablet_manager.cc:1403] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.008s
I20260709 12:16:18.399923 24110 raft_consensus.cc:359] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.400573 24110 raft_consensus.cc:385] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.400832 24110 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.401183 23996 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.401587 24109 raft_consensus.cc:359] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.402426 24109 raft_consensus.cc:385] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.402541 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.402861 24109 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.403484 24152 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.403955 24152 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:18.403677 24109 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.401455 24110 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.405463 24152 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.406984 24110 ts_tablet_manager.cc:1434] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:16:18.408135 24110 tablet_bootstrap.cc:492] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.409957 23819 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.415187 24109 ts_tablet_manager.cc:1434] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 12:16:18.415304 24110 tablet_bootstrap.cc:654] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.416298 24109 tablet_bootstrap.cc:492] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.417935 24117 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.422358 23921 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.426445 24117 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.426532 24109 tablet_bootstrap.cc:654] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.427003 24117 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.429531 24152 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.429991 24152 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.432067 24152 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.433970 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.434691 23919 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:18.436025 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.436622 23996 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.437716 24117 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.438731 23960 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.438933 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.439644 24069 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:18.440043 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.441459 24152 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.441792 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.442453 24069 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.441799 24152 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.443485 24152 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.443766 24111 tablet_bootstrap.cc:492] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.444670 24111 ts_tablet_manager.cc:1403] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.000s
I20260709 12:16:18.448535 24111 raft_consensus.cc:359] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.450062 24111 raft_consensus.cc:385] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.450367 24111 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.451023 24117 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.451381 24117 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.455044 24117 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.455544 24152 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.447948 24070 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.458218 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:18.458768 23996 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.459045 24152 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.463161 24111 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.463936 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.464463 24070 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.465162 24111 ts_tablet_manager.cc:1434] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:16:18.469033 24111 tablet_bootstrap.cc:492] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.469751 23996 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.470960 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.472697 24152 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.473316 24152 raft_consensus.cc:697] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:18.477223 24111 tablet_bootstrap.cc:654] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.479110 24116 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.484638 24117 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.492277 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:18.492954 23919 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.494068 24070 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.474149 24152 consensus_queue.cc:237] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.500072 24117 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.510106 23816 catalog_manager.cc:5697] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.514931 23919 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:18.520831 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.527890 24109 tablet_bootstrap.cc:492] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.528370 24109 ts_tablet_manager.cc:1403] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.112s	user 0.030s	sys 0.035s
I20260709 12:16:18.529315 24110 tablet_bootstrap.cc:492] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.529762 24110 ts_tablet_manager.cc:1403] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.122s	user 0.041s	sys 0.068s
I20260709 12:16:18.530772 23960 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.535128 24171 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:18.536393 24143 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.527112 24070 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.536130 24109 raft_consensus.cc:359] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.546368 24109 raft_consensus.cc:385] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.546708 24109 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.547398 24109 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.550519 24110 raft_consensus.cc:359] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.551263 24110 raft_consensus.cc:385] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.551553 24110 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.551674 24069 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.552217 24110 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.554003 24109 ts_tablet_manager.cc:1434] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.006s
I20260709 12:16:18.555050 24109 tablet_bootstrap.cc:492] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.560060 24110 ts_tablet_manager.cc:1434] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.003s
I20260709 12:16:18.564333 24111 tablet_bootstrap.cc:492] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.564878 24111 ts_tablet_manager.cc:1403] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.010s
I20260709 12:16:18.567157 24152 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.567662 24152 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.569744 24152 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.571976 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.574309 23995 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.575050 24152 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.575575 24152 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.572163 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.576854 24068 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.577603 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.578302 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.578898 23995 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.582552 24176 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.583829 23887 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.584167 24176 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.584550 24176 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.585536 24111 raft_consensus.cc:359] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.586803 24111 raft_consensus.cc:385] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.587040 24111 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.585902 24152 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.588541 24152 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.588867 24152 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.589198 24152 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.587586 24111 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:18.590901 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60470.4us
I20260709 12:16:18.595220 24171 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.595762 24171 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.600469 24070 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:18.601770 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.604362 24171 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:18.608182 24111 ts_tablet_manager.cc:1434] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 12:16:18.609342 24111 tablet_bootstrap.cc:492] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.612579 23816 catalog_manager.cc:5697] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.607169 24117 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:16:18.617713 24117 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.618386 24117 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.619292 24171 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.620151 24171 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.622829 24171 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:18.625680 24110 tablet_bootstrap.cc:492] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.626946 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.627914 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.623632 24152 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.628093 23995 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:18.628780 23920 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:18.635731 24036 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.637036 24171 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.635890 24117 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.637486 24171 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.637085 24176 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.637876 24171 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.639024 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.639490 24176 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.639632 24069 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
W20260709 12:16:18.630919 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49248.4us
I20260709 12:16:18.640767 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.641217 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.642306 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.647523 24068 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.646791 24117 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.647864 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:18.648088 24117 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.648587 24117 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.647550 24109 tablet_bootstrap.cc:654] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.629778 24143 raft_consensus.cc:697] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:18.648808 23996 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.650353 24143 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.658592 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.658563 24171 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:18.665153 23887 leader_election.cc:343] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.665217 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:18.666792 24137 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:18.670678 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.671329 23920 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:18.671681 24171 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:18.672636 23996 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.674103 24191 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.674544 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:18.674762 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:18.675207 23995 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.674608 24191 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.676472 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.676717 24152 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.664053 24068 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.677230 24152 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.678666 24152 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:18.679455 24152 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.680383 24111 tablet_bootstrap.cc:654] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.680725 24110 tablet_bootstrap.cc:654] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.675474 23920 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.689083 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.686434 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:18.691139 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.691310 23996 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.691993 23918 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:18.693224 23995 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:18.697486 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:16:18.696952 23887 leader_election.cc:343] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.700184 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.702622 24111 tablet_bootstrap.cc:492] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.703579 24068 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:18.704329 24111 ts_tablet_manager.cc:1403] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.007s
I20260709 12:16:18.704140 23819 catalog_manager.cc:5697] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.704557 24117 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.706171 24036 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.707337 24171 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.707270 24111 raft_consensus.cc:359] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.707849 24171 raft_consensus.cc:697] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:18.707998 24111 raft_consensus.cc:385] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.708264 24111 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.708673 24171 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.708989 24111 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.711086 24111 ts_tablet_manager.cc:1434] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:16:18.711935 24111 tablet_bootstrap.cc:492] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.694468 24191 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.712741 24117 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.713400 24143 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.713873 24143 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.714263 24143 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.722499 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:18.723122 23918 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.714938 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.725485 24070 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.730369 24117 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.731077 24117 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.734723 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.735325 23919 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:18.736573 23960 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.736951 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.737432 24191 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.737871 24191 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.737983 24117 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.738242 24191 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.721263 24152 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.737855 24068 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:18.740521 24152 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.745918 24152 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.746809 24188 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:18.752374 24070 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:18.753476 24110 tablet_bootstrap.cc:492] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.753249 24191 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.753607 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.755281 24188 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.755801 24188 raft_consensus.cc:697] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:18.756453 24191 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.753981 24110 ts_tablet_manager.cc:1403] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.016s
I20260709 12:16:18.756767 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:18.756597 24188 consensus_queue.cc:237] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.751646 23819 catalog_manager.cc:5697] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:18.757344 24111 tablet_bootstrap.cc:654] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.757297 23921 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.759850 23920 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:18.769872 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.770256 23918 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:18.770567 23995 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.775475 24152 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.775957 24152 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.779000 24152 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.779248 24109 tablet_bootstrap.cc:492] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.779740 24109 ts_tablet_manager.cc:1403] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.225s	user 0.017s	sys 0.005s
I20260709 12:16:18.781133 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.784271 24109 raft_consensus.cc:359] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.784941 24109 raft_consensus.cc:385] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.785207 24109 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.785907 24109 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.787250 24109 ts_tablet_manager.cc:1434] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:18.787873 24109 tablet_bootstrap.cc:492] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.789131 24171 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.789655 24171 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.791568 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.791517 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.780665 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.793219 24190 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:18.793838 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.794502 24068 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.794323 24190 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.794603 24171 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:18.778059 23921 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:18.795816 24152 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.796296 24152 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.797910 23960 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.798530 24152 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.781736 23996 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.800707 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.800804 24188 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.801492 24188 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:18.802624 24188 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.803790 24110 raft_consensus.cc:359] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.804415 24110 raft_consensus.cc:385] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.804661 24110 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.805573 24110 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.796320 24190 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:16:18.807014 24036 leader_election.cc:343] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:18.799083 23887 leader_election.cc:343] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.810228 24110 ts_tablet_manager.cc:1434] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.053s	user 0.003s	sys 0.003s
I20260709 12:16:18.809284 23995 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:18.808571 24152 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:18.810705 24194 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:16:18.812093 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:18.808779 24070 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.811192 24110 tablet_bootstrap.cc:492] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:18.813733 24190 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:18.815059 24190 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:18.815394 24190 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.816910 24111 tablet_bootstrap.cc:492] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.817070 24152 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.818480 24111 ts_tablet_manager.cc:1403] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.018s
I20260709 12:16:18.821358 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:18.824354 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:18.826828 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:18.826992 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:18.827865 23995 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.828444 24111 raft_consensus.cc:359] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.829121 24111 raft_consensus.cc:385] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.829398 24111 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.830156 24111 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.832008 24110 tablet_bootstrap.cc:654] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.830588 24143 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.834491 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:16:18.835167 24034 leader_election.cc:343] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.835615 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:18.835834 24171 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.842979 24111 ts_tablet_manager.cc:1434] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:16:18.845363 24111 tablet_bootstrap.cc:492] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.839725 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.848558 24068 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.837105 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:18.850958 23918 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.850381 24190 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.836695 24137 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.854821 24069 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.853787 24109 tablet_bootstrap.cc:654] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.852663 24190 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.838824 24143 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:18.836234 23995 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.865953 23819 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.874185 24070 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:18.877822 24143 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.837116 23887 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:18.882642 24190 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.883242 24190 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:18.884160 24110 tablet_bootstrap.cc:492] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.884595 24110 ts_tablet_manager.cc:1403] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.023s
I20260709 12:16:18.884280 24190 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.869210 23818 catalog_manager.cc:5697] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:18.890235 23867 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:18.891283 24068 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:18.892095 24111 tablet_bootstrap.cc:654] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.892575 23962 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.895143 24204 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.895795 24204 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:18.897308 24204 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.874185 23918 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
W20260709 12:16:18.893363 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 56336.5us
W20260709 12:16:18.909150 23887 leader_election.cc:343] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.910637 23818 catalog_manager.cc:5697] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.914224 24109 tablet_bootstrap.cc:492] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:18.914698 24109 ts_tablet_manager.cc:1403] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.008s
I20260709 12:16:18.911975 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:18.917608 24110 raft_consensus.cc:359] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.918262 24110 raft_consensus.cc:385] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.918560 24110 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.918455 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:18.919247 24110 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.919066 24068 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.919905 24190 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.920516 24190 raft_consensus.cc:697] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:16:18.921046 23887 leader_election.cc:343] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.921456 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:18.921339 24190 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.922855 24152 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:18.924222 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:18.924767 23995 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.926842 24068 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.932432 24110 ts_tablet_manager.cc:1434] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.000s
I20260709 12:16:18.932488 23995 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:18.933518 24110 tablet_bootstrap.cc:492] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
W20260709 12:16:18.934855 23887 leader_election.cc:343] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:18.937162 24109 raft_consensus.cc:359] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.938184 24109 raft_consensus.cc:385] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.938524 24109 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.939693 24109 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.942200 24109 ts_tablet_manager.cc:1434] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:16:18.937106 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:18.944898 24152 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:18.945327 24152 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:18.946206 24152 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.949394 23995 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:18.956493 24111 tablet_bootstrap.cc:492] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:18.957231 24111 ts_tablet_manager.cc:1403] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.002s
I20260709 12:16:18.964342 24111 raft_consensus.cc:359] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.965282 24111 raft_consensus.cc:385] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:18.965616 24111 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:18.967067 24109 tablet_bootstrap.cc:492] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:18.970474 24110 tablet_bootstrap.cc:654] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.971472 24111 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.973944 24152 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.974663 24111 ts_tablet_manager.cc:1434] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:16:18.975855 24111 tablet_bootstrap.cc:492] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:18.983645 23816 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:18.985747 24171 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:18.989171 24109 tablet_bootstrap.cc:654] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.995637 24111 tablet_bootstrap.cc:654] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:18.995661 24110 tablet_bootstrap.cc:492] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:18.996239 24110 ts_tablet_manager.cc:1403] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.063s	user 0.008s	sys 0.004s
I20260709 12:16:18.998858 24110 raft_consensus.cc:359] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:18.999663 24110 raft_consensus.cc:385] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.000000 24110 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.004405 24190 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.002992 24110 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.015060 23818 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.020797 24111 tablet_bootstrap.cc:492] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:19.021389 24111 ts_tablet_manager.cc:1403] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.005s
I20260709 12:16:19.024685 24109 tablet_bootstrap.cc:492] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:19.025316 24109 ts_tablet_manager.cc:1403] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.008s
I20260709 12:16:19.024595 24111 raft_consensus.cc:359] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.028311 24111 raft_consensus.cc:385] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.028594 24110 ts_tablet_manager.cc:1434] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:16:19.028733 24111 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.029898 24111 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.028311 24109 raft_consensus.cc:359] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.031313 24109 raft_consensus.cc:385] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.031708 24109 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.029946 24110 tablet_bootstrap.cc:492] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:19.032928 24111 ts_tablet_manager.cc:1434] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:16:19.034214 24111 tablet_bootstrap.cc:492] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:19.036273 23816 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.038654 23816 catalog_manager.cc:5697] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:19.042369 24109 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.045116 24111 tablet_bootstrap.cc:654] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.048810 24110 tablet_bootstrap.cc:654] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.051295 24109 ts_tablet_manager.cc:1434] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:16:19.052254 24109 tablet_bootstrap.cc:492] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:19.056408 24111 tablet_bootstrap.cc:492] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:19.056929 24111 ts_tablet_manager.cc:1403] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.012s
I20260709 12:16:19.057967 24109 tablet_bootstrap.cc:654] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.059758 24111 raft_consensus.cc:359] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.060624 24111 raft_consensus.cc:385] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.060958 24111 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.061769 24111 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.064131 24111 ts_tablet_manager.cc:1434] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:19.065083 24111 tablet_bootstrap.cc:492] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:19.070933 24111 tablet_bootstrap.cc:654] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.076545 24109 tablet_bootstrap.cc:492] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:19.077112 24109 ts_tablet_manager.cc:1403] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 12:16:19.080247 24109 raft_consensus.cc:359] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.080991 24109 raft_consensus.cc:385] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.081337 24109 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.082149 24109 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.087440 24109 ts_tablet_manager.cc:1434] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:19.088615 24109 tablet_bootstrap.cc:492] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:19.090395 24111 tablet_bootstrap.cc:492] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:19.090915 24111 ts_tablet_manager.cc:1403] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.000s
I20260709 12:16:19.092655 24110 tablet_bootstrap.cc:492] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:19.093101 24110 ts_tablet_manager.cc:1403] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.004s
I20260709 12:16:19.093967 24111 raft_consensus.cc:359] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.094729 24111 raft_consensus.cc:385] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.095078 24111 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.095791 24111 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.097615 24111 ts_tablet_manager.cc:1434] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:19.098752 24111 tablet_bootstrap.cc:492] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:19.099149 24152 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.101437 24109 tablet_bootstrap.cc:654] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.104678 24111 tablet_bootstrap.cc:654] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.109570 24152 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.113152 24110 raft_consensus.cc:359] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.113809 24110 raft_consensus.cc:385] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.114086 24110 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.114780 24111 tablet_bootstrap.cc:492] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:19.115304 24111 ts_tablet_manager.cc:1403] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 12:16:19.117473 24110 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.117959 24111 raft_consensus.cc:359] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.118745 24111 raft_consensus.cc:385] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.119066 24111 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.119521 24110 ts_tablet_manager.cc:1434] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.002s
I20260709 12:16:19.119582 24143 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.119745 24111 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.120487 24110 tablet_bootstrap.cc:492] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:19.121506 24111 ts_tablet_manager.cc:1434] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:19.122437 24111 tablet_bootstrap.cc:492] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:19.129534 24111 tablet_bootstrap.cc:654] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.137995 24109 tablet_bootstrap.cc:492] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:19.140180 24109 ts_tablet_manager.cc:1403] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.002s
I20260709 12:16:19.145267 24110 tablet_bootstrap.cc:654] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.145627 24152 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.148917 24109 raft_consensus.cc:359] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.150750 24109 raft_consensus.cc:385] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.151319 24109 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.153853 24109 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.171734 24110 tablet_bootstrap.cc:492] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:19.176628 24110 ts_tablet_manager.cc:1403] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.005s
I20260709 12:16:19.177382 24109 ts_tablet_manager.cc:1434] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:16:19.178236 24109 tablet_bootstrap.cc:492] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:19.174906 24204 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.184724 24109 tablet_bootstrap.cc:654] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.184150 24204 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.187657 24188 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.189162 24116 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.189370 24111 tablet_bootstrap.cc:492] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:19.189800 24111 ts_tablet_manager.cc:1403] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.068s	user 0.041s	sys 0.019s
I20260709 12:16:19.189646 24116 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.191684 24116 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:19.192337 24111 raft_consensus.cc:359] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.192968 24111 raft_consensus.cc:385] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.193228 24111 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.193832 24111 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.178995 24110 raft_consensus.cc:359] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.194839 24110 raft_consensus.cc:385] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.195230 24110 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.196194 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:19.196043 24110 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.196790 23995 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:19.197619 24111 ts_tablet_manager.cc:1434] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:16:19.198510 24111 tablet_bootstrap.cc:492] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:19.207144 24152 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.199031 24036 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:19.207628 24152 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.199906 24190 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:16:19.200205 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:19.211472 23918 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:19.201968 24137 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.212982 24137 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.215368 24137 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:19.215782 24116 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.216228 24116 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.216599 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:19.216791 24116 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.217272 24068 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:19.221724 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:19.222559 23921 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:19.222982 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:19.223891 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:19.224128 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:19.224422 24188 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.225979 24117 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.226078 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:19.228019 24068 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:19.226450 24117 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.230628 24117 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:19.226145 23887 leader_election.cc:343] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.227073 24034 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:19.231940 24171 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.232329 24171 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.232687 24171 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.210120 24152 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:19.227849 24137 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:19.239851 24036 leader_election.cc:343] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.240331 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:19.244423 24152 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.244902 24152 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.245313 24152 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.251860 24171 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.198753 24110 ts_tablet_manager.cc:1434] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:16:19.250474 24117 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.261339 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:19.261941 23921 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.255199 24188 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.264550 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:19.264712 24117 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:19.265192 24068 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.267594 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:16:19.269181 23960 leader_election.cc:343] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.272328 23921 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:19.273097 24068 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:19.274062 24117 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.274525 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:16:19.274832 24117 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.275921 24188 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.276067 24171 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:19.204310 24191 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.054s
I20260709 12:16:19.277046 24117 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:19.277222 24109 tablet_bootstrap.cc:492] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:19.277148 24171 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.277771 24109 ts_tablet_manager.cc:1403] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.100s	user 0.039s	sys 0.043s
I20260709 12:16:19.278256 24171 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.280577 24171 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:19.280929 24109 raft_consensus.cc:359] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.281656 24109 raft_consensus.cc:385] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.206104 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:19.281931 24109 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.282967 24034 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:19.205159 24204 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:19.204185 24111 tablet_bootstrap.cc:654] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.276461 24188 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:19.256827 24152 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.260273 24110 tablet_bootstrap.cc:492] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:19.297565 24204 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.300081 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:19.300542 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:19.307674 23960 leader_election.cc:343] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.308027 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:19.314460 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:16:19.314998 24036 leader_election.cc:343] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.315107 23921 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:19.293553 24137 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:19.315946 24036 leader_election.cc:343] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.312810 24109 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.313841 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:19.321890 24137 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:19.294301 24116 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:19.340375 23960 leader_election.cc:343] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.341094 24034 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:19.340402 24066 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.351858 24115 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.353084 24115 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.356232 24137 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.356280 24204 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.357343 24115 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:19.347510 24171 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.361454 24109 ts_tablet_manager.cc:1434] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.083s	user 0.001s	sys 0.009s
I20260709 12:16:19.335554 24188 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:19.368202 23962 leader_election.cc:343] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.368749 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:19.369614 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:19.363680 24171 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.370434 24204 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.375551 24152 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:19.373992 24171 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.379204 24240 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:16:19.380921 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:16:19.381471 23887 leader_election.cc:343] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.386849 24109 tablet_bootstrap.cc:492] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:19.411185 24111 tablet_bootstrap.cc:492] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:19.411831 24111 ts_tablet_manager.cc:1403] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.214s	user 0.027s	sys 0.010s
I20260709 12:16:19.382447 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:19.413199 24064 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:19.385656 23887 leader_election.cc:343] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.422447 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:19.423327 24065 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:19.423604 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:19.424407 23919 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.430919 24110 tablet_bootstrap.cc:654] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.419307 24116 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:19.441378 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:19.475858 24204 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.476593 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:19.480260 23996 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.481527 24111 raft_consensus.cc:359] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.482323 24111 raft_consensus.cc:385] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.482542 24152 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:19.482708 24111 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.483037 24152 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:19.483465 24152 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.485335 24111 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:19.486784 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 51823.5us
I20260709 12:16:19.491129 24115 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.500398 24111 ts_tablet_manager.cc:1434] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.001s
I20260709 12:16:19.501101 24111 tablet_bootstrap.cc:492] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:19.490089 24176 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:16:19.497184 23919 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:19.527282 24176 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:19.533155 24034 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:19.544760 24137 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.545210 24137 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:19.546227 24109 tablet_bootstrap.cc:654] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.547580 24190 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.541035 24244 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.546767 24171 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:19.639508 24249 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:16:19.614823 24244 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.648229 24064 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:19.657586 24242 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.658314 24242 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.584473 24137 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:19.687608 24246 log.cc:927] Time spent T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
I20260709 12:16:19.677616 24152 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.695845 24242 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:19.687163 23996 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
W20260709 12:16:19.701810 24241 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 12:16:19.700659 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:19.706200 24171 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:19.708065 24110 tablet_bootstrap.cc:492] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:19.708490 24110 ts_tablet_manager.cc:1403] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.448s	user 0.023s	sys 0.005s
I20260709 12:16:19.724629 24110 raft_consensus.cc:359] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.725152 24110 raft_consensus.cc:385] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.725392 24110 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.746496 24111 tablet_bootstrap.cc:654] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.761507 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:19.762177 23919 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.763247 23817 catalog_manager.cc:5697] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:19.768620 24245 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.239s	user 0.001s	sys 0.003s
I20260709 12:16:19.770730 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:19.745059 24115 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:19.773869 24244 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:19.784343 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:19.812501 24110 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:19.813699 24247 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.083s	user 0.008s	sys 0.008s
W20260709 12:16:19.806720 24250 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.001s
I20260709 12:16:19.821224 24110 ts_tablet_manager.cc:1434] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.112s	user 0.004s	sys 0.009s
I20260709 12:16:19.811375 24152 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:19.824891 24259 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:19.825601 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 52549.6us
I20260709 12:16:19.840679 24109 tablet_bootstrap.cc:492] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:19.841161 24109 ts_tablet_manager.cc:1403] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.455s	user 0.022s	sys 0.000s
I20260709 12:16:19.815300 24115 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.826092 24110 tablet_bootstrap.cc:492] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:19.804821 23919 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
W20260709 12:16:19.813313 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 56792.9us
I20260709 12:16:19.850862 24111 tablet_bootstrap.cc:492] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:19.851389 24111 ts_tablet_manager.cc:1403] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.350s	user 0.011s	sys 0.016s
I20260709 12:16:19.852329 24109 raft_consensus.cc:359] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.853010 24109 raft_consensus.cc:385] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.853262 24109 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
W20260709 12:16:19.850934 23960 consensus_peers.cc:597] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:19.857604 24115 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:19.856340 24109 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.858414 24110 tablet_bootstrap.cc:654] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.859756 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:19.855994 24259 raft_consensus.cc:697] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:19.861562 24137 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:19.863421 24109 ts_tablet_manager.cc:1434] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:16:19.865221 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:19.865474 24109 tablet_bootstrap.cc:492] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:19.866485 24111 raft_consensus.cc:359] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.867123 24111 raft_consensus.cc:385] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.867332 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:19.867383 24111 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.868450 24111 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.871409 24111 ts_tablet_manager.cc:1434] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
I20260709 12:16:19.872555 24111 tablet_bootstrap.cc:492] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:19.872473 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:19.872944 24109 tablet_bootstrap.cc:654] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.873113 24064 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.877316 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:19.877912 23993 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:19.880594 24067 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:19.884516 24036 leader_election.cc:343] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.886572 24115 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.886754 24204 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:19.887179 24111 tablet_bootstrap.cc:654] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.890656 24110 tablet_bootstrap.cc:492] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:19.891772 24110 ts_tablet_manager.cc:1403] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.005s
I20260709 12:16:19.880546 24259 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.908445 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:19.910043 24034 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:19.912910 23993 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:19.916287 24110 raft_consensus.cc:359] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.916934 24110 raft_consensus.cc:385] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.917230 24110 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.898965 24064 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:19.917898 24110 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.913446 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:19.914021 24244 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.919283 24244 raft_consensus.cc:697] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:19.920364 24110 ts_tablet_manager.cc:1434] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:16:19.920068 24244 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.921252 24110 tablet_bootstrap.cc:492] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
W20260709 12:16:19.925160 24036 consensus_peers.cc:597] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:19.935822 24256 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:19.932857 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:19.938769 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:19.942847 24242 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:19.948112 24111 tablet_bootstrap.cc:492] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:19.948559 24111 ts_tablet_manager.cc:1403] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.076s	user 0.017s	sys 0.003s
I20260709 12:16:19.949077 24110 tablet_bootstrap.cc:654] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:19.949478 24068 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:19.956838 23816 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:19.961090 24111 raft_consensus.cc:359] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.961766 24111 raft_consensus.cc:385] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:19.962056 24111 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:19.964092 24111 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.952643 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:16:19.965489 23887 leader_election.cc:343] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:19.966497 24111 ts_tablet_manager.cc:1434] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
W20260709 12:16:19.966900 23867 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:19.967195 24115 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:19.967422 24111 tablet_bootstrap.cc:492] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:19.967662 24115 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:19.968644 24109 tablet_bootstrap.cc:492] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:19.968447 24115 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:19.969053 24109 ts_tablet_manager.cc:1403] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.104s	user 0.006s	sys 0.016s
W20260709 12:16:20.037006 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 57982.9us
I20260709 12:16:20.064527 24109 raft_consensus.cc:359] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.065075 24109 raft_consensus.cc:385] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.065245 24109 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.065625 24109 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.051848 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:20.071847 24109 ts_tablet_manager.cc:1434] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.103s	user 0.004s	sys 0.005s
I20260709 12:16:20.075654 24109 tablet_bootstrap.cc:492] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.077108 24269 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.077540 24269 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.077860 24269 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.082298 24115 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.082816 24115 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.084769 24115 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.110895 24115 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.111397 24115 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.113570 24110 tablet_bootstrap.cc:492] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.117597 24111 tablet_bootstrap.cc:654] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.117672 24110 ts_tablet_manager.cc:1403] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.197s	user 0.009s	sys 0.009s
I20260709 12:16:20.119661 24115 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.091562 24269 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.123852 24110 raft_consensus.cc:359] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.124492 24110 raft_consensus.cc:385] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.124764 24110 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.125349 24110 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.127135 24110 ts_tablet_manager.cc:1434] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:20.127975 24110 tablet_bootstrap.cc:492] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:20.131434 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.132229 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:20.133612 24110 tablet_bootstrap.cc:654] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.134500 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.135283 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:20.135906 24068 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:20.138536 24137 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.143002 24137 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.151242 23817 catalog_manager.cc:5697] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:20.153926 23817 catalog_manager.cc:5697] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:20.155043 24269 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:16:20.156067 23887 leader_election.cc:343] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.157768 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:16:20.160197 23887 leader_election.cc:343] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.161473 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:20.162894 24259 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.163107 24109 tablet_bootstrap.cc:654] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.163339 24259 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.163710 24259 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:20.164534 23887 leader_election.cc:343] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.165719 24111 tablet_bootstrap.cc:492] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:20.166225 24111 ts_tablet_manager.cc:1403] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.199s	user 0.015s	sys 0.035s
I20260709 12:16:20.166455 24269 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.168020 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:20.169040 24111 raft_consensus.cc:359] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.169921 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:20.180178 24068 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.188468 24111 raft_consensus.cc:385] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.188962 24111 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.189306 23818 catalog_manager.cc:5697] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.190081 24111 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.174665 24259 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.190969 23818 catalog_manager.cc:5697] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.193331 24259 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.194734 24109 tablet_bootstrap.cc:492] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.196403 24109 ts_tablet_manager.cc:1403] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.121s	user 0.006s	sys 0.015s
I20260709 12:16:20.198032 24068 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:20.195654 24111 ts_tablet_manager.cc:1434] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:16:20.199175 24111 tablet_bootstrap.cc:492] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:20.200083 24109 raft_consensus.cc:359] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.200800 24109 raft_consensus.cc:385] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.201116 24109 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.200006 24110 tablet_bootstrap.cc:492] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.202122 24110 ts_tablet_manager.cc:1403] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.028s
I20260709 12:16:20.201779 24109 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.204463 24109 ts_tablet_manager.cc:1434] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:16:20.206643 24111 tablet_bootstrap.cc:654] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.207590 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:20.208153 24068 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.208480 24110 raft_consensus.cc:359] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.208707 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:20.209142 24110 raft_consensus.cc:385] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.209524 24110 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.210143 24110 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.212146 24110 ts_tablet_manager.cc:1434] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:16:20.212913 24110 tablet_bootstrap.cc:492] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:20.212671 24116 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.214875 24068 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:20.219024 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:20.220176 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:20.220875 24115 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.221321 24115 raft_consensus.cc:697] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:20.221504 24269 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.222208 24269 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:20.222131 24115 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.223074 24269 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:20.227413 23887 leader_election.cc:343] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:20.228389 23887 leader_election.cc:343] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.229336 24111 tablet_bootstrap.cc:492] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:20.229894 24111 ts_tablet_manager.cc:1403] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.006s
I20260709 12:16:20.230902 24109 tablet_bootstrap.cc:492] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.235252 24111 raft_consensus.cc:359] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.235984 24111 raft_consensus.cc:385] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.236311 24111 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.239307 24111 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.241591 24111 ts_tablet_manager.cc:1434] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:16:20.242534 24111 tablet_bootstrap.cc:492] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:20.244594 24110 tablet_bootstrap.cc:654] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.251449 24111 tablet_bootstrap.cc:654] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.254223 24204 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.254770 24204 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.255534 24110 tablet_bootstrap.cc:492] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.255942 24110 ts_tablet_manager.cc:1403] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:16:20.258239 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:20.258471 24110 raft_consensus.cc:359] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.259179 24110 raft_consensus.cc:385] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.259449 24110 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.260090 24110 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:20.260203 23960 leader_election.cc:343] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.260226 23818 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.262557 24110 ts_tablet_manager.cc:1434] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:20.263473 24110 tablet_bootstrap.cc:492] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:20.263466 23818 catalog_manager.cc:5697] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.264614 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:20.266584 23962 leader_election.cc:343] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.267187 23962 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:20.268338 24191 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.269385 24204 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.271456 24110 tablet_bootstrap.cc:654] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.276285 24109 tablet_bootstrap.cc:654] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.282342 24110 tablet_bootstrap.cc:492] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.282833 24110 ts_tablet_manager.cc:1403] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.008s
I20260709 12:16:20.285346 24110 raft_consensus.cc:359] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.285987 24110 raft_consensus.cc:385] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.286253 24110 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.286860 24110 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.289117 24110 ts_tablet_manager.cc:1434] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:16:20.289944 24110 tablet_bootstrap.cc:492] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:20.295463 24110 tablet_bootstrap.cc:654] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.296209 24111 tablet_bootstrap.cc:492] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:20.297073 24111 ts_tablet_manager.cc:1403] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.055s	user 0.030s	sys 0.010s
I20260709 12:16:20.298628 24109 tablet_bootstrap.cc:492] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.299283 24109 ts_tablet_manager.cc:1403] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.005s
I20260709 12:16:20.299989 24111 raft_consensus.cc:359] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.300632 24111 raft_consensus.cc:385] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.300869 24111 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.301469 24111 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.301710 24109 raft_consensus.cc:359] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.302313 24109 raft_consensus.cc:385] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.302572 24109 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.305667 24204 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.304152 24109 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.306131 24204 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.307730 24109 ts_tablet_manager.cc:1434] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:16:20.308230 24204 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.304193 24111 ts_tablet_manager.cc:1434] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:16:20.309823 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:20.310827 24110 tablet_bootstrap.cc:492] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.310787 24068 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:20.311213 24111 tablet_bootstrap.cc:492] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:20.311388 24110 ts_tablet_manager.cc:1403] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 12:16:20.312247 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:20.313135 24204 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.313514 24204 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.313841 24204 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.313791 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:20.314481 23919 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:20.315047 24109 tablet_bootstrap.cc:492] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.316776 24242 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.318827 24242 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.319294 24242 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:20.319775 23887 consensus_peers.cc:597] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:20.321446 24242 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:20.325306 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.326181 23993 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:20.326822 24110 raft_consensus.cc:359] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.327486 24110 raft_consensus.cc:385] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.327744 24110 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.328315 24110 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.328398 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:20.330068 23921 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:20.330901 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:20.334618 24242 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.335007 24242 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.335377 24242 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.335196 24204 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.341053 24110 ts_tablet_manager.cc:1434] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:16:20.341943 24110 tablet_bootstrap.cc:492] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:20.352653 24204 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.353174 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:20.353794 23921 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.353335 24137 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.354975 24137 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.361837 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:20.363649 24111 tablet_bootstrap.cc:654] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.362675 24068 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.366375 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:20.366945 23921 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
W20260709 12:16:20.367668 24034 leader_election.cc:343] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.370489 23960 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:20.371305 24109 tablet_bootstrap.cc:654] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.371331 24191 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.371905 24191 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:20.373499 24191 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.376330 24068 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:20.379323 24137 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:20.380426 23993 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.380692 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.384073 24110 tablet_bootstrap.cc:654] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.395108 24242 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:20.396407 24036 leader_election.cc:343] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.400004 24036 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:20.404841 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:20.405404 23919 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.408723 23818 catalog_manager.cc:5697] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:20.411608 24137 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.417711 24242 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:20.416882 24240 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:16:20.429263 24269 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.435379 24111 tablet_bootstrap.cc:492] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:20.435396 24109 tablet_bootstrap.cc:492] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.435945 24111 ts_tablet_manager.cc:1403] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.125s	user 0.022s	sys 0.007s
I20260709 12:16:20.436002 24109 ts_tablet_manager.cc:1403] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.011s
I20260709 12:16:20.428728 23919 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:20.436327 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:20.439227 23993 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.440943 24204 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.441459 24204 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.443288 24111 raft_consensus.cc:359] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.444036 24111 raft_consensus.cc:385] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.444332 24111 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.446655 24111 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.448674 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:20.449056 24109 raft_consensus.cc:359] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.449834 24109 raft_consensus.cc:385] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.450186 24109 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.452090 24109 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.452804 23993 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:20.454721 24111 ts_tablet_manager.cc:1434] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 12:16:20.454873 24034 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:20.456343 24109 ts_tablet_manager.cc:1434] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:16:20.457499 24109 tablet_bootstrap.cc:492] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.460966 24242 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.461516 24242 raft_consensus.cc:697] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:20.462376 24242 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.451243 24204 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.444453 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:20.465975 23960 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:20.467126 24191 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.474043 24111 tablet_bootstrap.cc:492] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:20.480899 24111 tablet_bootstrap.cc:654] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.485069 24259 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.485965 24111 tablet_bootstrap.cc:492] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:20.486912 24111 ts_tablet_manager.cc:1403] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:16:20.488309 24110 tablet_bootstrap.cc:492] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.488814 24110 ts_tablet_manager.cc:1403] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.147s	user 0.017s	sys 0.006s
I20260709 12:16:20.489538 24111 raft_consensus.cc:359] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.490238 24111 raft_consensus.cc:385] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.490587 24111 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.491343 24111 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.491549 24110 raft_consensus.cc:359] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.492282 24110 raft_consensus.cc:385] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.492668 24110 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.493538 24111 ts_tablet_manager.cc:1434] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:16:20.494501 24111 tablet_bootstrap.cc:492] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:20.494916 24109 tablet_bootstrap.cc:654] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.502759 24111 tablet_bootstrap.cc:654] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.493453 24110 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.507086 24110 ts_tablet_manager.cc:1434] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:16:20.508220 24110 tablet_bootstrap.cc:492] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:20.511845 23996 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.515349 24110 tablet_bootstrap.cc:654] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.523351 24259 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.527534 24191 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.528151 24191 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.531646 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:20.534492 24191 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.535487 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:20.536221 24068 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:16:20.538091 23962 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:20.539793 24109 tablet_bootstrap.cc:492] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.541442 24109 ts_tablet_manager.cc:1403] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.084s	user 0.005s	sys 0.007s
I20260709 12:16:20.541697 23817 catalog_manager.cc:5697] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:20.543603 24204 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.544838 24109 raft_consensus.cc:359] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.545702 24109 raft_consensus.cc:385] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.545967 24109 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.547830 24109 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.552177 24109 ts_tablet_manager.cc:1434] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260709 12:16:20.553292 24109 tablet_bootstrap.cc:492] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.555768 24204 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.562114 24109 tablet_bootstrap.cc:654] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.566450 24242 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.567073 24242 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.571338 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:20.571950 23921 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:20.571950 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.574554 24204 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.575160 24204 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.576241 24109 tablet_bootstrap.cc:492] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.576787 24109 ts_tablet_manager.cc:1403] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.007s
I20260709 12:16:20.577067 24034 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:20.577791 24137 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.577898 24240 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.578308 24240 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.578255 24137 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.578770 24240 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.579276 24109 raft_consensus.cc:359] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.579943 24109 raft_consensus.cc:385] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.580191 24109 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.580241 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:20.580861 24109 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:20.581655 23960 leader_election.cc:343] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.580358 24137 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:16:20.582844 24036 leader_election.cc:343] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.583403 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.583921 24242 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:20.583765 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:20.584997 24109 ts_tablet_manager.cc:1434] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 12:16:20.585505 24036 leader_election.cc:343] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.585891 24109 tablet_bootstrap.cc:492] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
W20260709 12:16:20.585938 24034 leader_election.cc:343] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.586462 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:20.587476 24242 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.590152 24240 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.595395 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:20.595952 23921 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.596398 24109 tablet_bootstrap.cc:654] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.604456 23921 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:20.606683 24034 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:20.606873 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:20.607367 24109 tablet_bootstrap.cc:492] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.607569 24242 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.607800 24109 ts_tablet_manager.cc:1403] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 12:16:20.608064 24242 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:16:20.608158 24036 leader_election.cc:343] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.608731 24240 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:20.608891 24242 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.610265 24109 raft_consensus.cc:359] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.610937 24109 raft_consensus.cc:385] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.611191 24109 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.611871 24109 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.612938 24259 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.615022 24109 ts_tablet_manager.cc:1434] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:20.615898 24109 tablet_bootstrap.cc:492] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.616608 24204 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.618207 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:20.619856 23962 leader_election.cc:343] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.620409 23962 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:20.621492 24117 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.622128 24109 tablet_bootstrap.cc:654] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.635105 24109 tablet_bootstrap.cc:492] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.635555 24109 ts_tablet_manager.cc:1403] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260709 12:16:20.638890 24109 raft_consensus.cc:359] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.639760 24109 raft_consensus.cc:385] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.640033 24109 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.640882 24109 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.645895 23996 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.647672 24109 ts_tablet_manager.cc:1434] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:16:20.649380 24109 tablet_bootstrap.cc:492] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.656862 24109 tablet_bootstrap.cc:654] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.658308 24115 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.666826 24115 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.667440 24109 tablet_bootstrap.cc:492] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.667881 24109 ts_tablet_manager.cc:1403] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 12:16:20.729123 24109 raft_consensus.cc:359] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.731750 24109 raft_consensus.cc:385] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.731803 24111 tablet_bootstrap.cc:492] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:20.732064 24109 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.732352 24111 ts_tablet_manager.cc:1403] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.238s	user 0.046s	sys 0.036s
I20260709 12:16:20.731803 24110 tablet_bootstrap.cc:492] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.733678 24110 ts_tablet_manager.cc:1403] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.226s	user 0.032s	sys 0.047s
I20260709 12:16:20.732721 24109 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.737486 24152 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.738183 24110 raft_consensus.cc:359] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.738896 24110 raft_consensus.cc:385] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.739164 24110 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.742038 24110 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.743906 24110 ts_tablet_manager.cc:1434] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:20.754027 24110 tablet_bootstrap.cc:492] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:20.773417 24110 tablet_bootstrap.cc:654] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.743904 23817 catalog_manager.cc:5697] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:20.744470 24111 raft_consensus.cc:359] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.756923 24109 ts_tablet_manager.cc:1434] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.089s	user 0.004s	sys 0.031s
I20260709 12:16:20.776683 24111 raft_consensus.cc:385] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.777089 24111 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.777598 24109 tablet_bootstrap.cc:492] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.777853 24111 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.779458 24111 ts_tablet_manager.cc:1434] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.005s
I20260709 12:16:20.779759 24152 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.780424 24111 tablet_bootstrap.cc:492] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:20.780267 24152 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.782780 24152 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.783550 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.784170 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:20.784988 23887 leader_election.cc:343] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:20.785802 23887 leader_election.cc:343] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.786204 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:20.786514 24109 tablet_bootstrap.cc:654] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.787010 24152 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.791247 24109 tablet_bootstrap.cc:492] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.791709 24109 ts_tablet_manager.cc:1403] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 12:16:20.793124 24111 tablet_bootstrap.cc:654] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.794615 24109 raft_consensus.cc:359] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.795461 24109 raft_consensus.cc:385] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.795718 24109 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.796437 24109 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.797574 24110 tablet_bootstrap.cc:492] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.798038 24110 ts_tablet_manager.cc:1403] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.005s
I20260709 12:16:20.798702 24109 ts_tablet_manager.cc:1434] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:20.799630 24109 tablet_bootstrap.cc:492] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.801231 24110 raft_consensus.cc:359] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.801704 23921 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.802004 24110 raft_consensus.cc:385] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.802363 24110 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.803421 24110 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.805668 24110 ts_tablet_manager.cc:1434] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:20.806675 24110 tablet_bootstrap.cc:492] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:20.807833 24111 tablet_bootstrap.cc:492] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:20.808302 24111 ts_tablet_manager.cc:1403] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:16:20.811635 24111 raft_consensus.cc:359] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.812376 24111 raft_consensus.cc:385] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.812654 24111 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.817234 24110 tablet_bootstrap.cc:654] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.820490 24109 tablet_bootstrap.cc:654] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.820228 24111 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.826498 24152 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.827337 24111 ts_tablet_manager.cc:1434] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:16:20.827032 24152 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.828701 24111 tablet_bootstrap.cc:492] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:20.830333 24152 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.832706 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.833952 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:20.835913 23887 leader_election.cc:343] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:20.836593 23887 leader_election.cc:343] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.836979 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:20.837406 24111 tablet_bootstrap.cc:654] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.837695 24152 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.839195 24115 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:20.840161 24110 tablet_bootstrap.cc:492] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.841014 24110 ts_tablet_manager.cc:1403] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.004s
I20260709 12:16:20.838229 24152 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.843214 24111 tablet_bootstrap.cc:492] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:20.843696 24111 ts_tablet_manager.cc:1403] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 12:16:20.843578 24110 raft_consensus.cc:359] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.843989 24152 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.844249 24110 raft_consensus.cc:385] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.844579 24110 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.846488 24109 tablet_bootstrap.cc:492] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.847038 24109 ts_tablet_manager.cc:1403] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.012s
I20260709 12:16:20.846494 24111 raft_consensus.cc:359] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.847909 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.848421 24111 raft_consensus.cc:385] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.848846 24111 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.848313 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:20.849525 23887 leader_election.cc:343] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.849943 24068 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:20.849519 24111 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.852115 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:20.851502 24109 raft_consensus.cc:359] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.852780 24109 raft_consensus.cc:385] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.852348 24110 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.853129 24109 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.853135 24116 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:20.854781 24110 ts_tablet_manager.cc:1434] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:16:20.853912 24109 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.855281 24152 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.855403 24242 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.857165 24109 ts_tablet_manager.cc:1434] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:20.857764 24111 ts_tablet_manager.cc:1434] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:16:20.858806 24111 tablet_bootstrap.cc:492] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:20.865981 24111 tablet_bootstrap.cc:654] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.859642 24109 tablet_bootstrap.cc:492] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.855675 24152 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.868376 24152 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.876269 24110 tablet_bootstrap.cc:492] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:20.879305 24115 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:20.885692 24115 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.888422 24115 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.907433 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:20.911525 24068 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:20.905515 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:20.912770 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:20.913123 23996 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:20.914214 24269 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:20.915349 24269 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:20.915681 24269 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.915804 24109 tablet_bootstrap.cc:654] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.928248 24111 tablet_bootstrap.cc:492] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:20.928696 24111 ts_tablet_manager.cc:1403] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.070s	user 0.017s	sys 0.021s
I20260709 12:16:20.934660 24117 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.934859 24152 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.937469 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:16:20.938809 23887 leader_election.cc:343] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:20.938620 24269 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.940168 24152 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.940737 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:20.941493 24064 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.944823 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:20.945405 23996 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.950826 24064 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:20.954097 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:20.954447 24269 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:20.956993 24269 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.959148 24269 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:20.957603 23996 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:20.962507 24269 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.963904 24111 raft_consensus.cc:359] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.964633 24111 raft_consensus.cc:385] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.964947 24111 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.965991 24109 tablet_bootstrap.cc:492] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:20.966446 24109 ts_tablet_manager.cc:1403] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.107s	user 0.018s	sys 0.013s
I20260709 12:16:20.966197 24117 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:20.968382 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:20.968740 24110 tablet_bootstrap.cc:654] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:20.968951 24064 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:20.971307 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:20.973618 24115 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:20.974082 24115 raft_consensus.cc:697] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:20.975517 24115 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.965752 24111 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.984033 24111 ts_tablet_manager.cc:1434] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.004s
I20260709 12:16:20.968955 24109 raft_consensus.cc:359] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.988572 24109 raft_consensus.cc:385] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:20.988857 24109 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:20.989635 24111 tablet_bootstrap.cc:492] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:20.989496 24109 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:20.991071 24064 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:20.992309 24109 ts_tablet_manager.cc:1434] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.002s
I20260709 12:16:20.993222 24109 tablet_bootstrap.cc:492] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:20.995409 24110 tablet_bootstrap.cc:492] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:20.995925 24110 ts_tablet_manager.cc:1403] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.123s	user 0.019s	sys 0.000s
I20260709 12:16:21.002247 24111 tablet_bootstrap.cc:654] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.002942 24110 raft_consensus.cc:359] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.006093 24110 raft_consensus.cc:385] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.006587 24110 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.008667 24109 tablet_bootstrap.cc:654] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.009325 24110 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.012101 24110 ts_tablet_manager.cc:1434] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:16:21.013536 24110 tablet_bootstrap.cc:492] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:21.020063 24111 tablet_bootstrap.cc:492] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:21.020728 24111 ts_tablet_manager.cc:1403] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.003s
I20260709 12:16:21.027994 24111 raft_consensus.cc:359] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.030406 24111 raft_consensus.cc:385] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.030697 24111 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.031596 24111 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.033356 23994 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.033660 24111 ts_tablet_manager.cc:1434] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:16:21.034632 24111 tablet_bootstrap.cc:492] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:21.041235 24110 tablet_bootstrap.cc:654] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.053229 24110 tablet_bootstrap.cc:492] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:21.053989 24110 ts_tablet_manager.cc:1403] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.003s
I20260709 12:16:21.054317 24242 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.056836 24110 raft_consensus.cc:359] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.057668 24110 raft_consensus.cc:385] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.058008 24110 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.058805 24110 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.060854 24110 ts_tablet_manager.cc:1434] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:16:21.061820 24110 tablet_bootstrap.cc:492] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:21.066191 24109 tablet_bootstrap.cc:492] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:21.071300 24110 tablet_bootstrap.cc:654] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.071717 24328 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.072023 24111 tablet_bootstrap.cc:654] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.072229 24328 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.066844 24109 ts_tablet_manager.cc:1403] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.074s	user 0.015s	sys 0.004s
I20260709 12:16:21.075966 24109 raft_consensus.cc:359] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.076467 24109 raft_consensus.cc:385] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.076725 24109 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.076679 24328 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.078486 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.078591 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:21.080475 23867 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:21.081429 23962 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:21.081064 23819 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.081064 24109 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.084825 24109 ts_tablet_manager.cc:1434] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:16:21.084713 24242 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.085358 24242 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.085867 24109 tablet_bootstrap.cc:492] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:21.087702 24328 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.088729 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:16:21.090101 24034 leader_election.cc:343] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.098054 24109 tablet_bootstrap.cc:654] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.098757 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.101960 24240 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.102532 24240 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.104837 24240 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.111949 24115 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.112129 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.112498 24115 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:21.112776 24036 leader_election.cc:343] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.113722 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.114291 24242 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.114642 24115 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.114888 24116 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.112782 23994 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:21.119575 24242 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.120074 24111 tablet_bootstrap.cc:492] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:21.120694 24111 ts_tablet_manager.cc:1403] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.013s
I20260709 12:16:21.120659 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:21.121790 24240 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.122474 24240 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.122887 24240 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.123030 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.124325 24111 raft_consensus.cc:359] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.125113 24111 raft_consensus.cc:385] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.125451 24111 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.126508 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:21.127259 24064 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:21.128523 24109 tablet_bootstrap.cc:492] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:21.129043 24109 ts_tablet_manager.cc:1403] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.008s
I20260709 12:16:21.132164 24110 tablet_bootstrap.cc:492] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:21.126860 24111 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.132613 24110 ts_tablet_manager.cc:1403] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.008s
I20260709 12:16:21.131845 24109 raft_consensus.cc:359] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.135246 24109 raft_consensus.cc:385] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.135605 24109 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.136307 24109 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.136854 24110 raft_consensus.cc:359] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.134914 24111 ts_tablet_manager.cc:1434] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:16:21.137676 24110 raft_consensus.cc:385] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.132608 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.138599 24111 tablet_bootstrap.cc:492] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:21.138862 23921 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:21.145983 24111 tablet_bootstrap.cc:654] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.148669 24109 ts_tablet_manager.cc:1434] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:16:21.151757 24190 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:21.147780 23887 leader_election.cc:343] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.152643 24190 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.155498 24190 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.156013 24115 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.156620 24115 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.138103 24110 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.158926 24115 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.158918 24110 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.159919 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.161062 24190 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.161435 24190 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.161763 24190 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.162667 24115 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.162729 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.163357 24115 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.165525 24115 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.166007 24110 ts_tablet_manager.cc:1434] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:16:21.170667 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:21.171553 23887 leader_election.cc:343] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.168493 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:21.173609 23887 leader_election.cc:343] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.169665 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:21.171751 24110 tablet_bootstrap.cc:492] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
W20260709 12:16:21.176347 23887 leader_election.cc:343] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.169239 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:21.177801 23887 leader_election.cc:343] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.178793 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.167869 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.180130 24115 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.180270 24240 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:21.181536 23887 leader_election.cc:343] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.183059 23887 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.182127 24110 tablet_bootstrap.cc:654] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.184445 24115 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:21.186861 23887 leader_election.cc:343] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.187830 23887 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.189124 24115 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.190243 24109 tablet_bootstrap.cc:492] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:21.192472 24190 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.195271 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:21.195814 23921 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.197080 24109 tablet_bootstrap.cc:654] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.201701 24110 tablet_bootstrap.cc:492] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:21.202095 24115 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.202880 24115 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.205013 24115 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.202183 24110 ts_tablet_manager.cc:1403] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.007s
I20260709 12:16:21.201766 23921 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:21.208936 24111 tablet_bootstrap.cc:492] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:21.209352 24111 ts_tablet_manager.cc:1403] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.010s
I20260709 12:16:21.210363 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.211580 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:21.211925 24190 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.211937 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:21.212368 24137 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.208024 24110 raft_consensus.cc:359] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.212755 24067 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:21.213742 24110 raft_consensus.cc:385] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.212867 24137 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:21.213899 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:21.214874 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:21.215281 23994 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.215416 24067 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.215507 24137 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.220454 24110 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.221658 24110 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.223850 24067 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:21.224133 23991 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:21.225934 24240 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.214542 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:21.229123 24110 ts_tablet_manager.cc:1434] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:16:21.230491 24110 tablet_bootstrap.cc:492] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:21.229079 23994 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:21.231204 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:21.225235 23819 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.234493 24111 raft_consensus.cc:359] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.235123 24111 raft_consensus.cc:385] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.235383 24111 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.230324 24190 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.232026 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:21.236191 24240 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.237066 24111 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.236450 24115 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.242816 24115 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:21.243899 24115 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.236985 24190 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.241108 23991 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.248076 24328 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.256636 24328 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.258941 24328 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.260018 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.261960 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:21.240724 24240 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.262743 24064 raft_consensus.cc:2393] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:16:21.267060 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:21.268093 23991 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:21.256414 24190 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.270517 24191 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.274741 24110 tablet_bootstrap.cc:654] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.283802 24190 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.286764 24190 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.287272 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:21.287854 23991 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.291428 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:21.292179 24064 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.295455 23991 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:21.296540 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:21.297734 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.298121 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:21.298812 24034 leader_election.cc:343] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.299607 23994 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:21.300197 24190 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.300943 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:16:21.302193 24190 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:21.306126 24190 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.304694 24064 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:21.302213 24242 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.311360 24242 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.311775 24242 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.314395 24240 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.328280 24191 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.330955 24111 ts_tablet_manager.cc:1434] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.000s
I20260709 12:16:21.331689 24109 tablet_bootstrap.cc:492] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:21.331837 24111 tablet_bootstrap.cc:492] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:21.332258 24109 ts_tablet_manager.cc:1403] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.142s	user 0.016s	sys 0.031s
I20260709 12:16:21.346164 24109 raft_consensus.cc:359] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.348348 24109 raft_consensus.cc:385] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.348855 24109 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.349522 24109 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.351228 23994 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.351492 24109 ts_tablet_manager.cc:1434] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.005s
I20260709 12:16:21.352358 24109 tablet_bootstrap.cc:492] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:21.360338 24110 tablet_bootstrap.cc:492] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:21.360729 24110 ts_tablet_manager.cc:1403] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.130s	user 0.008s	sys 0.007s
I20260709 12:16:21.364204 23818 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.379590 24111 tablet_bootstrap.cc:654] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.385313 23819 catalog_manager.cc:5697] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.392171 24242 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.393383 24269 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.395216 24242 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.397722 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:21.398543 23818 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.404002 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:16:21.402344 24034 leader_election.cc:343] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.404595 23991 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.408298 24137 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.408769 24137 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.415062 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.411837 24137 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.415731 23996 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:21.417163 24036 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:21.415752 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.418541 23921 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:21.419373 24137 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.419785 24137 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.420184 24137 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.423049 24111 tablet_bootstrap.cc:492] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:21.423489 24111 ts_tablet_manager.cc:1403] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.092s	user 0.010s	sys 0.006s
I20260709 12:16:21.423477 23991 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:21.426107 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:16:21.428233 24111 raft_consensus.cc:359] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.428918 24111 raft_consensus.cc:385] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.429237 24111 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.430261 24109 tablet_bootstrap.cc:654] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.429917 24111 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.431378 24240 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.431859 24240 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:21.432660 24240 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.433118 24111 ts_tablet_manager.cc:1434] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:21.434363 24111 tablet_bootstrap.cc:492] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:21.443629 24137 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.446007 24137 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.446892 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:21.447451 23921 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.447678 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:21.448365 23991 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.451960 24111 tablet_bootstrap.cc:654] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.454211 24110 raft_consensus.cc:359] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.454917 24110 raft_consensus.cc:385] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.455196 24110 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.456157 24110 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.456426 23921 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:21.458811 23991 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:21.458913 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:21.464766 24116 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.465173 24110 ts_tablet_manager.cc:1434] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.104s	user 0.004s	sys 0.003s
I20260709 12:16:21.465221 24116 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:21.466151 24110 tablet_bootstrap.cc:492] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:21.466086 24116 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.466650 24240 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.467134 24240 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.469071 24240 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.470484 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.470907 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.471326 23994 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:21.471501 23919 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:21.472560 24110 tablet_bootstrap.cc:654] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.472522 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:21.473637 24338 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.474005 24338 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.474354 24338 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.480224 24111 tablet_bootstrap.cc:492] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:21.480670 24111 ts_tablet_manager.cc:1403] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.001s
I20260709 12:16:21.481669 24115 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.483753 24111 raft_consensus.cc:359] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.484414 24111 raft_consensus.cc:385] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.484678 24111 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.485302 24111 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.486671 24190 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.487458 24111 ts_tablet_manager.cc:1434] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:16:21.488343 24338 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.488368 24111 tablet_bootstrap.cc:492] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:21.491305 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:21.491912 23994 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.495483 24111 tablet_bootstrap.cc:654] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.499433 23994 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:21.500881 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:21.501986 24242 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.502528 24242 raft_consensus.cc:697] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:21.503450 24242 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.508055 24109 tablet_bootstrap.cc:492] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:21.508504 24109 ts_tablet_manager.cc:1403] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.156s	user 0.011s	sys 0.003s
I20260709 12:16:21.509321 24111 tablet_bootstrap.cc:492] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:21.509737 24111 ts_tablet_manager.cc:1403] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 12:16:21.518443 24338 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.519887 24109 raft_consensus.cc:359] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.520057 24111 raft_consensus.cc:359] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.520569 24109 raft_consensus.cc:385] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.520642 24111 raft_consensus.cc:385] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.520888 24109 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.520982 24111 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.521667 24109 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.521756 24111 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.524577 24111 ts_tablet_manager.cc:1434] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.004s
I20260709 12:16:21.526537 24111 tablet_bootstrap.cc:492] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:21.529825 24109 ts_tablet_manager.cc:1434] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 12:16:21.530377 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:21.531073 23921 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.531858 24109 tablet_bootstrap.cc:492] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:21.535010 24110 tablet_bootstrap.cc:492] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:21.535512 24110 ts_tablet_manager.cc:1403] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.003s
I20260709 12:16:21.540699 24269 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.550444 23921 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:21.559661 23817 catalog_manager.cc:5697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.561087 24110 raft_consensus.cc:359] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.561781 24110 raft_consensus.cc:385] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.562078 24110 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.561648 23817 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.563741 24110 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.565761 24110 ts_tablet_manager.cc:1434] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 12:16:21.566629 24110 tablet_bootstrap.cc:492] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:21.572448 24111 tablet_bootstrap.cc:654] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.585827 24152 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.586336 24152 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.588253 24152 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.590160 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:21.590806 24067 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:21.591125 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.576464 24110 tablet_bootstrap.cc:654] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.592085 23887 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:21.592824 24257 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:21.592965 23887 leader_election.cc:343] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.593245 24257 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.593597 24257 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.579699 24109 tablet_bootstrap.cc:654] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.584408 23817 catalog_manager.cc:5697] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.601186 24338 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.601686 24338 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.603132 24111 tablet_bootstrap.cc:492] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:21.603502 24111 ts_tablet_manager.cc:1403] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.077s	user 0.010s	sys 0.006s
I20260709 12:16:21.606909 24111 raft_consensus.cc:359] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.607589 24111 raft_consensus.cc:385] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.607892 24111 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.608695 24109 tablet_bootstrap.cc:492] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:21.608652 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.609274 24109 ts_tablet_manager.cc:1403] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.005s
I20260709 12:16:21.609210 24338 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:16:21.609946 24036 leader_election.cc:343] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.608696 24111 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.612890 24111 ts_tablet_manager.cc:1434] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:16:21.613821 24111 tablet_bootstrap.cc:492] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:21.614952 24109 raft_consensus.cc:359] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.615598 24109 raft_consensus.cc:385] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.615861 24109 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.616628 24109 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.617976 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.618567 23921 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:21.615823 24257 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.619481 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.620241 24338 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.620587 24338 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.620630 24257 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.620977 24338 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.621466 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:21.622140 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:21.622759 24067 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.627699 24338 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:21.631100 23887 leader_election.cc:343] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.632846 24067 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:21.633786 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:21.634346 23921 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.634895 23887 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.635507 24111 tablet_bootstrap.cc:654] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.638796 24338 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.639351 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:16:21.640877 24036 leader_election.cc:343] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.642398 24257 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.642328 24109 ts_tablet_manager.cc:1434] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:16:21.642927 24257 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:21.643726 24257 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.647998 24109 tablet_bootstrap.cc:492] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:21.651861 24110 tablet_bootstrap.cc:492] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:21.652297 24110 ts_tablet_manager.cc:1403] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.086s	user 0.013s	sys 0.008s
I20260709 12:16:21.659150 23921 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:21.656085 24110 raft_consensus.cc:359] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.661234 24110 raft_consensus.cc:385] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.661696 24110 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.701458 24109 tablet_bootstrap.cc:654] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.708042 24110 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.710084 24110 ts_tablet_manager.cc:1434] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.007s
I20260709 12:16:21.711506 24110 tablet_bootstrap.cc:492] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:21.717486 24110 tablet_bootstrap.cc:654] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.717540 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.724895 24338 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:21.725028 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 57482.3us
I20260709 12:16:21.726261 24338 raft_consensus.cc:697] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:21.727363 24338 consensus_queue.cc:237] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.731014 24110 tablet_bootstrap.cc:492] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:21.731599 24110 ts_tablet_manager.cc:1403] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.002s
I20260709 12:16:21.736524 24109 tablet_bootstrap.cc:492] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:21.737143 24109 ts_tablet_manager.cc:1403] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.094s	user 0.014s	sys 0.005s
I20260709 12:16:21.742014 23818 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:21.744676 24110 raft_consensus.cc:359] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.745477 24110 raft_consensus.cc:385] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.745810 24110 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.748695 24116 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.748550 24109 raft_consensus.cc:359] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.749359 24109 raft_consensus.cc:385] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.743094 24257 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:16:21.749694 24109 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.750571 24109 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.752770 24109 ts_tablet_manager.cc:1434] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:16:21.753575 24109 tablet_bootstrap.cc:492] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:21.753662 24152 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.753333 23817 catalog_manager.cc:5697] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:21.754101 24152 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.754400 24116 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.754999 24116 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.755836 24152 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.757304 24116 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.758410 24110 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.758946 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.760493 24110 ts_tablet_manager.cc:1434] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
W20260709 12:16:21.761441 24036 leader_election.cc:343] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.762003 24109 tablet_bootstrap.cc:654] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.762845 24110 tablet_bootstrap.cc:492] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:21.763032 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:21.763041 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.772184 24110 tablet_bootstrap.cc:654] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.776665 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:16:21.780135 24034 leader_election.cc:343] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.780565 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.781629 24116 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:21.782809 23887 leader_election.cc:343] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:21.783793 23887 leader_election.cc:343] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.784169 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.784832 24257 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.785816 24111 tablet_bootstrap.cc:492] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:21.789709 24111 ts_tablet_manager.cc:1403] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.176s	user 0.033s	sys 0.040s
I20260709 12:16:21.790566 24152 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.793915 24111 raft_consensus.cc:359] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.798238 24111 raft_consensus.cc:385] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.799530 24111 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.801091 24111 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.805160 24338 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.811779 24111 ts_tablet_manager.cc:1434] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.005s
I20260709 12:16:21.815670 24111 tablet_bootstrap.cc:492] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:21.820189 24152 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.830718 24111 tablet_bootstrap.cc:654] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.830497 24338 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.837298 24111 tablet_bootstrap.cc:492] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:21.837734 24111 ts_tablet_manager.cc:1403] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.004s
I20260709 12:16:21.840709 24110 tablet_bootstrap.cc:492] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:21.841133 24110 ts_tablet_manager.cc:1403] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.004s
I20260709 12:16:21.842749 24328 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.843235 24328 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.844040 24109 tablet_bootstrap.cc:492] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:21.844444 24109 ts_tablet_manager.cc:1403] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.091s	user 0.011s	sys 0.011s
I20260709 12:16:21.845237 24328 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.846401 24152 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.846794 24152 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.846936 24109 raft_consensus.cc:359] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.847492 24109 raft_consensus.cc:385] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.847620 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.850416 24190 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.851451 24111 raft_consensus.cc:359] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.851698 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:21.853212 24110 raft_consensus.cc:359] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.852077 24111 raft_consensus.cc:385] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.853626 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:21.853893 24110 raft_consensus.cc:385] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.853978 24111 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.854391 24110 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.854619 24067 raft_consensus.cc:2393] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:16:21.854808 24111 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.855070 24110 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.847770 24109 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.855806 23962 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:21.855813 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.856314 24109 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:21.856724 23887 leader_election.cc:343] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:21.857872 23887 leader_election.cc:343] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:21.858305 23887 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:21.848579 24152 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.859195 24191 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.859838 24111 ts_tablet_manager.cc:1434] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:16:21.859938 24110 ts_tablet_manager.cc:1434] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:16:21.860282 24152 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.860776 24111 tablet_bootstrap.cc:492] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:21.860901 24110 tablet_bootstrap.cc:492] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:21.863850 24109 ts_tablet_manager.cc:1434] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:16:21.864741 24109 tablet_bootstrap.cc:492] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:21.868074 24191 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:21.873436 24109 tablet_bootstrap.cc:654] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.879138 24111 tablet_bootstrap.cc:654] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.916517 24110 tablet_bootstrap.cc:654] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:21.920363 24109 tablet_bootstrap.cc:492] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:21.920881 24109 ts_tablet_manager.cc:1403] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.056s	user 0.012s	sys 0.004s
I20260709 12:16:21.928968 24109 raft_consensus.cc:359] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.929634 24109 raft_consensus.cc:385] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:21.929893 24109 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:21.931099 24109 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.933169 23920 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.938400 24328 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.938894 24328 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.939685 24240 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.940150 24240 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.940886 24328 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.942075 24240 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.942759 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.943243 23919 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:21.944228 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:21.945079 24191 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.945426 24191 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.945755 24191 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.947145 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:21.947758 23919 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:21.947443 24137 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:21.949527 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:21.950486 24064 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:21.950630 24034 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:21.951614 24240 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:21.951960 24240 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:21.952359 24240 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.956168 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:21.957320 24137 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:21.960219 24328 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:21.970064 24328 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.960346 24109 ts_tablet_manager.cc:1434] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 12:16:21.973884 24109 tablet_bootstrap.cc:492] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:21.980110 24191 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.982225 24191 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:21.985960 24240 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:21.987071 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:21.987649 23920 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:21.987977 24240 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:21.994906 23920 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:21.996232 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:21.997381 24204 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:21.997869 24204 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:21.998757 24204 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.001750 24328 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.005208 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.005951 23919 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:21.966701 24111 tablet_bootstrap.cc:492] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:22.006676 24111 ts_tablet_manager.cc:1403] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.000s
I20260709 12:16:22.007367 23960 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:16:21.969463 24036 leader_election.cc:343] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.009690 24111 raft_consensus.cc:359] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.010540 24191 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.013010 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:22.015692 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:22.019429 24067 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:22.019737 24036 leader_election.cc:343] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.016634 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.022701 24064 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:22.023734 24191 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.024237 24191 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.017719 24109 tablet_bootstrap.cc:654] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.037119 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:22.037799 23921 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.045258 24110 tablet_bootstrap.cc:492] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:22.045743 24110 ts_tablet_manager.cc:1403] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.185s	user 0.063s	sys 0.090s
I20260709 12:16:22.047470 23921 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:22.048182 24152 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.048759 24152 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.049636 24109 tablet_bootstrap.cc:492] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:22.050078 24109 ts_tablet_manager.cc:1403] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.003s
I20260709 12:16:22.050813 24152 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.052907 24191 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.053644 24110 raft_consensus.cc:359] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.054348 24110 raft_consensus.cc:385] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.054700 24110 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.055454 24067 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:22.055312 24110 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.056955 24110 ts_tablet_manager.cc:1434] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:16:22.058032 24110 tablet_bootstrap.cc:492] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:22.060400 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:22.060978 23921 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.064222 24109 raft_consensus.cc:359] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.064842 24109 raft_consensus.cc:385] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.066195 24109 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.066815 24109 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.068245 24109 ts_tablet_manager.cc:1434] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.000s
I20260709 12:16:22.069111 24109 tablet_bootstrap.cc:492] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:22.072348 24240 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.073156 24034 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.074596 24109 tablet_bootstrap.cc:654] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.075805 24240 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.076069 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.076551 24240 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:22.078701 24110 tablet_bootstrap.cc:654] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.078258 24240 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.081290 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.081832 24111 raft_consensus.cc:385] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.088047 23817 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:22.082227 24111 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.095202 24111 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.097045 24111 ts_tablet_manager.cc:1434] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.000s
I20260709 12:16:22.100874 24111 tablet_bootstrap.cc:492] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:22.102692 23819 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:22.106086 24115 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.130369 24115 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.132620 24115 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.110932 24387 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:22.132828 23867 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:22.133255 24387 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.135558 24387 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.113008 24392 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.138267 24392 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.140786 24392 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.137583 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.142880 23919 raft_consensus.cc:2393] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:22.148059 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.148742 24068 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:22.113355 24191 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.113579 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:22.151346 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.151666 24064 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.153052 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.119719 24242 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.159058 24115 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:16:22.160143 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.160903 23919 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:22.161468 24064 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:22.126245 24109 tablet_bootstrap.cc:492] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:22.165809 24109 ts_tablet_manager.cc:1403] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.011s
I20260709 12:16:22.121423 23921 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:22.165853 24152 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:22.162060 23960 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:22.137588 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.169734 24109 raft_consensus.cc:359] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.128211 24110 tablet_bootstrap.cc:492] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:22.173353 24110 ts_tablet_manager.cc:1403] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.012s
I20260709 12:16:22.164584 24111 tablet_bootstrap.cc:654] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.173995 23960 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:22.165093 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.174584 24137 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.175117 24137 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.161514 24116 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.175751 24384 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.176146 24384 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.176467 24384 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.177866 24110 raft_consensus.cc:359] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.178634 24110 raft_consensus.cc:385] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.178916 24137 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.178988 24110 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
W20260709 12:16:22.179306 23887 leader_election.cc:343] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.178946 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.180131 24109 raft_consensus.cc:385] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.180496 24109 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
W20260709 12:16:22.180701 24036 leader_election.cc:343] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:22.181603 23887 leader_election.cc:343] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.181317 24109 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.182031 23887 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.182931 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.183589 23918 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:22.183781 24257 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.188061 24191 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.189870 24191 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:22.203599 24109 ts_tablet_manager.cc:1434] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:16:22.204382 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.207212 24137 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.207630 24137 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.207994 24137 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.209465 24109 tablet_bootstrap.cc:492] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:22.211800 24110 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.212620 24116 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.213114 24116 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.214104 24110 ts_tablet_manager.cc:1434] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.040s	user 0.011s	sys 0.000s
I20260709 12:16:22.215031 24110 tablet_bootstrap.cc:492] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:22.215298 24116 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.221686 24137 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.216745 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:22.223763 24036 leader_election.cc:343] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.227954 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:22.208773 23962 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:22.229604 24115 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:22.233454 24036 leader_election.cc:343] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.234311 24137 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.235486 24392 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.243678 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.244392 23921 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:22.245595 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:22.246465 24191 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.250813 23921 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.248420 24392 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.263474 24384 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.265348 24110 tablet_bootstrap.cc:654] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.268891 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:22.269284 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.269510 23918 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.269677 24384 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.270397 24137 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.270769 24137 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.271128 24137 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.272981 24111 tablet_bootstrap.cc:492] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:22.273437 24111 ts_tablet_manager.cc:1403] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.173s	user 0.032s	sys 0.044s
I20260709 12:16:22.276319 24111 raft_consensus.cc:359] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.276970 24111 raft_consensus.cc:385] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.277213 24111 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.277804 24111 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.278043 24137 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.279968 24111 ts_tablet_manager.cc:1434] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:16:22.280903 24111 tablet_bootstrap.cc:492] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:22.281533 24137 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.273456 24109 tablet_bootstrap.cc:654] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.283695 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:16:22.285248 24036 leader_election.cc:343] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.285691 23921 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:22.286866 24111 tablet_bootstrap.cc:654] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.289824 23918 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:22.290035 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.304077 24240 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.304553 24240 raft_consensus.cc:697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:22.304745 24137 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.305222 23818 catalog_manager.cc:5697] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:22.294340 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:22.306425 23921 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.293653 24110 tablet_bootstrap.cc:492] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:22.297901 24111 tablet_bootstrap.cc:492] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:22.300664 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:22.307435 24111 ts_tablet_manager.cc:1403] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.000s
I20260709 12:16:22.307580 23960 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:22.307581 24064 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.308943 24191 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.309448 24191 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:22.308081 24242 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.310267 24191 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.305436 24240 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.311000 24110 ts_tablet_manager.cc:1403] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.096s	user 0.008s	sys 0.004s
I20260709 12:16:22.310146 24111 raft_consensus.cc:359] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.322710 24111 raft_consensus.cc:385] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.323098 24111 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.323961 24111 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.327682 24064 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:22.332306 24111 ts_tablet_manager.cc:1434] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:16:22.333572 24111 tablet_bootstrap.cc:492] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:22.294929 24109 tablet_bootstrap.cc:492] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:22.335005 24109 ts_tablet_manager.cc:1403] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.127s	user 0.011s	sys 0.001s
I20260709 12:16:22.322046 24110 raft_consensus.cc:359] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.337532 24110 raft_consensus.cc:385] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.337925 24110 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.341248 23921 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:22.342944 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.344542 24116 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.345431 24116 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:22.346621 24116 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.350613 24109 raft_consensus.cc:359] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.342339 24110 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.355477 24110 ts_tablet_manager.cc:1434] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260709 12:16:22.352931 24109 raft_consensus.cc:385] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.357169 24109 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.358312 24109 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.366883 24109 ts_tablet_manager.cc:1434] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:16:22.368366 24109 tablet_bootstrap.cc:492] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:22.374121 24109 tablet_bootstrap.cc:654] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.374378 23819 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:22.378268 24110 tablet_bootstrap.cc:492] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:22.382459 24111 tablet_bootstrap.cc:654] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.384656 24110 tablet_bootstrap.cc:654] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.388625 23818 catalog_manager.cc:5697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:22.390062 24111 tablet_bootstrap.cc:492] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:22.390637 24111 ts_tablet_manager.cc:1403] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.005s
I20260709 12:16:22.390064 23818 catalog_manager.cc:5697] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:22.393057 24111 raft_consensus.cc:359] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.393708 24111 raft_consensus.cc:385] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.393966 24111 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.408255 24109 tablet_bootstrap.cc:492] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:22.408716 24109 ts_tablet_manager.cc:1403] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.001s
I20260709 12:16:22.411691 24109 raft_consensus.cc:359] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.412374 24109 raft_consensus.cc:385] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.412626 24109 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.413236 24109 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.414740 24109 ts_tablet_manager.cc:1434] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:16:22.415537 24109 tablet_bootstrap.cc:492] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:22.424216 24384 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.424690 24384 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.425822 24110 tablet_bootstrap.cc:492] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:22.426328 24110 ts_tablet_manager.cc:1403] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.000s
I20260709 12:16:22.429230 24384 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.434104 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.434194 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.434918 23921 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:22.435420 24111 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.438995 23960 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:22.436820 24110 raft_consensus.cc:359] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.439821 24110 raft_consensus.cc:385] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.440115 24110 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.440491 24392 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.442131 24110 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.442718 24111 ts_tablet_manager.cc:1434] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:16:22.443792 24109 tablet_bootstrap.cc:654] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.444605 24110 ts_tablet_manager.cc:1434] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:16:22.444307 24111 tablet_bootstrap.cc:492] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:22.446707 24110 tablet_bootstrap.cc:492] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:22.453084 24110 tablet_bootstrap.cc:654] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.454509 24384 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.455009 24384 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.457818 24111 tablet_bootstrap.cc:654] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.458519 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.459236 23921 raft_consensus.cc:2393] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:22.458549 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.461776 23960 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:22.462523 24191 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.468591 24110 tablet_bootstrap.cc:492] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:22.471028 24110 ts_tablet_manager.cc:1403] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 12:16:22.471088 24392 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.469331 24191 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.469715 24384 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.470510 24109 tablet_bootstrap.cc:492] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:22.472555 24109 ts_tablet_manager.cc:1403] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.007s
I20260709 12:16:22.475147 24109 raft_consensus.cc:359] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.475813 24109 raft_consensus.cc:385] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.477512 24109 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.478772 24111 tablet_bootstrap.cc:492] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:22.479200 24111 ts_tablet_manager.cc:1403] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.005s
I20260709 12:16:22.479324 24109 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.479614 24110 raft_consensus.cc:359] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.480365 24110 raft_consensus.cc:385] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.480676 24110 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.481317 24110 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.483326 24110 ts_tablet_manager.cc:1434] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:16:22.487011 24109 ts_tablet_manager.cc:1434] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:16:22.487977 24109 tablet_bootstrap.cc:492] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:22.489157 24111 raft_consensus.cc:359] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.490465 24111 raft_consensus.cc:385] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.490756 24111 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.490913 24110 tablet_bootstrap.cc:492] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:22.491510 24111 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.493949 24111 ts_tablet_manager.cc:1434] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:16:22.494861 24111 tablet_bootstrap.cc:492] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:22.497071 24109 tablet_bootstrap.cc:654] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.497377 24110 tablet_bootstrap.cc:654] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.500648 24111 tablet_bootstrap.cc:654] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.512869 24111 tablet_bootstrap.cc:492] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:22.513541 24111 ts_tablet_manager.cc:1403] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.001s
I20260709 12:16:22.516773 24191 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.518597 24240 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.519100 24240 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.521756 24240 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.522881 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.523566 23921 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:22.523699 24111 raft_consensus.cc:359] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.524823 24111 raft_consensus.cc:385] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.525022 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.524797 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:22.525549 24111 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.525820 23996 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:22.527187 24137 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.527611 24137 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.528098 24137 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.527383 24111 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.530709 24111 ts_tablet_manager.cc:1434] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.003s
I20260709 12:16:22.531991 24111 tablet_bootstrap.cc:492] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:22.533308 24109 tablet_bootstrap.cc:492] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:22.533806 24109 ts_tablet_manager.cc:1403] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.006s
I20260709 12:16:22.536669 24109 raft_consensus.cc:359] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.537350 24109 raft_consensus.cc:385] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.537659 24109 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.539842 24111 tablet_bootstrap.cc:654] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.539672 24109 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.542258 24110 tablet_bootstrap.cc:492] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:22.542812 24110 ts_tablet_manager.cc:1403] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.052s	user 0.025s	sys 0.023s
I20260709 12:16:22.543341 24191 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.543918 24191 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.546057 24110 raft_consensus.cc:359] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.546885 24110 raft_consensus.cc:385] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.547214 24110 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.547021 24137 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.547513 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.548400 23921 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:22.547981 24110 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.550262 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.551057 24110 ts_tablet_manager.cc:1434] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:22.551834 23962 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:22.552897 24191 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.553159 24392 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.555691 24109 ts_tablet_manager.cc:1434] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:16:22.557324 24110 tablet_bootstrap.cc:492] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:22.561293 24384 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.563800 24110 tablet_bootstrap.cc:654] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.566186 24109 tablet_bootstrap.cc:492] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:22.572681 24109 tablet_bootstrap.cc:654] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.581334 24109 tablet_bootstrap.cc:492] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:22.582109 24109 ts_tablet_manager.cc:1403] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 12:16:22.584709 24392 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.587661 24109 raft_consensus.cc:359] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.589359 24109 raft_consensus.cc:385] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.590099 24109 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.591370 24109 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.592443 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:22.593593 23991 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.595321 24109 ts_tablet_manager.cc:1434] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:16:22.598817 24109 tablet_bootstrap.cc:492] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:22.604513 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:22.605165 23919 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.610555 24109 tablet_bootstrap.cc:654] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.620467 23919 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:22.622738 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:22.623854 24240 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.624480 24240 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:22.625589 24240 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.636158 24387 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.590415 24137 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.652683 23991 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:22.660147 24109 tablet_bootstrap.cc:492] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:22.660745 24109 ts_tablet_manager.cc:1403] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.003s
I20260709 12:16:22.663031 24110 tablet_bootstrap.cc:492] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:22.663426 24109 raft_consensus.cc:359] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.663471 24110 ts_tablet_manager.cc:1403] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.051s
I20260709 12:16:22.664176 24109 raft_consensus.cc:385] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.665104 24109 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.665776 24109 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.669685 24109 ts_tablet_manager.cc:1434] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:22.670637 24109 tablet_bootstrap.cc:492] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:22.673590 24137 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.674018 23816 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:22.676409 24109 tablet_bootstrap.cc:654] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.666899 24110 raft_consensus.cc:359] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.667860 24111 tablet_bootstrap.cc:492] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:22.688064 24110 raft_consensus.cc:385] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.688320 24111 ts_tablet_manager.cc:1403] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.157s	user 0.041s	sys 0.039s
I20260709 12:16:22.688383 24110 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.689775 24110 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.692006 24110 ts_tablet_manager.cc:1434] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:16:22.693758 24110 tablet_bootstrap.cc:492] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:22.698952 24111 raft_consensus.cc:359] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.699664 24111 raft_consensus.cc:385] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.699939 24111 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.701566 24111 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.706604 24111 ts_tablet_manager.cc:1434] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:22.707533 24111 tablet_bootstrap.cc:492] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:22.708212 24242 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:22.737564 24152 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.738019 24152 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.734809 24242 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.743052 24242 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.744071 24392 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.745141 24137 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.745656 24242 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.745576 24137 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.748159 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.750424 24152 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.750211 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.750979 23994 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:22.751977 24137 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.752549 24137 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.754136 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.754706 23994 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:22.756796 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.753021 24137 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.758173 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:16:22.759393 24036 leader_election.cc:343] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.753350 23921 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:22.762835 24137 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.763959 24240 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.764335 24240 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.763506 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.764674 24240 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.771091 24152 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.771538 24152 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.771039 24116 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.778453 24152 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.779469 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.780084 23994 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:22.779986 24116 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.783192 24116 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.784543 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.785151 23920 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:22.785393 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:22.784152 24111 tablet_bootstrap.cc:654] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.785849 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.784003 24110 tablet_bootstrap.cc:654] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.787367 24269 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.787745 24269 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.787645 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:22.788213 24269 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.786520 23917 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:22.790020 24109 tablet_bootstrap.cc:492] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:22.790483 24109 ts_tablet_manager.cc:1403] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.120s	user 0.021s	sys 0.039s
I20260709 12:16:22.791399 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:22.794020 24152 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.794719 24152 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.789969 24115 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.792842 24116 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.800771 24152 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.800882 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.796617 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.803625 24109 raft_consensus.cc:359] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.804113 24109 raft_consensus.cc:385] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.804340 24109 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.805722 24109 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.802250 24116 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.810215 24034 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.810916 24109 ts_tablet_manager.cc:1434] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.001s
I20260709 12:16:22.815229 24137 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:22.815572 24137 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:22.815791 24109 tablet_bootstrap.cc:492] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:22.815815 24137 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.817260 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.820457 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:22.821441 24036 leader_election.cc:343] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:22.822121 23887 leader_election.cc:343] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.801100 24115 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:22.826174 23887 leader_election.cc:343] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.814452 24116 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.832046 24137 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.834209 24137 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.835474 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:16:22.836575 24036 leader_election.cc:343] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.838403 24115 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.839783 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.842029 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:22.844480 23887 leader_election.cc:343] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.844897 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.841948 24384 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:16:22.848811 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:22.850606 24269 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.853296 24269 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.854036 24115 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:22.859045 23887 leader_election.cc:343] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.857970 24116 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.861464 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.868928 24269 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.870393 24240 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.907495 24064 raft_consensus.cc:2393] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:22.913385 24240 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:16:22.921486 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 62477.9us
I20260709 12:16:22.922005 24116 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:16:22.923058 24034 leader_election.cc:343] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.923484 24034 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.923744 24111 tablet_bootstrap.cc:492] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:22.924222 24111 ts_tablet_manager.cc:1403] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.217s	user 0.009s	sys 0.016s
I20260709 12:16:22.927662 24242 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.928385 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:22.928606 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:22.929000 23993 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.929101 23992 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.929958 24109 tablet_bootstrap.cc:654] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.931075 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:22.931578 24115 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.932267 24115 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.934687 24115 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:22.937040 23993 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:22.936951 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:22.937933 23920 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:22.937774 23887 leader_election.cc:343] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.938424 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:16:22.938922 23887 leader_election.cc:343] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:22.939116 23916 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.939365 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:22.940289 24152 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:22.942119 24110 tablet_bootstrap.cc:492] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:22.942677 24110 ts_tablet_manager.cc:1403] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.249s	user 0.041s	sys 0.023s
I20260709 12:16:22.942951 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:22.943573 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:22.947446 24111 raft_consensus.cc:359] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.954921 24111 raft_consensus.cc:385] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.955302 24111 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.951826 24384 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:22.957683 24111 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.960034 24111 ts_tablet_manager.cc:1434] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.001s
I20260709 12:16:22.960558 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:22.961560 24067 raft_consensus.cc:2393] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:22.963423 23920 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:22.965219 23992 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:22.953732 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:22.956642 23919 raft_consensus.cc:2393] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 1: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:16:22.968101 24111 tablet_bootstrap.cc:492] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:22.968659 24137 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:22.954139 23916 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:22.972298 24137 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.974231 24152 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.974730 24152 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:22.980459 24110 raft_consensus.cc:359] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.982117 24110 raft_consensus.cc:385] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.975521 24152 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.984084 24137 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:22.987965 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:22.982597 24110 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.989530 24110 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:22.968400 24116 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
W20260709 12:16:22.993777 23887 leader_election.cc:343] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.002753 24110 ts_tablet_manager.cc:1434] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:16:23.005596 24110 tablet_bootstrap.cc:492] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:23.001820 24429 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.011071 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:23.012113 24429 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.012621 24429 raft_consensus.cc:697] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:16:23.034617 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60714.8us
I20260709 12:16:23.050414 24269 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:23.050865 24036 leader_election.cc:343] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.013481 24429 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.051000 24269 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.040617 24034 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:23.091197 24240 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.091897 24240 raft_consensus.cc:697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:23.094432 24240 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:23.136711 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 96168.2us
I20260709 12:16:23.137566 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:23.138464 24435 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.163242 24137 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:23.145485 24384 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.162933 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:23.180284 24109 tablet_bootstrap.cc:492] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:23.180810 24109 ts_tablet_manager.cc:1403] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.365s	user 0.018s	sys 0.014s
I20260709 12:16:23.171638 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:23.172820 24384 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:23.193461 23887 leader_election.cc:343] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.200877 24384 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:23.200639 24109 raft_consensus.cc:359] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.201401 24109 raft_consensus.cc:385] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.201722 24109 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.207455 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:23.208130 23916 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:23.294114 24109 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.315629 24115 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.316089 24115 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.319298 24115 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:23.320191 24445 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:23.324604 23887 leader_election.cc:343] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.325217 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:23.326546 24110 tablet_bootstrap.cc:654] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.328168 24115 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.330183 24109 ts_tablet_manager.cc:1434] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.149s	user 0.007s	sys 0.002s
I20260709 12:16:23.331230 24109 tablet_bootstrap.cc:492] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:23.320705 24445 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.334120 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:23.341420 24034 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:23.365128 24448 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.369172 24448 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.369560 24448 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.372520 24449 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:16:23.374439 24447 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:16:23.386116 24111 tablet_bootstrap.cc:654] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.397054 24445 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:23.404049 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:23.404929 23915 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:23.398151 23819 catalog_manager.cc:5697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:23.413159 24269 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:16:23.420943 23887 leader_election.cc:343] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.451097 24110 tablet_bootstrap.cc:492] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:23.451683 24110 ts_tablet_manager.cc:1403] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.446s	user 0.013s	sys 0.018s
W20260709 12:16:23.455886 23867 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:23.440378 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:23.457486 23960 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:23.462250 24110 raft_consensus.cc:359] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.463333 24110 raft_consensus.cc:385] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.463726 24110 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.464602 24110 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.466188 24393 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.472047 24393 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.472546 24393 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.475683 24111 tablet_bootstrap.cc:492] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:23.476140 24111 ts_tablet_manager.cc:1403] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.508s	user 0.028s	sys 0.033s
I20260709 12:16:23.481357 24110 ts_tablet_manager.cc:1434] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
W20260709 12:16:23.484169 23887 leader_election.cc:343] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.484652 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:23.485374 24152 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.479147 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:23.447932 24448 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.501415 24111 raft_consensus.cc:359] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.499636 24109 tablet_bootstrap.cc:654] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.505897 24111 raft_consensus.cc:385] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.506191 24111 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.507373 24110 tablet_bootstrap.cc:492] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:23.508548 24111 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.508698 23916 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:23.524844 24111 ts_tablet_manager.cc:1434] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:16:23.526490 24448 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:23.532081 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:23.535230 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:23.535776 23919 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.542445 24448 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.551875 24448 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.552289 24448 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:23.561806 24450 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.191s	user 0.003s	sys 0.000s
I20260709 12:16:23.573184 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:23.572402 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:23.601415 24111 tablet_bootstrap.cc:492] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:23.591490 24441 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:16:23.612775 24448 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.613487 24110 tablet_bootstrap.cc:654] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.618615 24067 raft_consensus.cc:2393] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:23.624266 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:23.629878 24393 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.624763 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:23.631743 23916 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.632539 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:23.624730 24063 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:23.638008 24436 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.640916 23993 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 1: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:16:23.645565 23818 catalog_manager.cc:5697] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.648077 23818 catalog_manager.cc:5697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.652730 24152 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.653239 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:23.654676 24435 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.667948 23919 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:23.668548 24269 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.684319 24109 tablet_bootstrap.cc:492] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:23.684726 24034 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:23.684924 24109 ts_tablet_manager.cc:1403] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.354s	user 0.014s	sys 0.010s
I20260709 12:16:23.656767 24435 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.655923 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:23.690903 24445 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.688619 24448 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:16:23.721102 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 83903.8us
I20260709 12:16:23.721836 24445 raft_consensus.cc:697] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:23.731441 23916 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:23.724074 24445 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.759057 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:23.765547 24435 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:23.772037 24111 tablet_bootstrap.cc:654] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:23.777987 24036 leader_election.cc:343] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.778257 24109 raft_consensus.cc:359] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.779904 24109 raft_consensus.cc:385] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.780218 24109 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.781036 24109 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.787074 24109 ts_tablet_manager.cc:1434] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.001s
I20260709 12:16:23.789647 24110 tablet_bootstrap.cc:492] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:23.790099 24110 ts_tablet_manager.cc:1403] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.283s	user 0.002s	sys 0.021s
I20260709 12:16:23.776340 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:23.795622 24438 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.796101 24438 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:23.786164 24392 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.802098 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:23.802361 24438 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.799160 23917 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:23.800040 24392 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.808907 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:23.807869 24466 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:16:23.811873 23992 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.812429 24392 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:23.824530 23990 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 1: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:16:23.825352 24467 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.826336 24467 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.826658 24467 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.832150 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:23.838697 23920 raft_consensus.cc:2393] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:23.832828 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:23.841292 24393 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:23.841763 24110 raft_consensus.cc:359] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.850421 24110 raft_consensus.cc:385] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.850730 24110 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.851365 24110 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.822979 24444 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:23.865864 24110 ts_tablet_manager.cc:1434] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.075s	user 0.003s	sys 0.003s
I20260709 12:16:23.869035 24109 tablet_bootstrap.cc:492] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:23.872085 24110 tablet_bootstrap.cc:492] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:23.874020 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:23.927434 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:23.909783 24467 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.932993 24445 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:23.939555 24467 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:23.936583 24109 tablet_bootstrap.cc:654] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.939375 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:23.943789 23914 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:23.948711 24036 leader_election.cc:343] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.956645 23914 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:23.958626 24111 tablet_bootstrap.cc:492] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:23.959060 24111 ts_tablet_manager.cc:1403] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.358s	user 0.015s	sys 0.027s
I20260709 12:16:23.955778 23819 catalog_manager.cc:5697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.959594 24445 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:23.960662 23819 catalog_manager.cc:5697] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.961467 24111 raft_consensus.cc:359] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.962077 24111 raft_consensus.cc:385] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.962975 24111 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.963651 24111 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.964229 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:23.968446 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:23.970438 24204 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.970498 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:23.971801 24191 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.974493 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:23.977180 24444 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.977624 24444 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:23.978392 24444 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:23.985569 24111 ts_tablet_manager.cc:1434] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:16:23.987056 24111 tablet_bootstrap.cc:492] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:23.974781 24110 tablet_bootstrap.cc:654] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.995704 24111 tablet_bootstrap.cc:654] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:23.997520 24036 leader_election.cc:343] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.004463 24152 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.004980 24152 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.006806 24152 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.014490 24109 tablet_bootstrap.cc:492] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:24.018082 24109 ts_tablet_manager.cc:1403] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.149s	user 0.013s	sys 0.012s
I20260709 12:16:24.034890 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.035302 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:24.036273 23992 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:24.035641 24067 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:24.034842 24109 raft_consensus.cc:359] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.041244 24109 raft_consensus.cc:385] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.041672 24109 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.042613 24109 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.044699 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:24.046486 24442 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.046954 24442 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.047364 24442 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.047559 24110 tablet_bootstrap.cc:492] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.047983 24110 ts_tablet_manager.cc:1403] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.181s	user 0.013s	sys 0.001s
I20260709 12:16:24.051050 24109 ts_tablet_manager.cc:1434] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:16:24.051502 23819 catalog_manager.cc:5697] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.055723 24109 tablet_bootstrap.cc:492] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:24.056366 24110 raft_consensus.cc:359] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.056999 24110 raft_consensus.cc:385] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.057052 24111 tablet_bootstrap.cc:492] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:24.057600 24111 ts_tablet_manager.cc:1403] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.071s	user 0.032s	sys 0.027s
I20260709 12:16:24.061533 24111 raft_consensus.cc:359] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.061702 24442 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.063344 24109 tablet_bootstrap.cc:654] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.063676 24110 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.065738 24442 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.062182 24111 raft_consensus.cc:385] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.066648 24111 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.067508 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:24.068123 23992 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.067301 24111 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.072398 24111 ts_tablet_manager.cc:1434] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:16:24.073215 24111 tablet_bootstrap.cc:492] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:24.075603 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:24.076218 24067 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.084638 24067 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:24.086520 24111 tablet_bootstrap.cc:654] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.087208 23992 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:24.097035 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.068133 24110 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.101164 24110 ts_tablet_manager.cc:1434] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:16:24.101811 24152 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.102512 24152 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:24.104017 24152 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.106583 24467 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.107259 24467 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.110306 24467 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:24.116196 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:16:24.117467 24034 leader_election.cc:343] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.118698 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:24.120918 24110 tablet_bootstrap.cc:492] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
W20260709 12:16:24.122313 24036 leader_election.cc:343] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.122769 24036 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:24.123773 24116 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.127409 24392 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.127903 24392 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.131552 24392 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.142787 24111 tablet_bootstrap.cc:492] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:24.142764 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.143409 24111 ts_tablet_manager.cc:1403] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.040s
I20260709 12:16:24.144481 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:24.145318 23916 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:16:24.145609 24111 raft_consensus.cc:359] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.147195 24111 raft_consensus.cc:385] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.147429 24111 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.147961 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:24.148015 24111 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.148814 24384 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.150954 24111 ts_tablet_manager.cc:1434] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:16:24.153098 24111 tablet_bootstrap.cc:492] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:24.158231 24110 tablet_bootstrap.cc:654] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.157789 24384 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.167873 24111 tablet_bootstrap.cc:654] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.174221 24109 tablet_bootstrap.cc:492] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:24.174726 24109 ts_tablet_manager.cc:1403] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.119s	user 0.027s	sys 0.011s
I20260709 12:16:24.181367 24111 tablet_bootstrap.cc:492] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:24.181818 24111 ts_tablet_manager.cc:1403] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.008s
I20260709 12:16:24.182348 23818 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:24.184170 24036 consensus_peers.cc:597] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:24.184535 24111 raft_consensus.cc:359] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.185197 24111 raft_consensus.cc:385] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.185462 24111 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.187207 24109 raft_consensus.cc:359] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.187866 24109 raft_consensus.cc:385] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.188138 24109 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.186087 24111 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.190001 24111 ts_tablet_manager.cc:1434] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:16:24.190666 24109 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.192552 24111 tablet_bootstrap.cc:492] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:24.195247 24110 tablet_bootstrap.cc:492] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.195905 24109 ts_tablet_manager.cc:1434] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:16:24.196799 24109 tablet_bootstrap.cc:492] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:24.198906 24110 ts_tablet_manager.cc:1403] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.003s
I20260709 12:16:24.203118 24111 tablet_bootstrap.cc:654] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.203365 24110 raft_consensus.cc:359] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.204102 24110 raft_consensus.cc:385] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.204366 24109 tablet_bootstrap.cc:654] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.204429 24110 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.205385 24110 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.218375 24110 ts_tablet_manager.cc:1434] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:16:24.219347 24110 tablet_bootstrap.cc:492] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:24.225647 24109 tablet_bootstrap.cc:492] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:24.226006 24110 tablet_bootstrap.cc:654] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.226148 24109 ts_tablet_manager.cc:1403] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.001s
I20260709 12:16:24.228996 24109 raft_consensus.cc:359] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.229725 24109 raft_consensus.cc:385] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.230021 24109 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.230895 24109 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.233315 24111 tablet_bootstrap.cc:492] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:24.234588 24109 ts_tablet_manager.cc:1434] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:24.235463 24109 tablet_bootstrap.cc:492] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:24.236840 24111 ts_tablet_manager.cc:1403] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.013s
I20260709 12:16:24.239782 24111 raft_consensus.cc:359] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.240437 24111 raft_consensus.cc:385] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.240695 24111 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.241161 24109 tablet_bootstrap.cc:654] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.241381 24111 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.244539 24111 ts_tablet_manager.cc:1434] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:24.245407 24111 tablet_bootstrap.cc:492] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:24.254228 24111 tablet_bootstrap.cc:654] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.264228 24152 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.264489 24109 tablet_bootstrap.cc:492] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:24.264958 24109 ts_tablet_manager.cc:1403] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.010s
I20260709 12:16:24.264694 24152 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.266571 24152 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.267333 24110 tablet_bootstrap.cc:492] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.267760 24110 ts_tablet_manager.cc:1403] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.008s
I20260709 12:16:24.267584 24109 raft_consensus.cc:359] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.268208 24109 raft_consensus.cc:385] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.268498 24109 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.269088 24109 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.269433 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.270669 24110 raft_consensus.cc:359] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.270841 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:24.271310 24110 raft_consensus.cc:385] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.271350 24109 ts_tablet_manager.cc:1434] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
W20260709 12:16:24.270830 23887 leader_election.cc:343] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.271739 24110 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
W20260709 12:16:24.272164 23887 leader_election.cc:343] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.272404 24109 tablet_bootstrap.cc:492] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:24.272529 23887 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:24.272644 24110 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.273433 24152 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.275708 24110 ts_tablet_manager.cc:1434] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:16:24.284564 24445 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.285419 24109 tablet_bootstrap.cc:654] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.290795 24110 tablet_bootstrap.cc:492] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:24.302032 24110 tablet_bootstrap.cc:654] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.308637 24384 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.309157 24384 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.310922 24111 tablet_bootstrap.cc:492] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:24.311867 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:24.312521 23916 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:24.313746 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.314632 24191 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.315110 24191 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.315394 24191 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.317029 24109 tablet_bootstrap.cc:492] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:24.317484 24109 ts_tablet_manager.cc:1403] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.007s
I20260709 12:16:24.319931 24109 raft_consensus.cc:359] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.320583 24109 raft_consensus.cc:385] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.311903 24111 ts_tablet_manager.cc:1403] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.018s
I20260709 12:16:24.320860 24109 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.303576 24445 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.321583 24109 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.322381 24110 tablet_bootstrap.cc:492] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.322867 24110 ts_tablet_manager.cc:1403] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.012s
I20260709 12:16:24.323972 24109 ts_tablet_manager.cc:1434] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:24.326604 24109 tablet_bootstrap.cc:492] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Bootstrap starting.
I20260709 12:16:24.329710 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.332096 24067 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:24.332331 24109 tablet_bootstrap.cc:654] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.334245 24111 raft_consensus.cc:359] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.334947 24111 raft_consensus.cc:385] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.335305 24111 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.336084 24384 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.337237 24111 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.338980 24152 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.341467 24152 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.343559 24152 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.340767 24444 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.344403 24111 ts_tablet_manager.cc:1434] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.023s	user 0.003s	sys 0.003s
I20260709 12:16:24.351056 24111 tablet_bootstrap.cc:492] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:24.341689 24110 raft_consensus.cc:359] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.351810 24110 raft_consensus.cc:385] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.353955 24110 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.354703 24110 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.344847 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:24.346657 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:16:24.362812 23887 leader_election.cc:343] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.365214 24110 ts_tablet_manager.cc:1434] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.003s
I20260709 12:16:24.368655 24110 tablet_bootstrap.cc:492] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:24.339809 24191 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.379159 24191 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:16:24.379824 23887 leader_election.cc:343] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.383198 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:24.383909 24440 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.380756 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:24.384763 23916 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.387454 24384 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.388106 24384 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.388998 24440 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.389508 24440 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.391430 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:24.392035 23917 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:24.392364 24384 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.393277 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.394672 24440 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.381791 24445 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.395130 24384 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.395762 24384 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.396196 24384 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.401036 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.403242 23916 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:24.381625 24111 tablet_bootstrap.cc:654] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.404107 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:16:24.405761 23887 leader_election.cc:343] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.406509 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.408792 24392 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.409430 24392 raft_consensus.cc:697] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:24.410534 24392 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.412007 24440 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.412693 24440 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.415380 24440 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.411077 24110 tablet_bootstrap.cc:654] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.420292 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:24.401912 24061 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:24.428001 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:24.428800 24067 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.433249 24384 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.434381 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.454144 24069 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:24.435636 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.455252 24063 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:24.466814 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:24.467625 24152 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.467936 24152 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.468207 24152 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.469172 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:16:24.470180 23887 leader_election.cc:343] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.475138 24111 tablet_bootstrap.cc:492] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:24.476715 24111 ts_tablet_manager.cc:1403] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.126s	user 0.023s	sys 0.018s
I20260709 12:16:24.479135 24110 tablet_bootstrap.cc:492] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.479568 24110 ts_tablet_manager.cc:1403] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.111s	user 0.012s	sys 0.000s
I20260709 12:16:24.476042 24269 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.484522 24269 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.484860 24269 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.490655 24384 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.497694 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:24.497606 24269 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.498332 24069 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.499522 24269 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.500698 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:24.501222 23917 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.501827 24442 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.502321 24442 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.508074 24110 raft_consensus.cc:359] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.508977 24110 raft_consensus.cc:385] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.509317 24110 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.526443 24111 raft_consensus.cc:359] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.527386 24111 raft_consensus.cc:385] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.527710 24111 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.489969 24067 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:24.560659 24111 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.561607 24442 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.562903 24111 ts_tablet_manager.cc:1434] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.086s	user 0.010s	sys 0.007s
I20260709 12:16:24.563788 24111 tablet_bootstrap.cc:492] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
W20260709 12:16:24.568357 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 65126us
I20260709 12:16:24.569391 24111 tablet_bootstrap.cc:654] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.569777 23818 catalog_manager.cc:5697] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.572674 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:24.573916 24063 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.574846 23917 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:24.575937 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.576709 24384 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.577142 24384 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:24.577919 24384 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.578469 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:24.571508 24442 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.583681 24063 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:24.583611 24442 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.585886 24442 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.593225 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:24.587387 24152 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.588479 24069 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:24.593736 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.598232 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.598860 24069 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:24.599824 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:24.600078 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:24.601187 24063 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.601495 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:24.570760 24110 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.604894 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:24.596448 24152 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.611449 24442 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.612078 24442 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:24.612893 24442 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.614178 24063 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:24.615854 24109 tablet_bootstrap.cc:492] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: No bootstrap required, opened a new log
I20260709 12:16:24.616060 24152 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.616482 24109 ts_tablet_manager.cc:1403] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Time spent bootstrapping tablet: real 0.290s	user 0.065s	sys 0.057s
W20260709 12:16:24.618105 23887 leader_election.cc:343] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.619621 24109 raft_consensus.cc:359] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.618784 23993 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 0.
I20260709 12:16:24.620573 24109 raft_consensus.cc:385] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.621002 24109 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.621415 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:24.624521 24508 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.624938 24508 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.625312 24508 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.627388 24110 ts_tablet_manager.cc:1434] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.148s	user 0.008s	sys 0.004s
I20260709 12:16:24.628904 24110 tablet_bootstrap.cc:492] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:24.628471 24109 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.627796 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:24.635452 24109 ts_tablet_manager.cc:1434] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:16:24.636271 24152 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.635634 24110 tablet_bootstrap.cc:654] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.639302 24152 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:24.640015 24152 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.637897 24111 tablet_bootstrap.cc:492] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:24.641817 24111 ts_tablet_manager.cc:1403] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.078s	user 0.005s	sys 0.015s
I20260709 12:16:24.638236 24508 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.644311 24508 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:16:24.638682 23867 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:24.647116 24111 raft_consensus.cc:359] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.647792 24111 raft_consensus.cc:385] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.648049 24111 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.649202 24111 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.650785 23816 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.651654 24111 ts_tablet_manager.cc:1434] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
W20260709 12:16:24.653743 23887 leader_election.cc:343] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.655288 24111 tablet_bootstrap.cc:492] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Bootstrap starting.
I20260709 12:16:24.657706 24392 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.658155 24392 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:16:24.659364 23887 leader_election.cc:343] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.661310 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:24.660116 24392 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.661737 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:24.662101 24152 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.662367 23917 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
W20260709 12:16:24.663313 23887 leader_election.cc:343] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.663506 23960 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.664413 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.665007 24063 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:24.665277 24384 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.665670 24384 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.666371 24384 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.678121 24110 tablet_bootstrap.cc:492] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.681365 24110 ts_tablet_manager.cc:1403] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.000s
I20260709 12:16:24.684567 24110 raft_consensus.cc:359] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.686627 24110 raft_consensus.cc:385] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.686956 24110 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.687155 24384 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.687755 24110 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.689801 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:24.690140 24110 ts_tablet_manager.cc:1434] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:16:24.690421 23914 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.691200 24110 tablet_bootstrap.cc:492] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:24.689836 23816 catalog_manager.cc:5697] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.699883 24110 tablet_bootstrap.cc:654] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.706810 24384 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.707739 23914 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:24.708554 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:24.709270 24069 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.712760 24111 tablet_bootstrap.cc:654] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.718580 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:24.719189 24067 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.723431 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:24.724042 23993 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.736941 24067 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:24.738587 24467 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.740403 23817 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.747192 24069 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:24.750598 23962 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.751255 23993 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:16:24.751847 24387 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.752312 24387 raft_consensus.cc:697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:24.753203 24110 tablet_bootstrap.cc:492] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.753090 24387 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.753615 24110 ts_tablet_manager.cc:1403] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.063s	user 0.026s	sys 0.022s
I20260709 12:16:24.756310 24110 raft_consensus.cc:359] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.756902 24110 raft_consensus.cc:385] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.757160 24110 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.757740 24110 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.759929 24110 ts_tablet_manager.cc:1434] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:16:24.760751 24110 tablet_bootstrap.cc:492] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:24.776074 23988 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.777123 24110 tablet_bootstrap.cc:654] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.799883 24111 tablet_bootstrap.cc:492] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: No bootstrap required, opened a new log
I20260709 12:16:24.800432 24111 ts_tablet_manager.cc:1403] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent bootstrapping tablet: real 0.145s	user 0.010s	sys 0.003s
I20260709 12:16:24.801163 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.802259 24152 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.802738 24152 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:24.803782 24110 tablet_bootstrap.cc:492] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.803462 24152 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.804466 24110 ts_tablet_manager.cc:1403] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.007s
I20260709 12:16:24.807348 24110 raft_consensus.cc:359] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.810734 24110 raft_consensus.cc:385] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.811100 24110 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.811846 24110 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.815230 24110 ts_tablet_manager.cc:1434] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:16:24.808167 24111 raft_consensus.cc:359] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.817076 24111 raft_consensus.cc:385] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.817351 24111 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.818451 24110 tablet_bootstrap.cc:492] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:24.821314 23816 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.824594 24110 tablet_bootstrap.cc:654] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.825685 23817 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.829154 24387 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.829641 24387 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.830543 24111 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.831694 24387 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.832899 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.833612 24067 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 1: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:16:24.834101 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:24.836609 24111 ts_tablet_manager.cc:1434] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 12:16:24.838043 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:24.841671 24384 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.845404 24110 tablet_bootstrap.cc:492] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.845952 24110 ts_tablet_manager.cc:1403] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.006s
I20260709 12:16:24.848878 24269 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.848820 24110 raft_consensus.cc:359] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.849699 24110 raft_consensus.cc:385] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.850047 24110 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.850878 24110 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.853104 24110 ts_tablet_manager.cc:1434] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:24.854528 24110 tablet_bootstrap.cc:492] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:24.863035 24110 tablet_bootstrap.cc:654] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.871748 24110 tablet_bootstrap.cc:492] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.872262 24110 ts_tablet_manager.cc:1403] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.006s
I20260709 12:16:24.878868 24110 raft_consensus.cc:359] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.880785 24110 raft_consensus.cc:385] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.884050 24110 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.879901 24384 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.885069 24110 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.887744 24110 ts_tablet_manager.cc:1434] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:16:24.888732 24110 tablet_bootstrap.cc:492] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Bootstrap starting.
I20260709 12:16:24.890548 24387 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.891037 24387 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.893049 24387 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.893817 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:24.894447 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.895588 24067 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:24.896770 23962 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.894517 23917 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:24.897583 24387 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.897830 24110 tablet_bootstrap.cc:654] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.897989 24387 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.898434 24387 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.904718 24387 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.907666 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:24.911607 23917 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.910720 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:24.922369 24067 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.910867 24384 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:16:24.908898 24387 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.943907 23917 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:24.945832 24067 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:24.947235 24110 tablet_bootstrap.cc:492] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: No bootstrap required, opened a new log
I20260709 12:16:24.947721 24110 ts_tablet_manager.cc:1403] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Time spent bootstrapping tablet: real 0.059s	user 0.032s	sys 0.018s
I20260709 12:16:24.947785 23962 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:24.948732 24387 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.949769 24387 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:24.950248 24110 raft_consensus.cc:359] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.950943 24110 raft_consensus.cc:385] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.950680 24387 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.951211 24110 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.951843 24110 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.953918 24110 ts_tablet_manager.cc:1434] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:24.962031 24392 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.963783 23816 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.995434 24392 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.995860 24392 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:24.997478 24392 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:24.998106 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:24.998386 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:24.998689 23914 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:24.998906 24067 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 0.
I20260709 12:16:24.999624 23960 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:25.000234 24392 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.000591 24392 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.000864 24392 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.005818 24392 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:25.007330 24392 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:25.008277 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:25.008315 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:25.008993 23914 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.009909 24067 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.015784 23914 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:25.016194 24067 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:16:25.017113 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:25.017684 24392 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.018126 24392 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:25.018849 24392 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:25.023593 24506 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.024040 24506 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:25.026062 24506 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:25.026998 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:25.026979 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:16:25.027736 23914 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:25.027801 23988 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 0.
I20260709 12:16:25.028333 23818 catalog_manager.cc:5697] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.028915 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:25.029940 24506 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:25.030388 24506 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:25.030710 24506 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.037199 24506 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:25.038421 24392 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.039819 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:25.039933 24506 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:25.040391 23914 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.045636 23914 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:25.046495 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:25.047379 24506 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:25.049012 24506 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:25.051074 24506 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:25.054373 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:25.055274 23988 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.140086 23816 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 0 to 1, leader changed from <none> to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:25.145480 24507 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.159981 24387 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.174569 24392 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:25.185590 23988 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:16:25.176247 24392 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:25.193270 24392 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:16:25.211035 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 70024.3us
I20260709 12:16:25.225871 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:16:25.231412 24152 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:16:25.238704 24442 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.246788 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:16:25.256901 23993 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:25.277715 24507 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.284897 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:25.288532 24533 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:25.355880 24507 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.355813 24534 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.371327 24535 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.381208 24535 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.383198 24269 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.391898 24387 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.455396 24387 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.473116 24387 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.547258 24444 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:25.559741 24444 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:27.119150 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:27.148917 24554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:27.149976 24555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:27.150048 22720 server_base.cc:1061] running on GCE node
W20260709 12:16:27.150141 24557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:27.151706 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:27.151947 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:27.152145 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599387152121 us; error 0 us; skew 500 ppm
I20260709 12:16:27.152693 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:27.155444 22720 webserver.cc:533] Webserver started at http://127.22.48.4:44951/ using document root <none> and password file <none>
I20260709 12:16:27.156037 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:27.156298 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:27.156607 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:27.157934 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-3-root/instance:
uuid: "71a48f59ff764d249519c6a53ec57f02"
format_stamp: "Formatted at 2026-07-09 12:16:27 on dist-test-slave-044g"
I20260709 12:16:27.163293 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:27.166841 24562 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:27.167932 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:16:27.168262 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-3-root
uuid: "71a48f59ff764d249519c6a53ec57f02"
format_stamp: "Formatted at 2026-07-09 12:16:27 on dist-test-slave-044g"
I20260709 12:16:27.168609 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:27.219458 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:27.220820 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:27.222376 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:27.224758 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:27.224977 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:27.225236 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:27.225409 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:27.276186 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.4:34635
I20260709 12:16:27.276261 24624 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.4:34635 every 8 connection(s)
I20260709 12:16:27.280776 22720 auto_leader_rebalancer-test.cc:439] add a tserver: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:27.300171 24625 heartbeater.cc:344] Connected to a master server at 127.22.48.62:36189
I20260709 12:16:27.300638 24625 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:27.301386 24625 heartbeater.cc:507] Master 127.22.48.62:36189 requested a full tablet report, sending...
I20260709 12:16:27.303517 23816 ts_manager.cc:194] Registered new tserver with Master: 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:16:27.305433 23816 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43626
I20260709 12:16:27.824465 23993 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:27.832110 23917 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:27.835441 24535 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:27.836580 24061 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:27.838425 24535 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:27.854533 24387 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:27.856235 23914 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
W20260709 12:16:27.862149 23961 consensus_peers.cc:597] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91e7023603694b9d8a378858f72b4532. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:27.880028 23816 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:27.903100 24061 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:27.937796 24069 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:27.953919 23993 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:27.956401 23916 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:27.956868 24552 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:27.959039 24552 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:27.968945 24551 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:27.973642 23992 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:27.999310 23817 catalog_manager.cc:5697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:27.999832 23914 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:28.012466 24061 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:28.015969 24035 consensus_peers.cc:597] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a33810a45fd4e70b0d4411b8c0afdd6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.027069 23993 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:28.028192 24035 consensus_peers.cc:597] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea07088f87a54d2194bc706db4279d24. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.028488 23914 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:28.028723 24552 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:28.030754 24551 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:28.039132 24552 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:28.041019 23992 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:28.043996 23914 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:28.056833 24061 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:28.062638 23817 catalog_manager.cc:5697] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:28.065122 23992 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:28.066095 24035 consensus_peers.cc:597] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e53ff7433274cdf9c150f141d03e1f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:28.067371 23916 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:28.068964 24551 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:28.072825 24551 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:28.082554 24444 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:28.089576 23990 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:28.105224 23816 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.107107 23916 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:28.307704 24625 heartbeater.cc:499] Master 127.22.48.62:36189 was elected leader, sending a full tablet report...
I20260709 12:16:28.331175 24656 ts_tablet_manager.cc:933] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:28.334192 24656 tablet_copy_client.cc:323] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:28.347776 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 2a33810a45fd4e70b0d4411b8c0afdd6 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:28.348424 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 2a33810a45fd4e70b0d4411b8c0afdd6 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-2a33810a45fd4e70b0d4411b8c0afdd6
I20260709 12:16:28.359205 24080 tablet_copy_source_session.cc:215] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:28.364650 24656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a33810a45fd4e70b0d4411b8c0afdd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:28.376402 24656 tablet_copy_client.cc:806] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:28.377010 24656 tablet_copy_client.cc:670] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:28.381206 24656 tablet_copy_client.cc:538] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:28.387871 24656 tablet_bootstrap.cc:492] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:28.398770 24659 ts_tablet_manager.cc:933] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:28.432233 24659 tablet_copy_client.cc:323] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.2:43801
I20260709 12:16:28.438517 24656 tablet_bootstrap.cc:492] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:28.439694 24656 tablet_bootstrap.cc:492] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:28.440903 24656 ts_tablet_manager.cc:1403] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.015s
I20260709 12:16:28.445343 24006 tablet_copy_service.cc:140] P ef0dd15ac654478b8371c22b8909240e: Received BeginTabletCopySession request for tablet 91e7023603694b9d8a378858f72b4532 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:60542)
I20260709 12:16:28.445988 24006 tablet_copy_service.cc:161] P ef0dd15ac654478b8371c22b8909240e: Beginning new tablet copy session on tablet 91e7023603694b9d8a378858f72b4532 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:60542: session id = 71a48f59ff764d249519c6a53ec57f02-91e7023603694b9d8a378858f72b4532
I20260709 12:16:28.444572 24656 raft_consensus.cc:359] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:28.446835 24656 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:28.447423 24656 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:28.456487 24006 tablet_copy_source_session.cc:215] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:28.460091 24656 ts_tablet_manager.cc:1434] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 12:16:28.464955 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e7023603694b9d8a378858f72b4532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:28.469487 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-2a33810a45fd4e70b0d4411b8c0afdd6 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:28.470005 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-2a33810a45fd4e70b0d4411b8c0afdd6 on tablet 2a33810a45fd4e70b0d4411b8c0afdd6 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:28.482403 24659 tablet_copy_client.cc:806] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:28.483067 24659 tablet_copy_client.cc:670] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:28.486548 24659 tablet_copy_client.cc:538] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:28.492985 24659 tablet_bootstrap.cc:492] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:28.509310 24659 tablet_bootstrap.cc:492] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:28.509953 24659 tablet_bootstrap.cc:492] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:28.510581 24659 ts_tablet_manager.cc:1403] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.008s
I20260709 12:16:28.513057 24659 raft_consensus.cc:359] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:28.513684 24659 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:28.514146 24659 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:28.516036 24659 ts_tablet_manager.cc:1434] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:16:28.517875 24006 tablet_copy_service.cc:342] P ef0dd15ac654478b8371c22b8909240e: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-91e7023603694b9d8a378858f72b4532 received from {username='slave'} at 127.0.0.1:60542
I20260709 12:16:28.518357 24006 tablet_copy_service.cc:434] P ef0dd15ac654478b8371c22b8909240e: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-91e7023603694b9d8a378858f72b4532 on tablet 91e7023603694b9d8a378858f72b4532 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:28.531024 24659 ts_tablet_manager.cc:933] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:28.534162 24659 tablet_copy_client.cc:323] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:28.536755 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 7e53ff7433274cdf9c150f141d03e1f5 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:28.537273 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 7e53ff7433274cdf9c150f141d03e1f5 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-7e53ff7433274cdf9c150f141d03e1f5
I20260709 12:16:28.544616 24080 tablet_copy_source_session.cc:215] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:28.549468 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e53ff7433274cdf9c150f141d03e1f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:28.564306 24659 tablet_copy_client.cc:806] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:28.564862 24659 tablet_copy_client.cc:670] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:28.570716 24659 tablet_copy_client.cc:538] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:28.580631 24659 tablet_bootstrap.cc:492] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:28.597368 24659 tablet_bootstrap.cc:492] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:28.598400 24659 tablet_bootstrap.cc:492] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:28.599089 24659 ts_tablet_manager.cc:1403] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.004s
I20260709 12:16:28.600736 24656 ts_tablet_manager.cc:933] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:28.602162 24659 raft_consensus.cc:359] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:28.603044 24659 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:28.603924 24659 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:28.605847 24656 tablet_copy_client.cc:323] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:28.607357 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet ea07088f87a54d2194bc706db4279d24 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:28.607867 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet ea07088f87a54d2194bc706db4279d24 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-ea07088f87a54d2194bc706db4279d24
I20260709 12:16:28.608028 24659 ts_tablet_manager.cc:1434] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:16:28.610194 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-7e53ff7433274cdf9c150f141d03e1f5 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:28.610620 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-7e53ff7433274cdf9c150f141d03e1f5 on tablet 7e53ff7433274cdf9c150f141d03e1f5 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:28.614998 24080 tablet_copy_source_session.cc:215] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:28.618076 24656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea07088f87a54d2194bc706db4279d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:28.630980 24656 tablet_copy_client.cc:806] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:28.631471 24656 tablet_copy_client.cc:670] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:28.634678 24656 tablet_copy_client.cc:538] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:28.641947 24656 tablet_bootstrap.cc:492] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:28.660154 24656 tablet_bootstrap.cc:492] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:28.660995 24656 tablet_bootstrap.cc:492] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:28.661638 24656 ts_tablet_manager.cc:1403] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 12:16:28.664515 24656 raft_consensus.cc:359] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:28.665323 24656 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:28.665869 24656 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:28.668292 24656 ts_tablet_manager.cc:1434] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:16:28.669986 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-ea07088f87a54d2194bc706db4279d24 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:28.670424 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-ea07088f87a54d2194bc706db4279d24 on tablet ea07088f87a54d2194bc706db4279d24 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:28.720491 24600 raft_consensus.cc:1217] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:28.837033 24600 raft_consensus.cc:1217] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:29.092628 24600 raft_consensus.cc:1217] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:29.172377 24600 raft_consensus.cc:1217] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:29.297101 24670 raft_consensus.cc:1064] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:29.299207 24670 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:29.305452 23990 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.305552 24600 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.307119 24552 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.307721 23921 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.308490 24670 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.309311 24444 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.331431 24444 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.333714 24669 raft_consensus.cc:1064] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:29.333204 23921 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.351138 24599 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.355751 23990 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.336249 24669 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:29.350179 23818 catalog_manager.cc:5697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.384888 24069 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.384905 24599 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.385982 23921 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.387475 24669 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.389331 24387 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.391314 24387 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.420199 24535 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.423290 24069 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.428071 23914 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.432832 24599 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.433470 24061 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:29.440348 23816 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.441207 24600 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:29.444594 24670 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:29.452615 23990 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:29.454653 24444 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.458547 24600 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.463814 23993 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:29.465180 24670 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:29.471335 23993 raft_consensus.cc:2955] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.478081 24552 raft_consensus.cc:1064] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:29.480382 24552 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:29.490929 24599 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:29.495469 24683 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:29.509547 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2a33810a45fd4e70b0d4411b8c0afdd6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:29.523864 24535 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.529119 24598 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.530089 24599 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.529160 23990 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.531942 23914 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.536782 23819 catalog_manager.cc:5697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.530819 24552 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:29.546434 23914 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:29.548317 24444 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.548693 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 91e7023603694b9d8a378858f72b4532 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:29.549124 24655 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.552588 24683 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:29.572505 23921 raft_consensus.cc:2955] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.581199 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a33810a45fd4e70b0d4411b8c0afdd6 with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:29.583786 23817 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.614073 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 91e7023603694b9d8a378858f72b4532 with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57818
I20260709 12:16:29.641523 24689 tablet_replica.cc:333] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:29.643134 24690 tablet_replica.cc:333] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:16:29.653360 24690 raft_consensus.cc:2243] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.654085 24690 raft_consensus.cc:2272] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.654980 24689 raft_consensus.cc:2243] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.655975 24689 raft_consensus.cc:2272] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.661123 24689 ts_tablet_manager.cc:1916] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:29.664923 24690 ts_tablet_manager.cc:1916] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:29.666909 24444 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.672154 23990 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.672693 24600 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.677985 24689 ts_tablet_manager.cc:1929] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:29.678692 24689 log.cc:1199] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/2a33810a45fd4e70b0d4411b8c0afdd6
I20260709 12:16:29.680620 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet 2a33810a45fd4e70b0d4411b8c0afdd6 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:29.691785 23817 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.692896 24690 ts_tablet_manager.cc:1929] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:29.694530 24690 log.cc:1199] T 91e7023603694b9d8a378858f72b4532 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/91e7023603694b9d8a378858f72b4532
I20260709 12:16:29.698381 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 91e7023603694b9d8a378858f72b4532 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:29.697561 23914 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.722002 24063 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:29.727799 24600 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:29.729142 23914 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:29.729525 24552 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:29.730695 24670 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:29.741097 24444 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.747625 24600 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.752156 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7e53ff7433274cdf9c150f141d03e1f5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:29.751600 23916 raft_consensus.cc:2955] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.755072 24670 raft_consensus.cc:1064] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:29.756819 24670 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:29.758689 23819 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:29.768354 23993 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.770498 24600 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.771178 24655 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.774606 23914 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:29.777891 24670 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.779656 24670 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:29.789458 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 7e53ff7433274cdf9c150f141d03e1f5 with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:29.793808 24655 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.796855 24698 tablet_replica.cc:333] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:29.796998 23990 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.808388 24698 raft_consensus.cc:2243] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.809011 24698 raft_consensus.cc:2272] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.816237 24600 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.818444 23914 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.825379 24698 ts_tablet_manager.cc:1916] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:29.826146 23819 catalog_manager.cc:5697] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.848336 24698 ts_tablet_manager.cc:1929] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:29.848946 24698 log.cc:1199] T 7e53ff7433274cdf9c150f141d03e1f5 P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/7e53ff7433274cdf9c150f141d03e1f5
I20260709 12:16:29.851325 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 7e53ff7433274cdf9c150f141d03e1f5 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:29.852738 24069 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:29.857198 23914 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:29.857591 24600 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:29.858347 24655 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:29.859231 24670 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:29.864616 24670 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.867188 23914 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.873665 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea07088f87a54d2194bc706db4279d24 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:29.875301 24600 raft_consensus.cc:2955] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.884078 23818 catalog_manager.cc:5697] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:29.898038 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet ea07088f87a54d2194bc706db4279d24 with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:29.898955 24698 tablet_replica.cc:333] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:29.899694 24698 raft_consensus.cc:2243] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:29.900272 24698 raft_consensus.cc:2272] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:29.903083 24698 ts_tablet_manager.cc:1916] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:29.929236 24698 ts_tablet_manager.cc:1929] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:29.929613 24698 log.cc:1199] T ea07088f87a54d2194bc706db4279d24 P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/ea07088f87a54d2194bc706db4279d24
I20260709 12:16:29.930888 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet ea07088f87a54d2194bc706db4279d24 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:30.963167 24063 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:30.970124 23993 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:30.970412 23916 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:30.970155 24035 consensus_peers.cc:597] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0caf361b460241abb91679f8f8b6e7e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:30.972093 24444 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.973213 24694 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:30.989645 24670 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:30.991220 23916 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:30.991259 23993 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.009198 23990 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.013669 23817 catalog_manager.cc:5697] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
W20260709 12:16:31.016466 23961 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4db304f4ee46489296e4f0f6b21cac26. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.017184 24063 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:31.017899 23916 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:31.018834 24701 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.019647 24684 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.034297 24683 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.037050 23916 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.039813 24061 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.063230 24061 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.064757 23816 catalog_manager.cc:5697] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:31.091849 24035 consensus_peers.cc:597] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eac75053172041f285deb68d4418ed57. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.094883 23916 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:31.096267 24705 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.099810 23993 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:31.101905 24705 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:31.106798 24670 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.112320 23916 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.123363 23990 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.131315 23816 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:31.138850 23993 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.158865 24061 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:31.160348 24684 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:31.162810 23916 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:31.166953 24684 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:31.167414 23961 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c6dc6b578324215a52f1a0a5f46c3d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:31.174027 24715 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.176646 24061 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.193368 23916 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.205396 23816 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:31.349350 24722 ts_tablet_manager.cc:933] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:31.352181 24722 tablet_copy_client.cc:323] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:31.353648 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 0caf361b460241abb91679f8f8b6e7e4 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:31.354179 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 0caf361b460241abb91679f8f8b6e7e4 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-0caf361b460241abb91679f8f8b6e7e4
I20260709 12:16:31.360610 24080 tablet_copy_source_session.cc:215] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:31.364214 24722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0caf361b460241abb91679f8f8b6e7e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:31.385123 24722 tablet_copy_client.cc:806] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:31.385891 24722 tablet_copy_client.cc:670] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:31.391685 24722 tablet_copy_client.cc:538] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:31.402186 24722 tablet_bootstrap.cc:492] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:31.423785 24722 tablet_bootstrap.cc:492] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:31.424691 24722 tablet_bootstrap.cc:492] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:31.425356 24722 ts_tablet_manager.cc:1403] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.008s
I20260709 12:16:31.428367 24722 raft_consensus.cc:359] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.429203 24722 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:31.429859 24722 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.435814 24722 ts_tablet_manager.cc:1434] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 12:16:31.437819 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-0caf361b460241abb91679f8f8b6e7e4 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:31.438233 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-0caf361b460241abb91679f8f8b6e7e4 on tablet 0caf361b460241abb91679f8f8b6e7e4 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:31.575682 24722 ts_tablet_manager.cc:933] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:31.577435 24722 tablet_copy_client.cc:323] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.2:43801
I20260709 12:16:31.579085 24006 tablet_copy_service.cc:140] P ef0dd15ac654478b8371c22b8909240e: Received BeginTabletCopySession request for tablet 4db304f4ee46489296e4f0f6b21cac26 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:60542)
I20260709 12:16:31.579587 24006 tablet_copy_service.cc:161] P ef0dd15ac654478b8371c22b8909240e: Beginning new tablet copy session on tablet 4db304f4ee46489296e4f0f6b21cac26 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:60542: session id = 71a48f59ff764d249519c6a53ec57f02-4db304f4ee46489296e4f0f6b21cac26
I20260709 12:16:31.582501 24728 ts_tablet_manager.cc:933] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:31.589114 24006 tablet_copy_source_session.cc:215] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:31.591645 24728 tablet_copy_client.cc:323] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:31.592579 24722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db304f4ee46489296e4f0f6b21cac26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:31.593209 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet eac75053172041f285deb68d4418ed57 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:31.593655 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet eac75053172041f285deb68d4418ed57 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-eac75053172041f285deb68d4418ed57
I20260709 12:16:31.601922 24080 tablet_copy_source_session.cc:215] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:31.605165 24728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eac75053172041f285deb68d4418ed57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:31.610419 24722 tablet_copy_client.cc:806] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:31.611057 24722 tablet_copy_client.cc:670] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:31.615185 24722 tablet_copy_client.cc:538] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:31.620811 24728 tablet_copy_client.cc:806] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:31.621418 24728 tablet_copy_client.cc:670] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:31.627485 24728 tablet_copy_client.cc:538] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:31.629185 24722 tablet_bootstrap.cc:492] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:31.638906 24728 tablet_bootstrap.cc:492] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:31.656837 24722 tablet_bootstrap.cc:492] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:31.657758 24722 tablet_bootstrap.cc:492] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:31.658459 24722 ts_tablet_manager.cc:1403] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.030s	user 0.026s	sys 0.005s
I20260709 12:16:31.661439 24722 raft_consensus.cc:359] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.662388 24722 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:31.663064 24722 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.665439 24722 ts_tablet_manager.cc:1434] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:16:31.667325 24006 tablet_copy_service.cc:342] P ef0dd15ac654478b8371c22b8909240e: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-4db304f4ee46489296e4f0f6b21cac26 received from {username='slave'} at 127.0.0.1:60542
I20260709 12:16:31.667775 24006 tablet_copy_service.cc:434] P ef0dd15ac654478b8371c22b8909240e: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-4db304f4ee46489296e4f0f6b21cac26 on tablet 4db304f4ee46489296e4f0f6b21cac26 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:31.675920 24728 tablet_bootstrap.cc:492] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:31.688450 24728 tablet_bootstrap.cc:492] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:31.689172 24728 ts_tablet_manager.cc:1403] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.014s
I20260709 12:16:31.695094 24728 raft_consensus.cc:359] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.698968 24728 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:31.699656 24728 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.702203 24722 ts_tablet_manager.cc:933] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:31.711496 24728 ts_tablet_manager.cc:1434] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:16:31.715097 24722 tablet_copy_client.cc:323] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.2:43801
I20260709 12:16:31.716646 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-eac75053172041f285deb68d4418ed57 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:31.717082 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-eac75053172041f285deb68d4418ed57 on tablet eac75053172041f285deb68d4418ed57 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:31.717904 24006 tablet_copy_service.cc:140] P ef0dd15ac654478b8371c22b8909240e: Received BeginTabletCopySession request for tablet 5c6dc6b578324215a52f1a0a5f46c3d4 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:60542)
I20260709 12:16:31.718406 24006 tablet_copy_service.cc:161] P ef0dd15ac654478b8371c22b8909240e: Beginning new tablet copy session on tablet 5c6dc6b578324215a52f1a0a5f46c3d4 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:60542: session id = 71a48f59ff764d249519c6a53ec57f02-5c6dc6b578324215a52f1a0a5f46c3d4
I20260709 12:16:31.725495 24006 tablet_copy_source_session.cc:215] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:31.729526 24722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c6dc6b578324215a52f1a0a5f46c3d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:31.744336 24722 tablet_copy_client.cc:806] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:31.744825 24722 tablet_copy_client.cc:670] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:31.749254 24722 tablet_copy_client.cc:538] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:31.754443 24722 tablet_bootstrap.cc:492] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:31.769266 24722 tablet_bootstrap.cc:492] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:31.770081 24722 tablet_bootstrap.cc:492] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:31.770668 24722 ts_tablet_manager.cc:1403] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.016s	user 0.015s	sys 0.004s
I20260709 12:16:31.775053 24722 raft_consensus.cc:359] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.775808 24722 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:31.776346 24722 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:31.780184 24722 ts_tablet_manager.cc:1434] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:16:31.782255 24006 tablet_copy_service.cc:342] P ef0dd15ac654478b8371c22b8909240e: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-5c6dc6b578324215a52f1a0a5f46c3d4 received from {username='slave'} at 127.0.0.1:60542
I20260709 12:16:31.782684 24006 tablet_copy_service.cc:434] P ef0dd15ac654478b8371c22b8909240e: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-5c6dc6b578324215a52f1a0a5f46c3d4 on tablet 5c6dc6b578324215a52f1a0a5f46c3d4 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:31.879159 24600 raft_consensus.cc:1217] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:32.066586 24600 raft_consensus.cc:1217] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:32.080657 24600 raft_consensus.cc:1217] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:32.290190 24600 raft_consensus.cc:1217] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:32.396413 24705 raft_consensus.cc:1064] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:32.398195 24705 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:32.404541 23990 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.405496 24600 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.406738 24735 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:32.408985 23921 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.408504 24705 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:32.413318 24670 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:32.427472 24705 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.430330 23990 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.432367 24600 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.454824 23817 catalog_manager.cc:5697] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.467517 23916 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.518604 24069 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:32.524688 24599 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:32.526005 23990 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:32.526571 24743 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:32.527511 24744 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:32.533826 24743 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.535544 24599 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.537982 23990 raft_consensus.cc:2955] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.546912 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0caf361b460241abb91679f8f8b6e7e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:32.555244 23817 catalog_manager.cc:5697] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:32.568573 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet 0caf361b460241abb91679f8f8b6e7e4 with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:32.577613 24749 tablet_replica.cc:333] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:32.584663 24749 raft_consensus.cc:2243] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:32.585314 24749 raft_consensus.cc:2272] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:32.592906 24749 ts_tablet_manager.cc:1916] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:32.608822 24749 ts_tablet_manager.cc:1929] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:32.609175 24749 log.cc:1199] T 0caf361b460241abb91679f8f8b6e7e4 P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/0caf361b460241abb91679f8f8b6e7e4
I20260709 12:16:32.610863 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet 0caf361b460241abb91679f8f8b6e7e4 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:32.687541 24743 raft_consensus.cc:1064] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:32.690126 24743 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:32.696486 24737 raft_consensus.cc:1064] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:32.699003 24737 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:32.710395 24715 raft_consensus.cc:1064] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:32.713028 24715 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:32.718120 24599 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.719740 24600 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.721776 24705 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:32.722472 23992 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.726552 24744 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:32.729718 24736 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:32.738526 23917 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.753527 24705 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:32.773694 24600 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.775303 24736 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:32.782449 24069 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.785184 23916 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.785522 24715 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:32.786677 24736 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:32.810525 24069 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.816010 23914 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:32.806499 24715 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.815866 24736 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:16:32.842018 24753 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:16:32.958827 24600 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.970383 23917 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.974560 23818 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:32.981405 24767 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.000350 23990 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:33.007537 24600 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.012385 24752 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.018077 24063 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.021907 23993 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.028313 24599 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:33.030687 24599 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.040839 24752 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:16:33.041584 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49391.4us
I20260709 12:16:33.043889 23818 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.049402 23917 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:33.051034 23917 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.048166 23816 catalog_manager.cc:5697] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:33.055202 24715 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.063217 24752 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:33.071992 23993 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:33.081203 24600 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.120136 23917 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:33.122570 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c6dc6b578324215a52f1a0a5f46c3d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:33.123504 24752 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:33.123832 23921 raft_consensus.cc:2955] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.136634 24753 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.147878 24598 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:33.148000 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4db304f4ee46489296e4f0f6b21cac26 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:33.154570 24736 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:33.155114 23819 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.159646 24063 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.162593 23921 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.165760 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c6dc6b578324215a52f1a0a5f46c3d4 with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57818
I20260709 12:16:33.167472 24598 raft_consensus.cc:2955] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.178228 23816 catalog_manager.cc:5697] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.183331 24769 tablet_replica.cc:333] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:16:33.185683 24069 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:33.194569 23921 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.207791 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 4db304f4ee46489296e4f0f6b21cac26 with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57818
I20260709 12:16:33.208174 23993 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:33.225083 24769 raft_consensus.cc:2243] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:33.227877 24769 raft_consensus.cc:2272] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:33.231436 24769 ts_tablet_manager.cc:1916] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:33.241740 24768 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:33.247790 24600 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:33.255245 24705 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:33.257653 24743 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.268090 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet eac75053172041f285deb68d4418ed57 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:33.273200 23992 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.280870 24769 ts_tablet_manager.cc:1929] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:33.280310 24600 raft_consensus.cc:2955] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:33.281390 24769 log.cc:1199] T 5c6dc6b578324215a52f1a0a5f46c3d4 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/5c6dc6b578324215a52f1a0a5f46c3d4
I20260709 12:16:33.281114 23817 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:33.283229 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 5c6dc6b578324215a52f1a0a5f46c3d4 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:33.283689 24769 tablet_replica.cc:333] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:16:33.284811 24769 raft_consensus.cc:2243] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:33.285537 24769 raft_consensus.cc:2272] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:33.289206 24769 ts_tablet_manager.cc:1916] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:33.295034 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet eac75053172041f285deb68d4418ed57 with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:33.303777 24771 tablet_replica.cc:333] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:33.310715 24771 raft_consensus.cc:2243] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:33.313474 24771 raft_consensus.cc:2272] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:33.314347 24769 ts_tablet_manager.cc:1929] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:33.314810 24769 log.cc:1199] T 4db304f4ee46489296e4f0f6b21cac26 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/4db304f4ee46489296e4f0f6b21cac26
I20260709 12:16:33.317047 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 4db304f4ee46489296e4f0f6b21cac26 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:33.319752 24771 ts_tablet_manager.cc:1916] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:33.332297 24771 ts_tablet_manager.cc:1929] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:33.332687 24771 log.cc:1199] T eac75053172041f285deb68d4418ed57 P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/eac75053172041f285deb68d4418ed57
I20260709 12:16:33.334043 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet eac75053172041f285deb68d4418ed57 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:34.371789 24066 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:34.379968 24035 consensus_peers.cc:597] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 479416b99927471b8600549d94ad4873. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.380218 23992 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:34.381072 23921 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:34.381572 24772 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.382311 24743 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.391571 24705 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.392526 23921 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.403915 23992 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.405900 24066 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:34.407058 23817 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:34.417097 24035 consensus_peers.cc:597] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da0449b96d0e4a57b82ad92e05c4cea7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.418936 23990 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:34.420743 24743 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.422194 23921 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:34.425101 24772 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:34.436441 24781 raft_consensus.cc:2955] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.440634 23992 raft_consensus.cc:2955] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.454589 23916 raft_consensus.cc:2955] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.461323 23817 catalog_manager.cc:5697] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.484820 23921 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:34.494004 24066 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:34.494690 23992 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:34.498229 24765 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:34.500250 24765 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.509655 24764 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.510783 23992 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
W20260709 12:16:34.533013 23886 consensus_peers.cc:597] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f58a6c8f74504786b09cf0261ea665c7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.538815 23816 catalog_manager.cc:5697] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.552207 23921 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:34.571911 23886 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9a0df8b4c2674e279e8740ab00a67267. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:34.578510 24066 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:34.581408 24066 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.582528 24764 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:34.582901 23992 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:34.584971 24764 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:34.597595 24793 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.600088 24066 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.602512 23992 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.619567 23818 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:34.949178 24798 ts_tablet_manager.cc:933] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:34.959233 24798 tablet_copy_client.cc:323] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:34.959633 24797 ts_tablet_manager.cc:933] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:34.960860 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet da0449b96d0e4a57b82ad92e05c4cea7 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:34.961576 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet da0449b96d0e4a57b82ad92e05c4cea7 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-da0449b96d0e4a57b82ad92e05c4cea7
I20260709 12:16:34.962975 24797 tablet_copy_client.cc:323] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:34.964704 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 479416b99927471b8600549d94ad4873 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:34.965255 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 479416b99927471b8600549d94ad4873 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-479416b99927471b8600549d94ad4873
I20260709 12:16:34.973371 24079 tablet_copy_source_session.cc:215] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:34.974972 24080 tablet_copy_source_session.cc:215] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:34.977412 24797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 479416b99927471b8600549d94ad4873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:34.980129 24798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da0449b96d0e4a57b82ad92e05c4cea7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:34.999538 24797 tablet_copy_client.cc:806] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:35.000101 24797 tablet_copy_client.cc:670] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:35.001592 24798 tablet_copy_client.cc:806] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:35.002197 24798 tablet_copy_client.cc:670] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:35.003872 24797 tablet_copy_client.cc:538] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:35.005563 24798 tablet_copy_client.cc:538] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:35.012238 24797 tablet_bootstrap.cc:492] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:35.016177 24798 tablet_bootstrap.cc:492] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:35.041347 24797 tablet_bootstrap.cc:492] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.042361 24797 tablet_bootstrap.cc:492] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:35.043079 24797 ts_tablet_manager.cc:1403] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.010s
I20260709 12:16:35.045420 24798 tablet_bootstrap.cc:492] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.046490 24798 tablet_bootstrap.cc:492] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:35.046222 24797 raft_consensus.cc:359] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:35.047125 24797 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:35.047247 24798 ts_tablet_manager.cc:1403] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.031s	user 0.025s	sys 0.005s
I20260709 12:16:35.047961 24797 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:35.051115 24798 raft_consensus.cc:359] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:35.053540 24798 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:35.054651 24798 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:35.058907 24797 ts_tablet_manager.cc:1434] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 12:16:35.064154 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-479416b99927471b8600549d94ad4873 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:35.064590 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-479416b99927471b8600549d94ad4873 on tablet 479416b99927471b8600549d94ad4873 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:35.067664 24798 ts_tablet_manager.cc:1434] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:16:35.069516 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-da0449b96d0e4a57b82ad92e05c4cea7 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:35.069922 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-da0449b96d0e4a57b82ad92e05c4cea7 on tablet da0449b96d0e4a57b82ad92e05c4cea7 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:35.073767 24797 ts_tablet_manager.cc:933] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:35.073882 24798 ts_tablet_manager.cc:933] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:35.075630 24797 tablet_copy_client.cc:323] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:35.083447 24798 tablet_copy_client.cc:323] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:35.092370 23931 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 9a0df8b4c2674e279e8740ab00a67267 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:35.092657 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet f58a6c8f74504786b09cf0261ea665c7 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:35.093006 23931 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 9a0df8b4c2674e279e8740ab00a67267 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-9a0df8b4c2674e279e8740ab00a67267
I20260709 12:16:35.093593 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet f58a6c8f74504786b09cf0261ea665c7 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-f58a6c8f74504786b09cf0261ea665c7
I20260709 12:16:35.103341 23931 tablet_copy_source_session.cc:215] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:35.106536 23930 tablet_copy_source_session.cc:215] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:35.107409 24797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a0df8b4c2674e279e8740ab00a67267. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:35.109489 24798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f58a6c8f74504786b09cf0261ea665c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:35.126628 24798 tablet_copy_client.cc:806] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:35.127177 24798 tablet_copy_client.cc:670] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:35.133697 24798 tablet_copy_client.cc:538] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:35.136845 24797 tablet_copy_client.cc:806] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:35.137614 24797 tablet_copy_client.cc:670] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:35.142328 24797 tablet_copy_client.cc:538] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:35.144665 24798 tablet_bootstrap.cc:492] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:35.169804 24797 tablet_bootstrap.cc:492] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:35.178375 24798 tablet_bootstrap.cc:492] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.179289 24798 tablet_bootstrap.cc:492] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:35.179906 24798 ts_tablet_manager.cc:1403] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.009s
I20260709 12:16:35.182703 24798 raft_consensus.cc:359] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:35.183517 24798 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:35.184149 24798 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:35.194445 24798 ts_tablet_manager.cc:1434] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 12:16:35.202617 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-f58a6c8f74504786b09cf0261ea665c7 received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:35.203039 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-f58a6c8f74504786b09cf0261ea665c7 on tablet f58a6c8f74504786b09cf0261ea665c7 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:35.214023 24797 tablet_bootstrap.cc:492] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:35.215008 24797 tablet_bootstrap.cc:492] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:35.215711 24797 ts_tablet_manager.cc:1403] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.046s	user 0.019s	sys 0.004s
I20260709 12:16:35.218966 24797 raft_consensus.cc:359] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:35.219898 24797 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:35.246017 24797 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:35.252549 24797 ts_tablet_manager.cc:1434] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.005s
I20260709 12:16:35.258421 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-9a0df8b4c2674e279e8740ab00a67267 received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:35.259240 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-9a0df8b4c2674e279e8740ab00a67267 on tablet 9a0df8b4c2674e279e8740ab00a67267 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:35.480929 24598 raft_consensus.cc:1217] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:35.508267 24598 raft_consensus.cc:1217] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:35.525466 24598 raft_consensus.cc:1217] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:35.617266 24598 raft_consensus.cc:1217] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:35.857221 24813 raft_consensus.cc:1064] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:35.860668 24813 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:35.867645 24598 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:35.867915 23992 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:35.869333 23921 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:35.870471 24772 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:35.873121 24814 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:35.874028 24705 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:35.884452 24772 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:35.892184 23921 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:35.903620 23992 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:35.908346 23817 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:35.911026 24598 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:35.953099 24063 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:35.958530 24793 raft_consensus.cc:1064] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:35.961148 23914 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:35.962493 24772 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:35.964592 24598 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:35.966091 24814 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:35.972867 24793 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:35.972954 24813 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:35.979854 23921 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:35.986465 24598 raft_consensus.cc:2955] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.011963 23817 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.020548 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 479416b99927471b8600549d94ad4873 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:36.025671 24598 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:36.027588 24825 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:36.040880 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 479416b99927471b8600549d94ad4873 with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:36.041886 24066 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:36.044257 23992 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:36.047174 24815 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:36.050186 24815 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:36.054397 24828 tablet_replica.cc:333] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:36.057394 24828 raft_consensus.cc:2243] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:36.059422 24828 raft_consensus.cc:2272] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:36.064837 24828 ts_tablet_manager.cc:1916] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:36.077541 24815 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.084233 24063 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.085774 24828 ts_tablet_manager.cc:1929] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:36.086380 24828 log.cc:1199] T 479416b99927471b8600549d94ad4873 P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/479416b99927471b8600549d94ad4873
I20260709 12:16:36.085850 23992 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.088308 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 479416b99927471b8600549d94ad4873 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:36.097235 24598 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.101488 23817 catalog_manager.cc:5697] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.118803 24772 raft_consensus.cc:1064] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:36.121228 24772 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:36.126974 23921 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:36.143787 24598 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:36.145361 24825 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:36.157531 24815 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.159878 24598 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.174121 24066 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:36.185343 23817 catalog_manager.cc:5697] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.187382 23990 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:36.192992 23916 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:36.194723 24809 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:36.208307 24772 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:36.196980 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f58a6c8f74504786b09cf0261ea665c7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:36.201589 24598 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:36.221067 24772 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:36.235491 24600 raft_consensus.cc:2955] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.238034 24814 raft_consensus.cc:2955] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.256194 24809 raft_consensus.cc:1064] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:36.260363 24809 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:36.264029 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet f58a6c8f74504786b09cf0261ea665c7 with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:36.265061 24828 tablet_replica.cc:333] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:36.271232 23819 catalog_manager.cc:5697] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.279212 23990 raft_consensus.cc:2955] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.297161 24598 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:36.298062 24069 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:36.298727 24792 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:36.304168 24599 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:36.308009 24705 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:16:36.312990 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 102913us
I20260709 12:16:36.318204 24814 raft_consensus.cc:2955] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.325049 23990 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:36.326894 24705 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:36.331010 23992 raft_consensus.cc:2955] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.336746 24066 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:36.342307 24069 raft_consensus.cc:2955] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.344311 23993 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:36.344686 24828 raft_consensus.cc:2243] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:36.346792 24828 raft_consensus.cc:2272] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:36.350328 24828 ts_tablet_manager.cc:1916] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:36.359898 24598 raft_consensus.cc:2955] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.366755 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet da0449b96d0e4a57b82ad92e05c4cea7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:36.371225 24809 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:36.373644 24832 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:36.393528 23818 catalog_manager.cc:5697] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.408463 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet da0449b96d0e4a57b82ad92e05c4cea7 with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:36.416708 24828 ts_tablet_manager.cc:1929] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:36.417093 24842 tablet_replica.cc:333] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:36.417181 24828 log.cc:1199] T f58a6c8f74504786b09cf0261ea665c7 P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/f58a6c8f74504786b09cf0261ea665c7
I20260709 12:16:36.417646 24826 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.418905 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet f58a6c8f74504786b09cf0261ea665c7 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:36.419176 23992 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:36.420440 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 52686.4us
I20260709 12:16:36.424006 24842 raft_consensus.cc:2243] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:36.427296 24842 raft_consensus.cc:2272] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:36.433250 24069 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.441658 24842 ts_tablet_manager.cc:1916] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:36.441205 24598 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.448851 23819 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:36.461293 24842 ts_tablet_manager.cc:1929] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:16:36.461796 24842 log.cc:1199] T da0449b96d0e4a57b82ad92e05c4cea7 P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/da0449b96d0e4a57b82ad92e05c4cea7
I20260709 12:16:36.463588 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet da0449b96d0e4a57b82ad92e05c4cea7 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:36.471274 23917 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:36.478165 24598 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:36.478549 23992 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:36.480902 24792 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:36.488081 24825 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.489984 24826 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:36.495010 24598 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.504830 23993 raft_consensus.cc:2955] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.523196 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9a0df8b4c2674e279e8740ab00a67267 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:36.530804 23819 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:36.542855 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 9a0df8b4c2674e279e8740ab00a67267 with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57818
I20260709 12:16:36.545696 24844 tablet_replica.cc:333] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:16:36.546887 24844 raft_consensus.cc:2243] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:36.549499 24844 raft_consensus.cc:2272] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:36.552973 24844 ts_tablet_manager.cc:1916] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:36.564749 24844 ts_tablet_manager.cc:1929] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:36.565009 24844 log.cc:1199] T 9a0df8b4c2674e279e8740ab00a67267 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/9a0df8b4c2674e279e8740ab00a67267
I20260709 12:16:36.566490 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 9a0df8b4c2674e279e8740ab00a67267 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:37.618649 23916 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:37.624810 24063 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:37.625506 23886 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5db9cea3b8f64883a51327db383cd13e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:37.625970 23993 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:37.626188 24825 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.628407 24825 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.634248 24848 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.635980 24063 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.637977 23993 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.665633 23990 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:37.672649 23818 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:37.688180 23916 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:37.688265 24063 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:37.689522 24846 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.691689 24846 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:16:37.699111 23961 consensus_peers.cc:597] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33e9bcdb00ec45229c3b370172970a07. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:37.710925 24845 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.736070 23921 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:37.745273 23916 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.746755 24069 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.745887 23819 catalog_manager.cc:5697] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:37.755554 23886 consensus_peers.cc:597] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ccb15a6c98843f3836da9918c1195dc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:37.763264 23993 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:37.764796 24848 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.768213 24069 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:37.774387 24826 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.788215 24848 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.790805 23990 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.790699 24069 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.803355 24069 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:37.809109 23817 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.814383 23921 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:37.815104 23990 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:37.815361 24035 consensus_peers.cc:597] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 675e57b981c1430ba502ba18c21dd0a4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:37.816042 24814 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.818506 24813 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:37.825248 24814 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.826926 23921 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.847699 23990 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:37.852953 23819 catalog_manager.cc:5697] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:38.088562 24870 ts_tablet_manager.cc:933] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:38.092299 24870 tablet_copy_client.cc:323] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:38.095896 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 5db9cea3b8f64883a51327db383cd13e from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:38.096431 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 5db9cea3b8f64883a51327db383cd13e from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-5db9cea3b8f64883a51327db383cd13e
I20260709 12:16:38.104836 23930 tablet_copy_source_session.cc:215] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:38.108023 24870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db9cea3b8f64883a51327db383cd13e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:38.128515 24870 tablet_copy_client.cc:806] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:38.129238 24870 tablet_copy_client.cc:670] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:38.133142 24870 tablet_copy_client.cc:538] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:38.142853 24870 tablet_bootstrap.cc:492] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:38.165733 24870 tablet_bootstrap.cc:492] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.166852 24870 tablet_bootstrap.cc:492] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:38.167649 24870 ts_tablet_manager.cc:1403] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.005s
I20260709 12:16:38.171066 24870 raft_consensus.cc:359] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:38.172029 24870 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:38.172857 24870 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:38.178313 24870 ts_tablet_manager.cc:1434] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.005s
I20260709 12:16:38.180514 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-5db9cea3b8f64883a51327db383cd13e received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:38.180949 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-5db9cea3b8f64883a51327db383cd13e on tablet 5db9cea3b8f64883a51327db383cd13e with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:38.194623 24870 ts_tablet_manager.cc:933] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:38.202417 24870 tablet_copy_client.cc:323] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:38.204627 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 5ccb15a6c98843f3836da9918c1195dc from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:38.205192 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 5ccb15a6c98843f3836da9918c1195dc from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-5ccb15a6c98843f3836da9918c1195dc
I20260709 12:16:38.213416 23930 tablet_copy_source_session.cc:215] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:38.216547 24870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ccb15a6c98843f3836da9918c1195dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:38.233036 24870 tablet_copy_client.cc:806] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:38.233664 24870 tablet_copy_client.cc:670] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:38.236747 24870 tablet_copy_client.cc:538] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:38.246008 24870 tablet_bootstrap.cc:492] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:38.265975 24870 tablet_bootstrap.cc:492] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.266853 24870 tablet_bootstrap.cc:492] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:38.267479 24870 ts_tablet_manager.cc:1403] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.003s
I20260709 12:16:38.270910 24870 raft_consensus.cc:359] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:38.271904 24870 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:38.272944 24870 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:38.275184 24870 ts_tablet_manager.cc:1434] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:16:38.276710 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-5ccb15a6c98843f3836da9918c1195dc received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:38.277098 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-5ccb15a6c98843f3836da9918c1195dc on tablet 5ccb15a6c98843f3836da9918c1195dc with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:38.283358 24870 ts_tablet_manager.cc:933] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:38.284974 24870 tablet_copy_client.cc:323] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.2:43801
I20260709 12:16:38.287000 24006 tablet_copy_service.cc:140] P ef0dd15ac654478b8371c22b8909240e: Received BeginTabletCopySession request for tablet 33e9bcdb00ec45229c3b370172970a07 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:60542)
I20260709 12:16:38.287424 24006 tablet_copy_service.cc:161] P ef0dd15ac654478b8371c22b8909240e: Beginning new tablet copy session on tablet 33e9bcdb00ec45229c3b370172970a07 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:60542: session id = 71a48f59ff764d249519c6a53ec57f02-33e9bcdb00ec45229c3b370172970a07
I20260709 12:16:38.292658 24006 tablet_copy_source_session.cc:215] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:38.295575 24870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33e9bcdb00ec45229c3b370172970a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:38.310322 24870 tablet_copy_client.cc:806] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:38.310813 24870 tablet_copy_client.cc:670] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:38.314672 24870 tablet_copy_client.cc:538] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:38.321426 24870 tablet_bootstrap.cc:492] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:38.337229 24870 tablet_bootstrap.cc:492] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.337894 24870 tablet_bootstrap.cc:492] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:38.338457 24870 ts_tablet_manager.cc:1403] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.008s
I20260709 12:16:38.340971 24870 raft_consensus.cc:359] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:38.341719 24870 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:38.342324 24870 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:38.344312 24870 ts_tablet_manager.cc:1434] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:38.346647 24006 tablet_copy_service.cc:342] P ef0dd15ac654478b8371c22b8909240e: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-33e9bcdb00ec45229c3b370172970a07 received from {username='slave'} at 127.0.0.1:60542
I20260709 12:16:38.347059 24006 tablet_copy_service.cc:434] P ef0dd15ac654478b8371c22b8909240e: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-33e9bcdb00ec45229c3b370172970a07 on tablet 33e9bcdb00ec45229c3b370172970a07 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:38.426192 24870 ts_tablet_manager.cc:933] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:38.427719 24870 tablet_copy_client.cc:323] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:38.429646 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 675e57b981c1430ba502ba18c21dd0a4 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:38.430173 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 675e57b981c1430ba502ba18c21dd0a4 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-675e57b981c1430ba502ba18c21dd0a4
I20260709 12:16:38.435865 24080 tablet_copy_source_session.cc:215] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:38.438692 24870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 675e57b981c1430ba502ba18c21dd0a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:38.452060 24870 tablet_copy_client.cc:806] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:38.452617 24870 tablet_copy_client.cc:670] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:38.458393 24870 tablet_copy_client.cc:538] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:38.465831 24870 tablet_bootstrap.cc:492] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:38.493584 24870 tablet_bootstrap.cc:492] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:38.494524 24870 tablet_bootstrap.cc:492] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:38.495239 24870 ts_tablet_manager.cc:1403] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.030s	user 0.023s	sys 0.008s
I20260709 12:16:38.497944 24870 raft_consensus.cc:359] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:38.498850 24870 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:38.499469 24870 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:38.501679 24870 ts_tablet_manager.cc:1434] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:16:38.511696 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-675e57b981c1430ba502ba18c21dd0a4 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:38.512185 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-675e57b981c1430ba502ba18c21dd0a4 on tablet 675e57b981c1430ba502ba18c21dd0a4 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:38.577423 24598 raft_consensus.cc:1217] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:38.735666 24598 raft_consensus.cc:1217] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:38.753451 24598 raft_consensus.cc:1217] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:38.939994 24598 raft_consensus.cc:1217] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:39.154222 24881 raft_consensus.cc:1064] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:39.156635 24881 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:39.162889 24599 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.163849 24853 raft_consensus.cc:1064] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:39.166728 24063 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.167865 24848 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.166064 24853 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:39.169327 24826 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.173995 23990 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.178831 24848 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:39.193951 24598 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.196519 23921 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.195663 24826 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.197371 24599 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.199235 24882 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.199683 24063 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.201001 24882 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.204622 24860 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.229436 23819 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.235913 24889 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.253692 24599 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.240392 23990 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.244184 24063 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.246259 24069 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.271384 23921 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.314338 23916 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:39.317777 23818 catalog_manager.cc:5697] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:39.328819 24598 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:39.330221 24826 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.334192 23992 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:39.341888 24848 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.349769 24891 raft_consensus.cc:1064] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:39.345449 24826 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.352309 24891 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:39.355005 24599 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.362820 23993 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:39.363184 23992 raft_consensus.cc:2955] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.368716 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5db9cea3b8f64883a51327db383cd13e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:39.370731 24063 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:39.372182 24860 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.374356 23818 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:39.379770 24889 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.383255 24069 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.384985 24881 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.390692 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33e9bcdb00ec45229c3b370172970a07 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:39.392308 24069 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.393180 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 5db9cea3b8f64883a51327db383cd13e with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57818
I20260709 12:16:39.398908 24598 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:39.401566 24882 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.403393 23993 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.403956 24900 tablet_replica.cc:333] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:16:39.404475 24599 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.405062 24900 raft_consensus.cc:2243] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.405881 24891 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.407488 24881 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.411181 24900 raft_consensus.cc:2272] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.414340 24599 raft_consensus.cc:2955] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.419206 24900 ts_tablet_manager.cc:1916] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:39.426241 23818 catalog_manager.cc:5697] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.439003 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet 33e9bcdb00ec45229c3b370172970a07 with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:39.458789 24903 tablet_replica.cc:333] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:39.458024 24826 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.461206 24903 raft_consensus.cc:2243] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.461915 24903 raft_consensus.cc:2272] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.464704 24598 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.466137 24903 ts_tablet_manager.cc:1916] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:39.480558 24837 raft_consensus.cc:1064] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:39.481853 24903 ts_tablet_manager.cc:1929] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:39.482304 24903 log.cc:1199] T 33e9bcdb00ec45229c3b370172970a07 P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/33e9bcdb00ec45229c3b370172970a07
I20260709 12:16:39.482638 24069 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.483278 24837 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:39.486444 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet 33e9bcdb00ec45229c3b370172970a07 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:39.487669 23818 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:39.502969 23992 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.509035 23921 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:39.533653 24598 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:39.535012 24848 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.541877 24826 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.543257 24900 ts_tablet_manager.cc:1929] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:39.546778 24599 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.548451 24900 log.cc:1199] T 5db9cea3b8f64883a51327db383cd13e P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/5db9cea3b8f64883a51327db383cd13e
I20260709 12:16:39.550149 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 5db9cea3b8f64883a51327db383cd13e (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:39.550340 24069 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:39.553004 24598 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.554646 24837 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.556332 23990 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.567623 24883 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.567849 23817 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.569470 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ccb15a6c98843f3836da9918c1195dc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:39.571450 24904 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.571985 23916 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:39.577338 24883 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:39.582787 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ccb15a6c98843f3836da9918c1195dc with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:39.585458 24907 tablet_replica.cc:333] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:39.586534 24907 raft_consensus.cc:2243] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.589833 24907 raft_consensus.cc:2272] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.593248 24907 ts_tablet_manager.cc:1916] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:39.588472 24069 raft_consensus.cc:2955] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.625988 24869 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.632151 23992 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.640954 24600 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.646898 24907 ts_tablet_manager.cc:1929] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:39.639282 23921 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.647354 24907 log.cc:1199] T 5ccb15a6c98843f3836da9918c1195dc P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/5ccb15a6c98843f3836da9918c1195dc
I20260709 12:16:39.649173 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 5ccb15a6c98843f3836da9918c1195dc (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:39.652271 23818 catalog_manager.cc:5697] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:39.679085 24069 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:39.684293 24600 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:39.684422 23917 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:39.685806 24814 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.686612 24869 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.695041 24837 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.704695 24600 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.707010 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 675e57b981c1430ba502ba18c21dd0a4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:39.708911 23917 raft_consensus.cc:2955] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:39.723356 23818 catalog_manager.cc:5697] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:39.735270 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 675e57b981c1430ba502ba18c21dd0a4 with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:39.736184 24907 tablet_replica.cc:333] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:39.737159 24907 raft_consensus.cc:2243] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:39.737787 24907 raft_consensus.cc:2272] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:39.741943 24907 ts_tablet_manager.cc:1916] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:39.756842 24907 ts_tablet_manager.cc:1929] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:39.757159 24907 log.cc:1199] T 675e57b981c1430ba502ba18c21dd0a4 P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/675e57b981c1430ba502ba18c21dd0a4
I20260709 12:16:39.758456 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 675e57b981c1430ba502ba18c21dd0a4 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:40.809747 23992 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:40.817315 23961 consensus_peers.cc:597] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac7e870c1a4544099414fa4aae03e1c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:40.820791 24069 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:40.821174 23917 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:40.822515 24912 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:40.823428 24889 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:40.831262 24860 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:40.833051 23917 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:40.835300 24063 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:40.846783 23921 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:40.850242 23816 catalog_manager.cc:5697] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:40.871361 23886 consensus_peers.cc:597] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e22d6a51d8e04f7bbcad59376624aa20. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:40.876921 24063 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:40.878438 23992 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:40.881938 24904 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:40.884646 24881 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:40.926604 24918 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:40.929507 24063 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:40.931257 23990 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:40.944106 24069 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:40.947808 23819 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:40.955135 24035 consensus_peers.cc:597] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9f761e3dc48440849d367f5e28b48adb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:40.957087 23990 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:40.957418 23917 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:40.958622 24910 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:40.959539 24924 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:40.969925 24910 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:40.973095 23917 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:40.984498 23992 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:40.997697 23819 catalog_manager.cc:5697] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:41.006910 24069 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:41.014930 24035 consensus_peers.cc:597] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b36a4b120beb473694980945af8d8909. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:41.016674 23921 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:41.017458 23990 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:41.017853 24910 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.018711 24869 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:41.032788 24910 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:41.034184 23921 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:41.035276 23993 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:41.049314 23818 catalog_manager.cc:5697] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:41.340644 24931 ts_tablet_manager.cc:933] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:41.342583 24931 tablet_copy_client.cc:323] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:41.343986 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 9f761e3dc48440849d367f5e28b48adb from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:41.344511 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 9f761e3dc48440849d367f5e28b48adb from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-9f761e3dc48440849d367f5e28b48adb
I20260709 12:16:41.350333 24080 tablet_copy_source_session.cc:215] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:41.352931 24931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f761e3dc48440849d367f5e28b48adb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.363473 24931 tablet_copy_client.cc:806] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:41.364019 24931 tablet_copy_client.cc:670] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:41.367498 24931 tablet_copy_client.cc:538] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:41.377997 24931 tablet_bootstrap.cc:492] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:41.437315 24935 ts_tablet_manager.cc:933] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:41.444516 24935 tablet_copy_client.cc:323] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:41.447633 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet e22d6a51d8e04f7bbcad59376624aa20 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:41.448189 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet e22d6a51d8e04f7bbcad59376624aa20 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-e22d6a51d8e04f7bbcad59376624aa20
I20260709 12:16:41.452219 24937 ts_tablet_manager.cc:933] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:41.457123 23930 tablet_copy_source_session.cc:215] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:41.462174 24935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e22d6a51d8e04f7bbcad59376624aa20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.463333 24937 tablet_copy_client.cc:323] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.2:43801
I20260709 12:16:41.465938 24006 tablet_copy_service.cc:140] P ef0dd15ac654478b8371c22b8909240e: Received BeginTabletCopySession request for tablet ac7e870c1a4544099414fa4aae03e1c2 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:60542)
I20260709 12:16:41.466562 24006 tablet_copy_service.cc:161] P ef0dd15ac654478b8371c22b8909240e: Beginning new tablet copy session on tablet ac7e870c1a4544099414fa4aae03e1c2 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:60542: session id = 71a48f59ff764d249519c6a53ec57f02-ac7e870c1a4544099414fa4aae03e1c2
I20260709 12:16:41.610339 24006 tablet_copy_source_session.cc:215] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:16:41.613724 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 133825us
I20260709 12:16:41.618371 24937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac7e870c1a4544099414fa4aae03e1c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.643913 24931 tablet_bootstrap.cc:492] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:41.645033 24931 tablet_bootstrap.cc:492] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:41.645750 24931 ts_tablet_manager.cc:1403] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.268s	user 0.072s	sys 0.111s
I20260709 12:16:41.649986 24931 raft_consensus.cc:359] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:41.650918 24931 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:41.651612 24931 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:41.663731 24931 ts_tablet_manager.cc:1434] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.010s
I20260709 12:16:41.699998 24947 ts_tablet_manager.cc:933] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:41.706300 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-9f761e3dc48440849d367f5e28b48adb received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:41.706794 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-9f761e3dc48440849d367f5e28b48adb on tablet 9f761e3dc48440849d367f5e28b48adb with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:41.710469 24935 tablet_copy_client.cc:806] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:41.711053 24935 tablet_copy_client.cc:670] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:41.723528 24937 tablet_copy_client.cc:806] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:41.724941 24937 tablet_copy_client.cc:670] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:41.733494 24937 tablet_copy_client.cc:538] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:41.742748 24937 tablet_bootstrap.cc:492] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:41.743573 24935 tablet_copy_client.cc:538] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:41.754160 24935 tablet_bootstrap.cc:492] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:41.742581 24947 tablet_copy_client.cc:323] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:41.756979 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet b36a4b120beb473694980945af8d8909 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:41.757531 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet b36a4b120beb473694980945af8d8909 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-b36a4b120beb473694980945af8d8909
I20260709 12:16:41.765554 24080 tablet_copy_source_session.cc:215] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:41.769075 24947 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b36a4b120beb473694980945af8d8909. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:41.785418 24937 tablet_bootstrap.cc:492] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:41.786378 24937 tablet_bootstrap.cc:492] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:41.787014 24937 ts_tablet_manager.cc:1403] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.044s	user 0.028s	sys 0.010s
I20260709 12:16:41.788559 24947 tablet_copy_client.cc:806] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:41.789397 24947 tablet_copy_client.cc:670] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:41.789917 24937 raft_consensus.cc:359] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:41.790792 24937 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:41.791424 24937 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:41.793313 24947 tablet_copy_client.cc:538] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:41.799888 24937 ts_tablet_manager.cc:1434] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.003s
I20260709 12:16:41.801903 24006 tablet_copy_service.cc:342] P ef0dd15ac654478b8371c22b8909240e: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-ac7e870c1a4544099414fa4aae03e1c2 received from {username='slave'} at 127.0.0.1:60542
I20260709 12:16:41.802358 24006 tablet_copy_service.cc:434] P ef0dd15ac654478b8371c22b8909240e: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-ac7e870c1a4544099414fa4aae03e1c2 on tablet ac7e870c1a4544099414fa4aae03e1c2 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:41.803941 24947 tablet_bootstrap.cc:492] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:41.805533 24935 tablet_bootstrap.cc:492] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:41.806622 24935 tablet_bootstrap.cc:492] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:41.807268 24935 ts_tablet_manager.cc:1403] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.018s
I20260709 12:16:41.811870 24935 raft_consensus.cc:359] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:41.812654 24935 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:41.813259 24935 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:41.825659 24935 ts_tablet_manager.cc:1434] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 12:16:41.827291 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-e22d6a51d8e04f7bbcad59376624aa20 received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:41.827888 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-e22d6a51d8e04f7bbcad59376624aa20 on tablet e22d6a51d8e04f7bbcad59376624aa20 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:41.856410 24947 tablet_bootstrap.cc:492] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:41.857331 24947 tablet_bootstrap.cc:492] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:41.858011 24947 ts_tablet_manager.cc:1403] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.027s
I20260709 12:16:41.860962 24947 raft_consensus.cc:359] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:41.861825 24947 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:41.862465 24947 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:41.864925 24947 ts_tablet_manager.cc:1434] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:16:41.866473 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-b36a4b120beb473694980945af8d8909 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:41.866804 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-b36a4b120beb473694980945af8d8909 on tablet b36a4b120beb473694980945af8d8909 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:41.896289 24598 raft_consensus.cc:1217] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:41.920619 24598 raft_consensus.cc:1217] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:41.939014 24598 raft_consensus.cc:1217] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:42.189551 24598 raft_consensus.cc:1217] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:42.375389 24910 raft_consensus.cc:1064] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:42.378216 24910 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:42.385456 24598 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.387384 24939 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.391764 23993 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.392776 23914 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.393786 24910 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.394640 24939 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.404866 24939 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.406849 24598 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.415951 23914 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.416540 23988 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.427644 24912 raft_consensus.cc:1064] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:42.430111 24912 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:42.432721 23819 catalog_manager.cc:5697] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.464622 24599 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.465245 24069 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.466327 23914 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.466565 24860 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.468335 24860 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.468881 24904 raft_consensus.cc:1064] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:42.471279 24904 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:42.475503 24912 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:16:42.521164 23993 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.522011 24061 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.523145 24598 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.523094 24960 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:42.525844 24941 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.531352 24933 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.538249 24061 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.539317 24904 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:42.546126 23914 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.566468 24599 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.576874 24598 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.575479 24941 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.579948 24061 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.595436 23990 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.621296 23816 catalog_manager.cc:5697] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.624702 24942 raft_consensus.cc:1064] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:42.626986 24061 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:42.630379 24942 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:42.635962 24598 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:42.637552 24963 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.641541 23914 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:42.642431 23816 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.645295 24943 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.646705 24598 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.650233 24599 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.654855 23914 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.661046 24910 raft_consensus.cc:2955] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.668787 24963 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.677239 23993 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:42.681782 23990 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.682497 23921 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:42.684505 24943 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.685359 24939 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:42.687191 24598 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:42.688696 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9f761e3dc48440849d367f5e28b48adb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:42.689344 24912 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.699127 24061 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:42.701723 24912 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.710457 23916 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:42.714836 24598 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:42.716557 24971 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.724257 24860 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.732082 24941 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.735023 24061 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.736169 24598 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.738692 24600 raft_consensus.cc:2955] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.780139 23993 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:42.813603 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e22d6a51d8e04f7bbcad59376624aa20 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:42.769007 23917 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.760493 24939 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.823885 23816 catalog_manager.cc:5697] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.844276 23988 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.846644 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac7e870c1a4544099414fa4aae03e1c2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:42.861009 23817 catalog_manager.cc:5697] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.874372 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 9f761e3dc48440849d367f5e28b48adb with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:42.882247 24971 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:42.888484 23816 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:42.898139 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 146601us
I20260709 12:16:42.904150 24980 tablet_replica.cc:333] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:42.905285 24980 raft_consensus.cc:2243] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:42.908113 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet ac7e870c1a4544099414fa4aae03e1c2 with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:42.912830 24598 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.922564 24980 raft_consensus.cc:2272] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:42.929162 24980 ts_tablet_manager.cc:1916] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:42.946974 24982 tablet_replica.cc:333] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:42.948140 24982 raft_consensus.cc:2243] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:42.943955 23817 catalog_manager.cc:5697] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.966401 23988 raft_consensus.cc:2955] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:42.970446 24982 raft_consensus.cc:2272] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:42.977416 24980 ts_tablet_manager.cc:1929] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:42.977921 24980 log.cc:1199] T 9f761e3dc48440849d367f5e28b48adb P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/9f761e3dc48440849d367f5e28b48adb
I20260709 12:16:42.979605 24982 ts_tablet_manager.cc:1916] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:42.979457 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 9f761e3dc48440849d367f5e28b48adb (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:42.984078 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet e22d6a51d8e04f7bbcad59376624aa20 with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57818
I20260709 12:16:42.986075 24066 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:42.993652 24600 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:42.994628 23990 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:42.995137 24974 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:42.998742 24942 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:43.004721 24910 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:43.007938 24598 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:43.015792 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b36a4b120beb473694980945af8d8909 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:43.017565 23993 raft_consensus.cc:2955] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:43.024209 24984 tablet_replica.cc:333] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:16:43.025030 24984 raft_consensus.cc:2243] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:43.025597 24984 raft_consensus.cc:2272] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:43.033639 23819 catalog_manager.cc:5697] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:43.030951 24982 ts_tablet_manager.cc:1929] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:43.041334 24982 log.cc:1199] T ac7e870c1a4544099414fa4aae03e1c2 P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/ac7e870c1a4544099414fa4aae03e1c2
I20260709 12:16:43.041960 24984 ts_tablet_manager.cc:1916] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:43.044350 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet ac7e870c1a4544099414fa4aae03e1c2 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:43.055433 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet b36a4b120beb473694980945af8d8909 with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:43.056349 24982 tablet_replica.cc:333] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:43.057371 24982 raft_consensus.cc:2243] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:43.058153 24982 raft_consensus.cc:2272] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:43.060621 24984 ts_tablet_manager.cc:1929] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:43.063071 24984 log.cc:1199] T e22d6a51d8e04f7bbcad59376624aa20 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/e22d6a51d8e04f7bbcad59376624aa20
I20260709 12:16:43.061477 24982 ts_tablet_manager.cc:1916] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:43.067560 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet e22d6a51d8e04f7bbcad59376624aa20 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:43.079808 24982 ts_tablet_manager.cc:1929] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:43.080318 24982 log.cc:1199] T b36a4b120beb473694980945af8d8909 P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/b36a4b120beb473694980945af8d8909
I20260709 12:16:43.081640 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet b36a4b120beb473694980945af8d8909 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:44.125211 23914 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:44.131806 23886 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 392f06df3ae54cb5a9746fdbb980ad3d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:44.133270 23993 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:44.133597 24066 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:44.134473 24904 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:44.135210 24987 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:44.142261 24960 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.143611 23993 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.143836 24066 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.160193 23817 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.167393 23993 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.180665 24066 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:44.180665 23914 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:44.181702 23961 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e905a7d4b6d64ec49ad9485c349179cb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:44.183256 24977 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:44.184391 24912 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:44.194670 24993 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.202250 23916 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.210016 24066 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.212863 24061 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:44.226941 24035 consensus_peers.cc:597] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dc5fe36cbf643f18c228bc420036e0c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:44.231200 23993 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:44.232751 24985 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:44.232954 23816 catalog_manager.cc:5697] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.236030 23914 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:44.239897 24985 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:44.247805 24974 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.251519 23993 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.262194 24061 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.263240 23914 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.266628 23817 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:44.275974 23993 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:44.276443 24035 consensus_peers.cc:597] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b3cbce810b542c7b032e8cbe30abbfd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:44.278223 24985 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:44.285338 23914 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:44.288437 24910 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:44.294890 24985 raft_consensus.cc:2955] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.297045 23993 raft_consensus.cc:2955] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.302560 23914 raft_consensus.cc:2955] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.310591 23819 catalog_manager.cc:5697] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:44.594688 25005 ts_tablet_manager.cc:933] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:44.596501 25005 tablet_copy_client.cc:323] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:44.597980 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 392f06df3ae54cb5a9746fdbb980ad3d from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:44.598526 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 392f06df3ae54cb5a9746fdbb980ad3d from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-392f06df3ae54cb5a9746fdbb980ad3d
I20260709 12:16:44.605772 23930 tablet_copy_source_session.cc:215] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:44.608521 25005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 392f06df3ae54cb5a9746fdbb980ad3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.622761 25005 tablet_copy_client.cc:806] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:44.623535 25005 tablet_copy_client.cc:670] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:44.627924 25005 tablet_copy_client.cc:538] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:44.633765 25005 tablet_bootstrap.cc:492] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:44.649816 25005 tablet_bootstrap.cc:492] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:44.650767 25005 tablet_bootstrap.cc:492] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:44.651422 25005 ts_tablet_manager.cc:1403] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.004s
I20260709 12:16:44.654441 25005 raft_consensus.cc:359] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.655293 25005 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:44.655977 25005 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.659789 25005 ts_tablet_manager.cc:1434] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:44.661510 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-392f06df3ae54cb5a9746fdbb980ad3d received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:44.661890 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-392f06df3ae54cb5a9746fdbb980ad3d on tablet 392f06df3ae54cb5a9746fdbb980ad3d with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:44.697144 25005 ts_tablet_manager.cc:933] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:44.699491 25005 tablet_copy_client.cc:323] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:44.701021 24080 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 8b3cbce810b542c7b032e8cbe30abbfd from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:44.701572 24080 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 8b3cbce810b542c7b032e8cbe30abbfd from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-8b3cbce810b542c7b032e8cbe30abbfd
I20260709 12:16:44.709523 24080 tablet_copy_source_session.cc:215] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:44.712901 25005 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b3cbce810b542c7b032e8cbe30abbfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.730288 25005 tablet_copy_client.cc:806] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:44.730904 25005 tablet_copy_client.cc:670] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:44.734393 25005 tablet_copy_client.cc:538] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:44.739210 25010 ts_tablet_manager.cc:933] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:44.740985 25010 tablet_copy_client.cc:323] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.2:43801
I20260709 12:16:44.743916 24006 tablet_copy_service.cc:140] P ef0dd15ac654478b8371c22b8909240e: Received BeginTabletCopySession request for tablet e905a7d4b6d64ec49ad9485c349179cb from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:60542)
I20260709 12:16:44.744558 24006 tablet_copy_service.cc:161] P ef0dd15ac654478b8371c22b8909240e: Beginning new tablet copy session on tablet e905a7d4b6d64ec49ad9485c349179cb from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:60542: session id = 71a48f59ff764d249519c6a53ec57f02-e905a7d4b6d64ec49ad9485c349179cb
I20260709 12:16:44.746840 25005 tablet_bootstrap.cc:492] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:44.763255 24006 tablet_copy_source_session.cc:215] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:44.780825 25005 tablet_bootstrap.cc:492] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:44.781770 25005 tablet_bootstrap.cc:492] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:44.782553 25005 ts_tablet_manager.cc:1403] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.012s
I20260709 12:16:44.785526 25005 raft_consensus.cc:359] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.786495 25005 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:44.787210 25005 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.789621 25005 ts_tablet_manager.cc:1434] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:16:44.792254 25012 ts_tablet_manager.cc:933] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:44.794117 25012 tablet_copy_client.cc:323] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:44.795357 24080 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-8b3cbce810b542c7b032e8cbe30abbfd received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:44.795779 24080 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-8b3cbce810b542c7b032e8cbe30abbfd on tablet 8b3cbce810b542c7b032e8cbe30abbfd with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:44.796994 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 8dc5fe36cbf643f18c228bc420036e0c from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:44.797526 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 8dc5fe36cbf643f18c228bc420036e0c from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-8dc5fe36cbf643f18c228bc420036e0c
I20260709 12:16:44.804502 25010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e905a7d4b6d64ec49ad9485c349179cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.808915 24079 tablet_copy_source_session.cc:215] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:44.820837 25012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dc5fe36cbf643f18c228bc420036e0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:44.837113 25012 tablet_copy_client.cc:806] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:44.839663 25012 tablet_copy_client.cc:670] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:44.844132 25012 tablet_copy_client.cc:538] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:44.849825 25010 tablet_copy_client.cc:806] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:44.850486 25010 tablet_copy_client.cc:670] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:44.853042 25012 tablet_bootstrap.cc:492] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:44.854380 25010 tablet_copy_client.cc:538] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:44.864135 25010 tablet_bootstrap.cc:492] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:44.880105 25012 tablet_bootstrap.cc:492] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:44.881027 25012 tablet_bootstrap.cc:492] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:44.881712 25012 ts_tablet_manager.cc:1403] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.013s
I20260709 12:16:44.884752 25012 raft_consensus.cc:359] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.885591 25012 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:44.886286 25012 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.889068 25012 ts_tablet_manager.cc:1434] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:16:44.890738 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-8dc5fe36cbf643f18c228bc420036e0c received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:44.891155 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-8dc5fe36cbf643f18c228bc420036e0c on tablet 8dc5fe36cbf643f18c228bc420036e0c with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:44.903568 25010 tablet_bootstrap.cc:492] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:44.904625 25010 tablet_bootstrap.cc:492] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:44.905382 25010 ts_tablet_manager.cc:1403] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.008s
I20260709 12:16:44.907887 25010 raft_consensus.cc:359] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.908496 25010 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:44.908974 25010 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:44.911120 25010 ts_tablet_manager.cc:1434] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:16:44.912904 24006 tablet_copy_service.cc:342] P ef0dd15ac654478b8371c22b8909240e: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-e905a7d4b6d64ec49ad9485c349179cb received from {username='slave'} at 127.0.0.1:60542
I20260709 12:16:44.913313 24006 tablet_copy_service.cc:434] P ef0dd15ac654478b8371c22b8909240e: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-e905a7d4b6d64ec49ad9485c349179cb on tablet e905a7d4b6d64ec49ad9485c349179cb with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:45.185544 24598 raft_consensus.cc:1217] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:45.194903 24600 raft_consensus.cc:1217] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:45.207209 24600 raft_consensus.cc:1217] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:45.263599 24600 raft_consensus.cc:1217] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:45.566674 25019 raft_consensus.cc:1064] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:45.577236 25019 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:45.592860 24600 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.594637 25021 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:45.595255 23914 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.595310 24061 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.597651 25021 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:45.599166 24993 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:45.615326 25021 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:45.621449 23916 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:45.623234 24066 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:45.634130 24600 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:45.644853 23817 catalog_manager.cc:5697] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:45.650635 24985 raft_consensus.cc:1064] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:45.660332 25015 raft_consensus.cc:1064] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:45.660959 24985 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:45.663945 25015 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:45.684558 24600 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.685398 23993 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.689934 24974 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:45.693383 24974 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:45.694234 24598 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.717120 25034 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:45.720773 23993 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:45.726646 23916 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.728777 25034 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:45.733445 24904 raft_consensus.cc:1064] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:45.742026 23916 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:45.742805 24598 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:45.744094 25021 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:45.753079 24904 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:45.745946 25021 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:16:45.759831 25019 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:45.763530 23916 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:45.774416 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 43620.3us
I20260709 12:16:45.785267 23988 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.773942 24598 raft_consensus.cc:2955] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:45.830227 23916 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.827100 24974 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:16:45.853895 25032 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:16:45.895745 23818 catalog_manager.cc:5697] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:45.895273 25015 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:45.926920 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 70587.8us
I20260709 12:16:45.947165 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet e905a7d4b6d64ec49ad9485c349179cb with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57818
I20260709 12:16:45.949136 23914 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:45.960613 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 67865.6us
I20260709 12:16:45.982933 25048 tablet_replica.cc:333] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:16:45.983877 24598 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:45.986491 25043 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:45.988144 25048 raft_consensus.cc:2243] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:45.989825 25048 raft_consensus.cc:2272] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:45.997021 25048 ts_tablet_manager.cc:1916] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:46.000051 24599 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.008692 23818 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.021327 25046 raft_consensus.cc:2955] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.028155 23988 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.037082 24061 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:16:46.038877 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 223323us
I20260709 12:16:46.041069 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e905a7d4b6d64ec49ad9485c349179cb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:46.049358 24599 raft_consensus.cc:2955] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.051826 23819 catalog_manager.cc:5697] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.057511 23920 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:46.058733 23990 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.061228 24069 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:46.066614 24069 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:46.048416 24598 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:46.072091 25032 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:46.079797 25015 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.089892 24600 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.112201 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8dc5fe36cbf643f18c228bc420036e0c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:46.113324 23990 raft_consensus.cc:2955] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.121929 25048 ts_tablet_manager.cc:1929] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:46.128273 25045 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:46.132936 24598 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:46.140874 23988 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:46.146934 24904 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:46.151458 25048 log.cc:1199] T e905a7d4b6d64ec49ad9485c349179cb P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/e905a7d4b6d64ec49ad9485c349179cb
I20260709 12:16:46.154827 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet e905a7d4b6d64ec49ad9485c349179cb (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:46.159533 24974 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:46.153501 23819 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.173487 25033 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:46.184741 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dc5fe36cbf643f18c228bc420036e0c with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:46.205619 24985 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:46.210001 25046 raft_consensus.cc:2955] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.210574 24598 raft_consensus.cc:2955] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.219025 23914 raft_consensus.cc:2955] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.223742 23988 raft_consensus.cc:2955] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.242811 23816 catalog_manager.cc:5697] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:46.304348 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44002.2us
I20260709 12:16:46.308537 25054 tablet_replica.cc:333] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
W20260709 12:16:46.310573 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 47759.4us
I20260709 12:16:46.311355 25054 raft_consensus.cc:2243] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:46.320456 25054 raft_consensus.cc:2272] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:46.328810 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b3cbce810b542c7b032e8cbe30abbfd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:46.340342 25054 ts_tablet_manager.cc:1916] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:46.342299 25052 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.366883 24061 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.370357 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b3cbce810b542c7b032e8cbe30abbfd with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:46.377806 24598 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.350898 23991 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.404596 23818 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.425597 25056 tablet_replica.cc:333] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:46.427894 23916 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:46.427088 25056 raft_consensus.cc:2243] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:46.431507 25056 pending_rounds.cc:70] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: Trying to abort 1 pending ops.
I20260709 12:16:46.431835 25056 pending_rounds.cc:77] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305623165549613056 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } } }
I20260709 12:16:46.435438 24598 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:46.433874 25056 raft_consensus.cc:2917] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:16:46.437599 25051 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:46.438020 25056 raft_consensus.cc:2889] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:16:46.438489 25056 raft_consensus.cc:2272] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:46.441751 23991 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:46.445169 25051 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:46.455515 25056 ts_tablet_manager.cc:1916] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:46.454483 24987 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.456650 23991 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.461468 24599 raft_consensus.cc:2955] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:46.472102 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 392f06df3ae54cb5a9746fdbb980ad3d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:46.473515 25054 ts_tablet_manager.cc:1929] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:46.478081 25056 ts_tablet_manager.cc:1929] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:46.482837 23816 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:46.487725 25054 log.cc:1199] T 8dc5fe36cbf643f18c228bc420036e0c P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/8dc5fe36cbf643f18c228bc420036e0c
I20260709 12:16:46.489552 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 8dc5fe36cbf643f18c228bc420036e0c (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:46.492267 25056 log.cc:1199] T 8b3cbce810b542c7b032e8cbe30abbfd P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/8b3cbce810b542c7b032e8cbe30abbfd
I20260709 12:16:46.494441 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet 8b3cbce810b542c7b032e8cbe30abbfd (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:46.499213 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 392f06df3ae54cb5a9746fdbb980ad3d with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57818
I20260709 12:16:46.500178 25048 tablet_replica.cc:333] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:16:46.501382 25048 raft_consensus.cc:2243] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:46.502236 25048 raft_consensus.cc:2272] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:46.507129 25048 ts_tablet_manager.cc:1916] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:46.528127 25048 ts_tablet_manager.cc:1929] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:46.528581 25048 log.cc:1199] T 392f06df3ae54cb5a9746fdbb980ad3d P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/392f06df3ae54cb5a9746fdbb980ad3d
I20260709 12:16:46.532135 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 392f06df3ae54cb5a9746fdbb980ad3d (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:47.282135 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.340209 24069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:47.340777 24069 raft_consensus.cc:606] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:47.353861 23916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:47.354511 23916 raft_consensus.cc:606] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:47.357031 23914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8132db9882c041d1845d0a8815c39788"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:47.357462 23914 raft_consensus.cc:606] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:47.359542 23914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:47.359930 23914 raft_consensus.cc:606] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:47.370085 23991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:16:47.370559 23991 raft_consensus.cc:606] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:47.372771 23914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:47.373230 23914 raft_consensus.cc:606] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:47.376343 23914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:47.376844 23914 raft_consensus.cc:606] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:47.378325 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:16:47.379527 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:47.380369 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.403306 25019 raft_consensus.cc:993] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:47.403815 25041 raft_consensus.cc:1081] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:47.405248 23914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:16:47.405820 23914 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.406136 23914 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.414441 23914 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.416224 23914 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:47.416849 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:47.417510 23991 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.417744 23991 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:47.418458 23991 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.419323 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:47.419582 23991 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.419859 24069 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.425289 23991 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:47.425822 24069 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:47.426508 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:47.427328 25051 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.428000 25051 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:47.428840 25051 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.429567 25046 raft_consensus.cc:993] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:47.430045 25015 raft_consensus.cc:1081] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:47.431384 23914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:16:47.431918 23914 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.432433 23914 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.436792 23914 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.438534 23914 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:47.439517 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:47.440089 23990 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.439639 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:47.439708 23818 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.440637 24069 raft_consensus.cc:3055] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.440932 24069 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:47.441672 24069 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.442899 24069 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.448685 25057 raft_consensus.cc:993] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:47.449281 25051 raft_consensus.cc:1081] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:47.453105 23993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:16:47.453661 23993 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.454226 23993 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.456692 23990 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:47.458019 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:47.458839 25051 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.461350 24069 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:47.459517 25051 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:47.463651 25051 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.464653 23993 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.466580 23993 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:47.467536 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:47.467708 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:47.468062 24061 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.469765 23914 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.470201 23914 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:47.471032 23914 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.472424 23914 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.478737 24061 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:47.480906 23962 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:47.482096 25041 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.482740 25041 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:47.483237 23914 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:47.483891 25041 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.511107 25057 raft_consensus.cc:993] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:47.511634 25057 raft_consensus.cc:1081] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:47.513504 24598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37708
I20260709 12:16:47.514142 24598 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.514492 24598 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.520056 23818 catalog_manager.cc:5697] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.521746 24598 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:47.524883 23816 catalog_manager.cc:5697] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:47.526875 24598 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:47.527987 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:47.528514 23993 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.529070 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:47.529621 23914 raft_consensus.cc:3055] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.529903 23914 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:47.530612 23914 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:47.531742 23914 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.542464 23993 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:47.542650 23914 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:47.543802 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:16:47.545684 25069 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.547683 25069 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:47.548578 25069 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:47.560523 23816 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.603823 24061 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:47.610752 24035 consensus_peers.cc:597] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3da07aaa60743c193b387e6a20fc83b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:47.610850 23993 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:47.611248 23914 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:47.612066 25073 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.613016 25015 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.621868 25046 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:47.623679 23993 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:47.630910 23916 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:47.642264 23914 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:47.647382 23816 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:47.662102 23886 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 84a22fee7e714048af4a1d40001e99de. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:47.669255 23990 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:47.670224 24061 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:47.672262 25052 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.673141 25078 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:47.673557 25057 raft_consensus.cc:993] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:47.674098 25057 raft_consensus.cc:1081] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:47.675872 23990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8132db9882c041d1845d0a8815c39788"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:16:47.676410 23990 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.676803 23990 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.685233 23990 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.686190 25052 raft_consensus.cc:993] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:47.686733 25078 raft_consensus.cc:1081] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:47.688589 24598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37708
I20260709 12:16:47.689093 24598 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.689456 24598 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.690377 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:47.690972 23916 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.691268 23916 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:47.692066 23916 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.694002 23916 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.700537 24598 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:47.703579 23990 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:47.703770 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:47.704370 24069 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.704595 23916 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:47.704840 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:47.705592 24066 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.705708 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:47.706640 25019 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.707154 25019 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:47.708007 25019 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:47.710597 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:47.711233 23920 raft_consensus.cc:3055] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:47.711575 23920 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:47.712440 23920 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:47.713804 23920 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.718938 24066 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:47.723065 24566 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:47.724645 25069 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:47.724783 24069 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:47.725137 25069 raft_consensus.cc:697] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:47.725306 25057 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:47.727325 23920 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:47.703747 24598 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:47.729491 24069 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:47.726132 25069 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:47.756825 25078 raft_consensus.cc:993] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:47.757344 25078 raft_consensus.cc:1081] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:47.765552 24600 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37708
I20260709 12:16:47.766103 24600 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:47.766489 24600 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.805160 24600 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:47.811770 24600 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:47.812781 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:47.813364 23990 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:47.812153 23816 catalog_manager.cc:5697] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:47.838810 23990 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:48.070899 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:48.071534 23921 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:48.071810 23921 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:48.072331 23921 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:48.073133 23921 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:48.073215 23993 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:48.080801 23921 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:48.081019 23993 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.093024 23990 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.097106 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:16:48.098012 25070 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:48.098502 25070 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:48.099474 25070 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:48.101506 23921 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:48.105436 25088 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:48.107522 23916 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.112331 25068 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.127889 23988 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:48.133165 25070 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:48.148593 24069 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:48.156531 24069 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.156121 23815 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:16:48.167696 23867 auto_rebalancer.cc:629] Failed to schedule move for tablet 8132db9882c041d1845d0a8815c39788: Illegal state: Replica 0829ddf18f07439086398756b9c6d216 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:16:48.170603 24069 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.174917 25080 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:48.175583 25051 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.176690 23816 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
W20260709 12:16:48.186939 23914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.013s	sys 0.010s
W20260709 12:16:48.187305 23914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.013s	sys 0.010s
I20260709 12:16:48.190445 23921 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.195612 25019 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.212787 24066 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.216370 25094 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.228672 23920 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:48.234840 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 61241.1us
I20260709 12:16:48.240440 25069 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:16:48.244455 23886 consensus_peers.cc:597] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 238addf610d94f84b346a29e1e4b0e52. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:48.253976 23988 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:48.273968 25100 ts_tablet_manager.cc:933] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:48.280550 23815 catalog_manager.cc:5697] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:48.292135 23992 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:48.301090 25107 ts_tablet_manager.cc:933] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:48.318912 25057 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:48.327186 24063 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:48.322760 25051 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:16:48.342844 24063 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:48.351321 25094 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:16:48.353077 25057 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:48.367290 23916 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:48.366433 25100 tablet_copy_client.cc:323] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:16:48.401330 25078 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:16:48.414546 25070 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:48.411868 25107 tablet_copy_client.cc:323] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:48.510382 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.557675 23990 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:16:48.562314 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 90286.4us
I20260709 12:16:48.567500 25070 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:48.580248 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet a3da07aaa60743c193b387e6a20fc83b from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:16:48.580870 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet a3da07aaa60743c193b387e6a20fc83b from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-a3da07aaa60743c193b387e6a20fc83b
I20260709 12:16:48.595955 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 84a22fee7e714048af4a1d40001e99de from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:48.596632 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 84a22fee7e714048af4a1d40001e99de from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-84a22fee7e714048af4a1d40001e99de
I20260709 12:16:48.688608 24079 tablet_copy_source_session.cc:215] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:48.714254 25100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da07aaa60743c193b387e6a20fc83b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:48.772610 23916 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:48.775363 25069 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:48.801905 23930 tablet_copy_source_session.cc:215] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:48.812942 24062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:48.829427 24062 raft_consensus.cc:606] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
W20260709 12:16:48.830660 25113 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:16:48.846468 25107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84a22fee7e714048af4a1d40001e99de. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:48.903116 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08001316c0 after lost signal to thread 22723
W20260709 12:16:48.904131 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800034b00 after lost signal to thread 23853
W20260709 12:16:48.905210 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08002cd1c0 after lost signal to thread 23945
W20260709 12:16:48.910943 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 64023.1us
W20260709 12:16:48.910408 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800325b40 after lost signal to thread 24020
W20260709 12:16:48.916049 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080030a580 after lost signal to thread 24094
I20260709 12:16:48.916371 23919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "368f96220d5b4469885774acf06e4475"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:48.917002 23919 raft_consensus.cc:606] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
W20260709 12:16:48.917182 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080031cfa0 after lost signal to thread 24624
I20260709 12:16:48.923933 23991 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:48.940213 25119 ts_tablet_manager.cc:933] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:48.946954 25051 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:49.005991 25100 tablet_copy_client.cc:806] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:49.015028 25100 tablet_copy_client.cc:670] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
W20260709 12:16:49.006994 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 85019.7us
I20260709 12:16:49.016835 25102 raft_consensus.cc:993] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:49.017235 25102 raft_consensus.cc:1081] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:49.018626 24061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:49.019222 24061 raft_consensus.cc:606] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:49.022981 24061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:49.023509 24061 raft_consensus.cc:606] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:49.026518 25100 tablet_copy_client.cc:538] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:49.033859 23914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:16:49.034444 23914 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.034788 23914 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.033217 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:16:49.037549 23990 raft_consensus.cc:606] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:49.039651 23818 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:49.043009 23914 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.051548 23914 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:49.051774 25057 raft_consensus.cc:993] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:49.053076 25057 raft_consensus.cc:1081] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:49.054096 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:49.054171 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:49.054697 23991 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.054905 24062 raft_consensus.cc:3055] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:49.055363 24062 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:49.054756 24061 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:49.056205 24062 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.057360 24062 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.061053 23991 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:49.063167 23916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:49.063844 23916 raft_consensus.cc:606] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:49.072744 23991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "368f96220d5b4469885774acf06e4475"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:16:49.072801 25119 tablet_copy_client.cc:323] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:49.073329 23991 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.073734 23991 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.074651 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:16:49.076359 24062 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:49.076647 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:49.077458 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.074772 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:49.080230 25125 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:49.080941 25125 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:49.082543 25125 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.101023 25107 tablet_copy_client.cc:806] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:49.101711 25107 tablet_copy_client.cc:670] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:49.107758 25019 raft_consensus.cc:993] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:49.108299 25019 raft_consensus.cc:1081] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:49.111531 23919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:16:49.112155 23919 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.112594 23919 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:49.129017 25100 tablet_bootstrap.cc:492] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:49.136874 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 238addf610d94f84b346a29e1e4b0e52 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:49.137472 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 238addf610d94f84b346a29e1e4b0e52 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-238addf610d94f84b346a29e1e4b0e52
I20260709 12:16:49.141052 23919 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.095098 23991 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.180312 23991 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:49.145478 23930 tablet_copy_source_session.cc:215] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:49.183218 25107 tablet_copy_client.cc:538] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:49.183331 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:49.183904 23990 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:49.184206 23990 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:49.184964 23990 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.185968 23990 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:49.187772 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:49.188088 25119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238addf610d94f84b346a29e1e4b0e52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:49.162400 25102 raft_consensus.cc:993] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:49.191107 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:49.188325 24061 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.191645 23916 raft_consensus.cc:3055] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:49.193223 23916 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:49.192495 25089 raft_consensus.cc:1081] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:49.196606 23919 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:49.198221 24596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37704
I20260709 12:16:49.198990 24596 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.199379 24596 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.195381 23916 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.199079 25090 raft_consensus.cc:993] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:49.201390 25090 raft_consensus.cc:1081] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:49.202205 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:49.202790 24062 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:49.213085 24062 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:16:49.213917 25100 tablet_bootstrap.cc:492] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:49.219287 25100 tablet_bootstrap.cc:492] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:49.219993 25100 ts_tablet_manager.cc:1403] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.008s
I20260709 12:16:49.227036 23990 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:16:49.229120 25100 raft_consensus.cc:359] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:49.229806 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:49.230258 25100 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:49.230592 23917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:16:49.231153 23917 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.231592 23917 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.231052 25100 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:49.233021 25107 tablet_bootstrap.cc:492] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:49.230897 25123 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:49.237480 25123 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:49.240252 23916 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.240928 25123 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.263947 25100 ts_tablet_manager.cc:1434] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.002s
I20260709 12:16:49.265672 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-a3da07aaa60743c193b387e6a20fc83b received from {username='slave'} at 127.0.0.1:42676
I20260709 12:16:49.266139 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-a3da07aaa60743c193b387e6a20fc83b on tablet a3da07aaa60743c193b387e6a20fc83b with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:49.274258 25119 tablet_copy_client.cc:806] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:49.274956 25119 tablet_copy_client.cc:670] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:49.276763 24596 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:49.280263 24061 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:49.283205 24596 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:49.289112 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:49.289644 25119 tablet_copy_client.cc:538] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:49.289718 24062 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:49.290236 24062 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:49.291136 24062 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:49.278595 23917 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.289790 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:49.304435 23919 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.303049 23816 catalog_manager.cc:5697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:49.302009 23916 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:49.313763 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:49.314381 23990 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.317106 23960 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:49.321557 23919 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:49.297955 24062 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.329718 23917 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:49.331727 24564 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:16:49.333215 23990 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:49.334553 25069 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:49.325563 25019 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:49.350448 25069 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:49.350502 25019 raft_consensus.cc:697] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:49.351447 25069 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:49.351639 25019 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.341192 25119 tablet_bootstrap.cc:492] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:49.355190 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:49.341723 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:49.356547 24061 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:49.349618 24062 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:49.356997 24061 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:49.359125 24061 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.357529 25051 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:49.365345 24061 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.367152 25051 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:49.368126 25051 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:49.375836 24061 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:49.381631 23817 catalog_manager.cc:5697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 3, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:49.401115 23816 catalog_manager.cc:5697] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:49.402622 23818 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:49.435422 25107 tablet_bootstrap.cc:492] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:49.441669 25107 tablet_bootstrap.cc:492] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:49.442509 25107 ts_tablet_manager.cc:1403] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.210s	user 0.017s	sys 0.009s
I20260709 12:16:49.520032 25107 raft_consensus.cc:359] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:49.521014 25107 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:49.521747 25107 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:49.544663 25107 ts_tablet_manager.cc:1434] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.099s	user 0.006s	sys 0.000s
I20260709 12:16:49.538168 23816 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:49.555243 25101 raft_consensus.cc:993] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:49.555719 25101 raft_consensus.cc:1081] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:49.563134 24596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37708
I20260709 12:16:49.563723 24596 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:49.564096 24596 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.567258 25119 tablet_bootstrap.cc:492] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:49.569621 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-84a22fee7e714048af4a1d40001e99de received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:49.570096 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-84a22fee7e714048af4a1d40001e99de on tablet 84a22fee7e714048af4a1d40001e99de with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:49.570809 25119 tablet_bootstrap.cc:492] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:49.575995 25119 ts_tablet_manager.cc:1403] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.235s	user 0.034s	sys 0.000s
I20260709 12:16:49.590338 25119 raft_consensus.cc:359] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:49.591164 25119 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:49.591799 25119 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:49.593191 24596 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:49.596679 24596 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:49.599943 25119 ts_tablet_manager.cc:1434] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:16:49.603349 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:49.603869 23988 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.605733 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:49.606263 23917 raft_consensus.cc:3055] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:49.606560 23917 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:49.607223 23917 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:49.608174 23917 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:49.624614 23988 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:49.625577 24566 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:49.626446 25069 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:49.626929 25069 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:49.627105 24598 raft_consensus.cc:1217] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:49.627740 25069 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:49.635430 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-238addf610d94f84b346a29e1e4b0e52 received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:49.635890 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-238addf610d94f84b346a29e1e4b0e52 on tablet 238addf610d94f84b346a29e1e4b0e52 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:49.643502 23917 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:49.660897 23988 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.662207 25140 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.680867 24062 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.685844 25057 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.688059 24062 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:49.691820 25140 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:49.722746 24598 raft_consensus.cc:1217] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:49.715759 23818 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:49.750835 23988 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:49.772672 25123 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:49.781736 23993 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.782876 24066 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.789074 24598 raft_consensus.cc:1217] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:49.802512 25123 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:49.803840 25140 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:49.874109 23917 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.875703 25087 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:16:49.876226 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 48873.8us
I20260709 12:16:49.900893 24061 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:49.902456 25086 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:49.907109 24063 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:49.908433 25069 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:49.965847 23916 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:49.967271 25069 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:50.093473 23993 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:50.095782 25141 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:50.150633 23916 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:50.159587 25088 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:50.201984 25046 raft_consensus.cc:1064] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:50.206099 25046 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.214398 25125 raft_consensus.cc:1064] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:50.217029 25125 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.223814 24598 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.224107 23993 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.227378 25102 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.229385 25102 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.231830 25057 raft_consensus.cc:1064] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:50.239548 25057 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.246788 23916 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.249915 25015 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.284590 24598 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.283691 25102 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.285966 25123 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.290998 24600 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.293757 25140 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.300545 24062 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.302870 23993 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.304690 25123 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.308663 23990 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.310892 25123 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.339577 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:50.343591 23818 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.363427 24063 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.367161 24596 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.371865 23988 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:50.386480 25140 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.389539 23916 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.397747 25057 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.400657 25123 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:50.409650 23988 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.436221 24600 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:50.464442 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 48664.1us
I20260709 12:16:50.470536 23818 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.483459 24061 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.502817 25123 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.473717 24062 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.519923 23917 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.521734 23993 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.537665 23988 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:50.540006 25102 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:50.549167 24596 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:50.549167 24600 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:50.553330 23917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:50.553915 23917 raft_consensus.cc:606] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:50.554435 25140 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:50.557044 23993 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:50.557166 25015 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:50.559464 23818 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.572023 25140 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:50.576828 23917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:50.577425 23917 raft_consensus.cc:606] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:50.583755 25125 raft_consensus.cc:993] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:50.584213 25125 raft_consensus.cc:1081] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:50.585937 24596 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37708
I20260709 12:16:50.586472 24596 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:50.586812 24596 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.579018 25057 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.593369 23993 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.592741 24600 raft_consensus.cc:2955] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.599798 23988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:16:50.600344 23988 raft_consensus.cc:606] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
W20260709 12:16:50.601275 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 44460.3us
I20260709 12:16:50.605597 24596 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.614101 25046 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.615123 23817 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 3 to 4, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.614802 24063 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.626003 24062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:50.626670 24062 raft_consensus.cc:606] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:50.628191 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a3da07aaa60743c193b387e6a20fc83b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:50.629127 23993 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.630961 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:50.631505 23917 raft_consensus.cc:3055] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:50.631770 23917 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:50.632447 23917 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.632899 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 84a22fee7e714048af4a1d40001e99de with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57818
I20260709 12:16:50.633453 23917 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.635691 24596 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:50.639295 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 84a22fee7e714048af4a1d40001e99de with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:50.643394 23917 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:50.654604 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:50.656178 24062 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.663403 24062 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:50.665313 24564 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:16:50.667132 25141 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:50.667582 25141 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:50.668416 25141 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.676877 24063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac75053172041f285deb68d4418ed57"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:50.677415 24063 raft_consensus.cc:606] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:50.685910 25183 tablet_replica.cc:333] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:16:50.695569 23818 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.702082 25183 raft_consensus.cc:2243] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:50.702912 25183 raft_consensus.cc:2272] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:50.703784 23815 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.706895 25183 ts_tablet_manager.cc:1916] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:16:50.722244 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55760.2us
I20260709 12:16:50.723726 24598 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.725534 23919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:50.726099 23919 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:50.732288 25183 ts_tablet_manager.cc:1929] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:50.732821 25183 log.cc:1199] T 84a22fee7e714048af4a1d40001e99de P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/84a22fee7e714048af4a1d40001e99de
I20260709 12:16:50.734557 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 84a22fee7e714048af4a1d40001e99de (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:50.739401 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:16:50.741022 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:50.741739 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:50.745407 25140 raft_consensus.cc:993] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:50.745868 25140 raft_consensus.cc:1081] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:50.748922 24599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37708
I20260709 12:16:50.749433 24599 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:50.749760 24599 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.768637 24599 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.771376 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet a3da07aaa60743c193b387e6a20fc83b with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:50.771413 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:50.772038 23919 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:50.772409 23919 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:50.660769 24596 raft_consensus.cc:2955] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.780418 23919 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.784195 23919 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.784219 25186 tablet_replica.cc:333] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:50.788224 25154 raft_consensus.cc:993] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:50.788702 25154 raft_consensus.cc:1081] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:50.790871 24598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37694
I20260709 12:16:50.790814 23917 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.796197 24599 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:50.797963 23919 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:50.799013 24564 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:16:50.799840 25069 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:50.800284 25069 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:50.801204 25069 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.803406 25186 raft_consensus.cc:2243] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:50.791550 24598 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:50.803995 24598 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.805536 25186 raft_consensus.cc:2272] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:50.809315 24599 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:50.810710 25140 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:16:50.792327 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 122586us
I20260709 12:16:50.812539 25186 ts_tablet_manager.cc:1916] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:50.815505 24063 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:50.816375 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:50.816910 23990 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.824292 23990 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:50.825410 25177 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.840016 24600 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.847255 25178 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:50.850996 25186 ts_tablet_manager.cc:1929] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:50.853482 25186 log.cc:1199] T a3da07aaa60743c193b387e6a20fc83b P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/a3da07aaa60743c193b387e6a20fc83b
I20260709 12:16:50.855542 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet a3da07aaa60743c193b387e6a20fc83b (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:50.864652 24598 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.867259 25182 raft_consensus.cc:993] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:50.868161 25182 raft_consensus.cc:1081] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:50.870795 24595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eac75053172041f285deb68d4418ed57"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37704
I20260709 12:16:50.871361 24595 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:50.871699 24595 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.874302 24063 raft_consensus.cc:2955] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.878937 24595 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.881770 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:50.882668 24062 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.885300 24595 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:50.870796 24598 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:50.890247 24062 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:50.904752 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 238addf610d94f84b346a29e1e4b0e52 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:50.909194 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:50.911355 24061 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:50.911641 24061 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:50.912406 24061 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.913676 24061 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.925172 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:50.927124 25182 raft_consensus.cc:993] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:50.925179 23815 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:50.927657 25182 raft_consensus.cc:1081] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:50.929975 25184 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:50.930533 25184 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:50.931416 25184 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.947149 23818 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:50.950860 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:50.951236 23917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:16:50.951548 23990 raft_consensus.cc:3055] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:50.951819 23917 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:50.951910 23990 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:50.952164 24061 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:50.952280 23917 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.952776 23990 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.955693 23990 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.958957 23917 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.961650 23990 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:50.962927 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:50.963222 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:16:50.963527 23993 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.963864 24600 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:50.964648 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:50.965513 25069 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:50.965969 25069 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:50.966902 25069 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:50.969746 23993 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:50.972509 24600 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:50.974298 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 238addf610d94f84b346a29e1e4b0e52 with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:50.987498 23886 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:16:50.990077 25057 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:50.990597 25057 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:50.991461 25057 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:51.007844 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:51.008167 23917 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:16:51.008448 24061 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:51.008718 24061 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:51.009465 24061 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:51.010452 24061 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.016816 23818 catalog_manager.cc:5697] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.018103 23818 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:51.026402 24061 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:51.027057 25192 tablet_replica.cc:333] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:51.028108 25192 raft_consensus.cc:2243] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.028707 25192 raft_consensus.cc:2272] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.040251 25057 raft_consensus.cc:993] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:51.040747 25057 raft_consensus.cc:1081] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:51.043200 23990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:16:51.043673 23990 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:51.044020 23990 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.044245 25192 ts_tablet_manager.cc:1916] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:51.031971 23817 catalog_manager.cc:5697] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:51.051697 23990 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:51.054008 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:51.054972 23914 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:51.055254 23914 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:51.055915 23914 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:51.056716 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:51.056895 23914 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.057241 24061 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:51.062214 23990 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:51.065117 24061 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:51.065245 23914 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:51.066162 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:51.067286 25188 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:51.068382 25188 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:51.069240 25188 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:51.079988 23817 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:51.080955 25192 ts_tablet_manager.cc:1929] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:51.081506 25192 log.cc:1199] T 238addf610d94f84b346a29e1e4b0e52 P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/238addf610d94f84b346a29e1e4b0e52
I20260709 12:16:51.083150 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 238addf610d94f84b346a29e1e4b0e52 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:51.093070 24061 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.094435 25069 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:51.123214 23914 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.126019 25069 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:51.197115 23914 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.198228 25141 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:51.204780 23990 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.207345 25069 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:51.405637 23993 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.406811 25141 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:51.424762 24061 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.427047 25141 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:51.461318 24061 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:51.462457 25188 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:51.471462 23914 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:51.474361 25087 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:51.520017 23993 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.521546 25141 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:51.524118 24062 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.527431 25141 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:16:51.578218 24061 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.579550 25140 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:51.592108 24595 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:51.593357 25140 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:16:52.044013 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:52.046519 23993 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:16:52.189343 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 118769us
W20260709 12:16:52.211763 23961 consensus_peers.cc:597] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9661e61546884b0aa0c1e828cd13e76e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.225775 24063 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:52.245640 25087 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:52.286303 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:16:52.286986 23993 raft_consensus.cc:606] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:52.291481 24063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:52.292063 24063 raft_consensus.cc:606] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:52.291136 25087 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.292598 23917 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:52.294158 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:52.295799 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:52.296490 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:52.299898 24063 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.303861 25154 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:52.321341 25215 raft_consensus.cc:993] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:52.321892 25180 raft_consensus.cc:1081] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:52.324162 23914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:16:52.324657 23914 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:52.325016 23914 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.331686 23914 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:52.345000 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:52.345546 23993 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:52.350512 23867 auto_rebalancer.cc:629] Failed to schedule move for tablet 6869b2949cb848a79c8263a5be455d66: Remote error: Service unavailable: leader transfer in progress
I20260709 12:16:52.355005 23993 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:52.356240 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:52.355837 23919 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:52.357110 25140 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:52.356575 23818 catalog_manager.cc:5697] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:52.357563 25140 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:52.358970 25140 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:52.365012 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:52.365572 24062 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:52.365866 24062 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:52.366865 23914 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:52.366669 24062 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:52.367744 24062 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.388186 23817 catalog_manager.cc:5697] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:52.397971 23886 consensus_peers.cc:597] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2e9a767edf8b423cb0ef561b055f670a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.402462 23993 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:52.405042 24061 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:52.405414 25212 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:52.408557 25178 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:52.398195 23917 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.426738 25178 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.429113 23993 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.414155 24062 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:52.463155 24062 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.472675 23917 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:52.499693 23818 catalog_manager.cc:5697] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
W20260709 12:16:52.538200 23886 consensus_peers.cc:597] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b80ceeebb5c4f0aaaecd9da202550b0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.539044 24062 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:52.540457 23991 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:52.540364 25178 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:52.542436 25178 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:52.549093 25178 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.551961 24062 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.578138 23991 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.582984 23815 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:52.663429 25087 raft_consensus.cc:993] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:52.664680 25189 raft_consensus.cc:1081] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:52.666776 24063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:16:52.667392 24063 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:52.667738 24063 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.675294 24063 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:52.677963 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:52.678610 23917 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.678752 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:52.679389 23991 raft_consensus.cc:3055] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:52.679689 23991 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:52.680440 23991 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:52.681566 23991 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:52.688839 23991 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:16:52.688982 23917 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:16:52.694804 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:52.695858 25215 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:52.696411 25215 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:52.697433 25215 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:52.689404 24063 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:52.724619 23817 catalog_manager.cc:5697] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 1 to 2, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 2 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:52.808173 23990 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:52.816746 25057 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:52.835103 24062 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:52.843286 25230 ts_tablet_manager.cc:933] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:52.851521 25212 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:52.858706 25230 tablet_copy_client.cc:323] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.2:43801
I20260709 12:16:52.864822 24006 tablet_copy_service.cc:140] P ef0dd15ac654478b8371c22b8909240e: Received BeginTabletCopySession request for tablet 9661e61546884b0aa0c1e828cd13e76e from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:60542)
I20260709 12:16:52.865417 24006 tablet_copy_service.cc:161] P ef0dd15ac654478b8371c22b8909240e: Beginning new tablet copy session on tablet 9661e61546884b0aa0c1e828cd13e76e from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:60542: session id = 71a48f59ff764d249519c6a53ec57f02-9661e61546884b0aa0c1e828cd13e76e
I20260709 12:16:52.873206 24006 tablet_copy_source_session.cc:215] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:52.880862 25230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9661e61546884b0aa0c1e828cd13e76e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.908360 25230 tablet_copy_client.cc:806] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:52.909003 25230 tablet_copy_client.cc:670] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:52.922350 25230 tablet_copy_client.cc:538] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:52.932612 25230 tablet_bootstrap.cc:492] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:52.959918 25236 ts_tablet_manager.cc:933] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:52.968868 25236 tablet_copy_client.cc:323] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:52.971010 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 2e9a767edf8b423cb0ef561b055f670a from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:52.971539 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 2e9a767edf8b423cb0ef561b055f670a from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-2e9a767edf8b423cb0ef561b055f670a
I20260709 12:16:52.996992 25230 tablet_bootstrap.cc:492] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:52.997928 25230 tablet_bootstrap.cc:492] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:52.996312 23930 tablet_copy_source_session.cc:215] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:53.007110 25230 ts_tablet_manager.cc:1403] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.075s	user 0.025s	sys 0.000s
I20260709 12:16:53.010381 25230 raft_consensus.cc:359] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:53.011355 25230 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:53.011863 25236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e9a767edf8b423cb0ef561b055f670a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.012091 25230 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:53.014531 25230 ts_tablet_manager.cc:1434] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 12:16:53.016793 24006 tablet_copy_service.cc:342] P ef0dd15ac654478b8371c22b8909240e: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-9661e61546884b0aa0c1e828cd13e76e received from {username='slave'} at 127.0.0.1:60542
I20260709 12:16:53.017190 24006 tablet_copy_service.cc:434] P ef0dd15ac654478b8371c22b8909240e: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-9661e61546884b0aa0c1e828cd13e76e on tablet 9661e61546884b0aa0c1e828cd13e76e with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:53.033903 25236 tablet_copy_client.cc:806] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:53.041199 25236 tablet_copy_client.cc:670] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:53.045195 25236 tablet_copy_client.cc:538] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:53.063025 25236 tablet_bootstrap.cc:492] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:53.083681 25236 tablet_bootstrap.cc:492] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:53.084676 25236 tablet_bootstrap.cc:492] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:53.085355 25236 ts_tablet_manager.cc:1403] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:16:53.088392 25236 raft_consensus.cc:359] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:53.089285 25236 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:53.089947 25236 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:53.099489 25236 ts_tablet_manager.cc:1434] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:16:53.107237 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-2e9a767edf8b423cb0ef561b055f670a received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:53.107748 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-2e9a767edf8b423cb0ef561b055f670a on tablet 2e9a767edf8b423cb0ef561b055f670a with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:53.126036 25236 ts_tablet_manager.cc:933] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:16:53.135784 25236 tablet_copy_client.cc:323] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:53.137730 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 2b80ceeebb5c4f0aaaecd9da202550b0 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:53.138332 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 2b80ceeebb5c4f0aaaecd9da202550b0 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-2b80ceeebb5c4f0aaaecd9da202550b0
I20260709 12:16:53.149433 23930 tablet_copy_source_session.cc:215] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:53.152585 25236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b80ceeebb5c4f0aaaecd9da202550b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.172814 25236 tablet_copy_client.cc:806] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:16:53.173480 25236 tablet_copy_client.cc:670] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:16:53.177206 25236 tablet_copy_client.cc:538] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:16:53.187599 25236 tablet_bootstrap.cc:492] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:16:53.214185 25236 tablet_bootstrap.cc:492] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:16:53.215425 25236 tablet_bootstrap.cc:492] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:16:53.216292 25236 ts_tablet_manager.cc:1403] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.006s
I20260709 12:16:53.220463 25236 raft_consensus.cc:359] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:53.221426 25236 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:16:53.222126 25236 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:53.224773 25236 ts_tablet_manager.cc:1434] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:53.228915 23930 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-2b80ceeebb5c4f0aaaecd9da202550b0 received from {username='slave'} at 127.0.0.1:56870
I20260709 12:16:53.229373 23930 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-2b80ceeebb5c4f0aaaecd9da202550b0 on tablet 2b80ceeebb5c4f0aaaecd9da202550b0 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:53.243561 23917 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:53.245533 25180 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:53.261037 23991 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:53.287583 25229 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:16:53.322428 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54271.3us
I20260709 12:16:53.374935 24595 raft_consensus.cc:1217] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:53.380597 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:53.417373 24600 raft_consensus.cc:1217] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:16:53.454666 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 124643us
I20260709 12:16:53.547013 24063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:53.547632 24063 raft_consensus.cc:606] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:53.550566 24063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479416b99927471b8600549d94ad4873"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:53.551206 24063 raft_consensus.cc:606] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:53.554471 23917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:53.554970 23917 raft_consensus.cc:606] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:53.559106 23991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:16:53.559681 23991 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:53.561010 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:53.562623 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:53.563258 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:53.595818 25087 raft_consensus.cc:993] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:53.596388 25087 raft_consensus.cc:1081] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:53.598192 24061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:16:53.598861 24061 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:53.599233 24061 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.618790 24061 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:53.621767 25212 raft_consensus.cc:993] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:53.646189 25178 raft_consensus.cc:1081] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:53.653141 23991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:16:53.653677 23991 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:53.654021 23991 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.655048 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:53.655640 23919 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.662377 23991 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:53.667817 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:53.665570 23919 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:16:53.668360 23993 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:53.668684 23993 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:53.669044 24034 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:53.666605 24061 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:53.669340 23993 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:53.671175 25229 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:53.671686 25229 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:53.672550 25229 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:53.674316 23993 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:53.675777 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:16:53.676378 24595 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.685283 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:53.685931 23919 raft_consensus.cc:3055] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:53.690850 24598 raft_consensus.cc:1217] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:16:53.686245 23919 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:53.695168 23919 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:53.696308 23919 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.697460 23991 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:16:53.689275 24595 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:53.701001 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:53.702057 25154 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:53.702570 25154 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:53.703449 25154 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:53.718835 23815 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 2 to 3, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 3 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:53.728223 23993 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:16:53.749078 23818 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:53.752956 23919 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:53.875003 25244 raft_consensus.cc:993] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:53.876488 25244 raft_consensus.cc:1081] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:53.881455 25212 raft_consensus.cc:1064] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:53.883879 25212 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:53.889138 23919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "479416b99927471b8600549d94ad4873"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:16:53.889802 23919 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:53.890448 23919 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.910909 24595 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:53.916357 25212 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:53.921761 24061 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:53.924134 23991 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:53.929337 23919 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:53.933074 25057 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:53.934303 23919 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:16:53.937644 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:16:53.938156 24598 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.948518 25057 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:53.955225 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:53.955869 24061 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:53.956239 24061 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:53.957010 24061 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:53.958128 24061 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:53.978591 24598 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:53.979739 23886 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:16:53.980726 25212 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:53.985852 25087 raft_consensus.cc:1064] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:53.988746 25087 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:53.994172 25212 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:53.995105 25244 raft_consensus.cc:993] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:53.995618 25246 raft_consensus.cc:1081] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:53.995235 25212 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:53.999773 24595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37704
I20260709 12:16:54.000331 24595 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:54.000741 24595 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.005581 25140 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.023411 24600 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.039063 23818 catalog_manager.cc:5697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.041514 24061 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:54.047048 24062 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.031927 24595 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:54.065725 24600 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:54.067739 25248 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.069128 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:54.069761 23991 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.070928 23919 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:54.072629 25154 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.077579 24062 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:54.078262 23991 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:54.084259 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:54.085384 25088 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:54.085860 25088 raft_consensus.cc:697] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:54.086694 25088 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:54.079252 25248 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.082054 24595 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:54.097465 23818 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.098634 23991 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:54.100140 25244 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.126500 25087 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:54.138396 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73668.7us
I20260709 12:16:54.153945 23919 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:54.179968 23919 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:54.185151 24600 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:54.196132 25057 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:54.204458 23919 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.214541 25057 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.219792 24600 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:54.241227 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 103524us
I20260709 12:16:54.261699 23818 catalog_manager.cc:5697] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:54.264416 23815 catalog_manager.cc:5697] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.219774 25244 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:16:54.276634 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:54.280395 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2e9a767edf8b423cb0ef561b055f670a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:54.287348 23990 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.289372 24061 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:54.290608 24062 raft_consensus.cc:3055] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:54.290973 24062 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:54.291666 24062 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:54.293149 24062 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:54.300386 25057 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:54.302237 23993 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:54.311815 24061 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.307842 23818 catalog_manager.cc:5697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.337668 24598 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:54.353727 23914 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:54.354346 25057 raft_consensus.cc:1064] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:16:54.356504 25057 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:54.357631 25275 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:54.368333 25277 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:16:54.373106 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 68487.3us
I20260709 12:16:54.374903 24600 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 1 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:54.375138 24598 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.376295 25140 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.377151 24062 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:54.389312 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 2e9a767edf8b423cb0ef561b055f670a with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:54.392135 23991 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:54.403065 23993 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:54.405234 25057 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.421159 24063 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:54.422398 25277 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:54.424082 25284 tablet_replica.cc:333] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:54.425163 25284 raft_consensus.cc:2243] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.425804 25284 raft_consensus.cc:2272] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.435508 24061 raft_consensus.cc:2955] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.443681 25248 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.453361 24066 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:16:54.463099 24063 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.464206 25140 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.466871 23990 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.479622 25284 ts_tablet_manager.cc:1916] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:54.481580 25178 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:54.485523 24599 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.508605 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9661e61546884b0aa0c1e828cd13e76e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:16:54.510687 23817 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.524586 24600 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:16:54.528246 25248 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:54.517848 23818 catalog_manager.cc:5697] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 1 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.529618 24063 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:54.534248 24600 raft_consensus.cc:2955] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:54.540901 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 53321.5us
I20260709 12:16:54.542388 25284 ts_tablet_manager.cc:1929] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:54.542804 25284 log.cc:1199] T 2e9a767edf8b423cb0ef561b055f670a P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/2e9a767edf8b423cb0ef561b055f670a
I20260709 12:16:54.544855 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 2e9a767edf8b423cb0ef561b055f670a (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:54.553859 24061 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:54.556277 25140 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:54.561503 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet 9661e61546884b0aa0c1e828cd13e76e with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45116
I20260709 12:16:54.588826 24061 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:54.590453 25088 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:54.593398 25289 tablet_replica.cc:333] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:16:54.594508 25289 raft_consensus.cc:2243] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:54.594832 24600 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:54.596896 25287 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:54.595144 25289 raft_consensus.cc:2272] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:54.624063 25289 ts_tablet_manager.cc:1916] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:54.637951 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:54.641209 23990 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:54.642647 25088 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:54.665172 25289 ts_tablet_manager.cc:1929] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:16:54.665723 25289 log.cc:1199] T 9661e61546884b0aa0c1e828cd13e76e P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/9661e61546884b0aa0c1e828cd13e76e
I20260709 12:16:54.667568 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet 9661e61546884b0aa0c1e828cd13e76e (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:54.807662 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:16:54.808326 23990 raft_consensus.cc:606] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:54.818192 23917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:54.818858 23917 raft_consensus.cc:606] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:54.821993 23917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:54.822625 23917 raft_consensus.cc:606] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:54.825299 24061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:54.825847 24061 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:54.827844 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:54.829660 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:54.830485 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:54.934767 25140 raft_consensus.cc:993] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:54.935241 25140 raft_consensus.cc:1081] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:54.954413 23990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:16:54.955102 23990 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:54.955534 23990 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.969635 23990 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:54.971868 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:54.972491 23917 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:54.972826 23917 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:54.973505 23917 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:54.974498 23917 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.971254 23990 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:54.985056 23917 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:16:54.985760 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:54.988082 24062 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:54.988817 23960 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:54.989670 25275 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:54.990367 25275 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:54.991195 25275 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:54.996398 24062 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:16:55.005461 25178 raft_consensus.cc:993] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:55.006225 25178 raft_consensus.cc:1081] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:55.008594 24061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57828
I20260709 12:16:55.009091 24061 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:55.009400 24061 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:16:55.020584 23804 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 2 similar messages]
I20260709 12:16:55.019496 24061 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:55.023675 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:55.024204 23916 raft_consensus.cc:3055] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.024487 23916 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:55.025230 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:16:55.025202 23916 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:55.025962 24600 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.026579 23916 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.033233 23916 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:16:55.036557 24600 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:16:55.037724 24035 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:55.038570 25229 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.039060 25229 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:55.039960 25229 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:55.043603 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:55.045111 23990 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.050191 24061 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:16:55.056279 23817 catalog_manager.cc:5697] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 4, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 4 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:55.066458 23804 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 2b80ceeebb5c4f0aaaecd9da202550b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0829ddf18f07439086398756b9c6d216 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:55.057256 23990 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:16:55.072140 23818 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 2 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.147691 25276 raft_consensus.cc:993] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:55.148159 25271 raft_consensus.cc:1081] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:55.149963 23916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:16:55.152654 23916 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:55.153013 23916 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.160815 23916 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:55.168041 23916 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:55.170753 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:55.170811 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:55.171442 23990 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.171521 24061 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:55.171988 24061 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:55.172715 24061 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:55.173715 24061 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:55.180205 23990 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:16:55.184818 24061 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:16:55.190670 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:55.191501 25287 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:55.193156 25287 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:55.194017 25287 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:55.209158 23818 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 3 to 4, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 4 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.213019 25248 raft_consensus.cc:993] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:55.213647 25275 raft_consensus.cc:1081] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:55.222219 24062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:16:55.222806 24062 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:55.223181 24062 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.231163 24062 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:55.233387 24062 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:55.238870 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:55.239437 23990 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.239707 23990 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:55.240765 23990 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:55.246935 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:55.247107 23990 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.257905 23990 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:16:55.258458 23916 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.266896 23916 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:16:55.268016 24036 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:55.270624 25229 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.271198 25229 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:55.272061 25229 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:55.330199 23818 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 1 to 2, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 2 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.431442 23916 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:55.479208 25275 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:55.547107 24595 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:16:55.568971 23993 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:16:55.583824 23916 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:16:55.587443 23991 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:55.590999 25178 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:55.589278 25307 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:55.596097 25310 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:55.626423 24061 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:55.669377 25154 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:55.673704 25276 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:16:55.742213 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44528.6us
I20260709 12:16:55.746949 24063 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:55.765904 23917 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.792229 25276 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:55.816349 25178 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:55.884248 23991 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.885875 25310 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:55.914220 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:55.997196 24063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:55.997931 24063 raft_consensus.cc:606] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:56.000952 23991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:16:56.001475 23991 raft_consensus.cc:606] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:56.005514 23914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:56.006034 23914 raft_consensus.cc:606] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:56.010627 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:56.011811 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:56.012660 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:56.174367 25275 raft_consensus.cc:993] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:56.174929 25275 raft_consensus.cc:1081] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:56.177866 23919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:16:56.178440 23919 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:56.178800 23919 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.185071 23919 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:56.188165 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:16:56.188776 24600 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.189472 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:56.190093 23991 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:56.190687 23991 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:56.191881 23991 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:56.193253 23991 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.195978 24600 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:56.196768 23919 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:16:56.210242 23991 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:56.214020 25180 raft_consensus.cc:993] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:56.223146 25180 raft_consensus.cc:1081] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:56.214375 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:56.227334 25212 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.227814 25212 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:56.229900 25212 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:56.238194 23914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:16:56.238852 23914 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:56.239382 23914 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:16:56.257023 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 58957.9us
W20260709 12:16:56.297886 23806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 65509.8us
I20260709 12:16:56.301342 23914 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:16:56.309613 23806 catalog_manager.cc:4755] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): ChangeConfig:REMOVE_PEER RPC failed for tablet 2b80ceeebb5c4f0aaaecd9da202550b0: Remote error: Service unavailable: leader transfer in progress
I20260709 12:16:56.313326 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:16:56.313922 24598 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.315243 23914 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:16:56.336035 23819 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.363831 24598 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:16:56.369284 24600 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3. Ops: []
W20260709 12:16:56.380682 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 93337.3us
I20260709 12:16:56.386672 25229 consensus_queue.cc:1059] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:16:56.389700 25229 raft_consensus.cc:3055] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:56.390043 25229 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:56.390906 25229 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:56.392279 25229 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.408231 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:56.408850 23991 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.414672 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:56.427255 24061 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:16:56.428864 23991 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:16:56.430430 23887 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:56.431257 25327 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.431742 25327 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:56.432788 25327 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:56.463116 23819 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 3, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.481236 25327 raft_consensus.cc:993] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:56.481812 25178 raft_consensus.cc:1081] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:56.483582 23990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:16:56.484071 23990 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:56.484373 23990 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.491338 23990 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:56.493891 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:56.494417 23914 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:56.494717 23914 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:56.494851 23990 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:56.495452 23914 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:56.496622 23914 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.498538 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:56.499090 24062 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:56.506353 23914 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:16:56.506610 24062 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:16:56.507648 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:56.508425 25154 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:56.508891 25154 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:56.509698 25154 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:56.524410 23819 catalog_manager.cc:5697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 2 to 3, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.787647 24598 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:56.788933 25327 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:56.815618 23990 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:56.820755 25178 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:16:56.921430 23990 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:16:56.925892 24062 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.928809 25154 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:56.936098 25178 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:56.976670 23917 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:56.979377 25341 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:56.981290 24600 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:16:56.983122 25212 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:57.004371 24063 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:16:57.023965 25327 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:57.061944 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:57.148696 23919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:57.149255 23919 raft_consensus.cc:606] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:16:57.152678 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:16:57.153157 23990 raft_consensus.cc:606] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:57.155519 23919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:57.155946 23919 raft_consensus.cc:606] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:57.158628 24061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:57.159119 24061 raft_consensus.cc:606] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:16:57.160383 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:57.161597 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:57.162191 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:57.246948 25229 raft_consensus.cc:993] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:57.247458 25229 raft_consensus.cc:1081] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:16:57.248929 24598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37704
I20260709 12:16:57.249430 24598 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.249758 24598 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.256400 24598 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:57.259852 24598 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:57.261648 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:57.262202 24062 raft_consensus.cc:3055] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.262511 24062 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:57.263255 24062 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:57.264454 24062 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.265651 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:57.266307 23991 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.274958 24062 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:57.276818 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:16:57.277756 25318 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.278512 25318 raft_consensus.cc:697] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:16:57.279337 25318 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:57.292300 23991 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:16:57.301772 23817 catalog_manager.cc:5697] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.332782 25327 raft_consensus.cc:993] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:57.333302 25178 raft_consensus.cc:1081] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:57.335994 24062 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57828
I20260709 12:16:57.336469 24062 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.336774 24062 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.402773 25154 raft_consensus.cc:993] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:57.403280 25154 raft_consensus.cc:1081] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
W20260709 12:16:57.403803 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 61102us
I20260709 12:16:57.411362 23919 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:57.417289 23914 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:16:57.417582 24598 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:16:57.417770 23914 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.418143 23914 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.419024 25178 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:16:57.421896 24061 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:16:57.425282 24062 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:57.426072 23914 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:57.427857 23914 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:57.429311 24062 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:57.430552 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:57.430747 25178 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:16:57.431082 23990 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.432415 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:57.432992 23988 raft_consensus.cc:3055] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.433286 23988 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:57.434038 23988 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:57.435264 23988 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.439682 23990 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:16:57.440828 24036 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:57.441962 25307 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:57.442821 25307 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:57.443758 25307 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:57.444572 23988 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:57.444784 25178 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:57.447229 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:57.433537 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:57.448104 24062 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.458465 25327 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.461647 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2b80ceeebb5c4f0aaaecd9da202550b0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:16:57.465675 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:57.466235 23917 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:57.466535 23917 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:57.467356 23917 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:57.468734 23917 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:57.478777 23917 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:16:57.478555 24598 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:57.509528 24062 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:16:57.531953 23817 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 2 to 3, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 3 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.535858 23818 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 6, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 3 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:16:57.537834 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55012.2us
I20260709 12:16:57.525907 25327 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:57.541090 25327 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:57.569707 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 2b80ceeebb5c4f0aaaecd9da202550b0 with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:37404
I20260709 12:16:57.574949 25355 tablet_replica.cc:333] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:16:57.576431 25355 raft_consensus.cc:2243] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:57.577400 25355 raft_consensus.cc:2272] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:57.583186 23817 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.588574 25355 ts_tablet_manager.cc:1916] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:16:57.591109 24067 raft_consensus.cc:2955] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:16:57.605144 25353 raft_consensus.cc:993] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:57.605666 25353 raft_consensus.cc:1081] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:16:57.608577 23990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:16:57.609099 23990 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:57.609422 23990 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.615865 23990 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:57.619037 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:57.619618 23920 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:57.619962 23920 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:57.620779 23920 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:57.622005 23990 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:57.624236 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:57.624787 24062 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.621896 23920 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:57.639110 24062 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:57.640228 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:57.641335 25341 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:57.641776 25341 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:57.642594 25341 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:57.648286 23920 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:16:57.656236 25355 ts_tablet_manager.cc:1929] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:16:57.656857 25355 log.cc:1199] T 2b80ceeebb5c4f0aaaecd9da202550b0 P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/2b80ceeebb5c4f0aaaecd9da202550b0
I20260709 12:16:57.662796 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 2b80ceeebb5c4f0aaaecd9da202550b0 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:16:57.663702 23817 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.666445 23990 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:57.667842 25184 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:57.695544 24062 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:16:57.697031 25318 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:57.884194 23920 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:57.885654 25307 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:57.900449 23990 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:57.906689 25229 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.056197 24062 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.057317 25327 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.066694 23988 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.068638 25353 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.154148 24062 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.155249 25341 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.171146 23916 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:58.175439 25341 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.238751 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:58.275596 23920 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:16:58.276122 23920 raft_consensus.cc:606] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:16:58.278664 24062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:16:58.279175 24062 raft_consensus.cc:606] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:58.281407 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:16:58.281828 23990 raft_consensus.cc:606] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:16:58.282986 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:16:58.284070 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:58.284621 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:58.477453 25180 raft_consensus.cc:993] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:58.477909 25307 raft_consensus.cc:1081] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:58.479297 23916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:16:58.479820 23916 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.480108 23916 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.485270 23916 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:58.487111 23916 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:16:58.487572 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:58.487861 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:16:58.488193 23990 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.488382 24067 raft_consensus.cc:3055] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:58.488682 24067 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:58.489416 24067 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:58.490586 24067 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.494342 23990 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:16:58.495775 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:58.496626 24067 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:16:58.496659 25327 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:58.507665 25327 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:58.508574 25327 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:58.516606 23818 catalog_manager.cc:5697] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 3, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
W20260709 12:16:58.637027 23867 auto_rebalancer.cc:629] Failed to schedule move for tablet 6869b2949cb848a79c8263a5be455d66: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:16:58.640815 24067 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:58.646894 23919 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:16:58.647197 24035 consensus_peers.cc:597] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: def9be339f8f4adc820a6a1320fec425. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:58.647289 23990 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:16:58.648572 25307 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.649367 25180 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:58.658013 25307 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.661263 23988 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.663805 23916 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.680541 23818 catalog_manager.cc:5697] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 2, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 1 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.696019 25341 raft_consensus.cc:993] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:58.696544 25369 raft_consensus.cc:1081] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:16:58.698253 23920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:16:58.698776 23920 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.699162 23920 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.698868 23916 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:58.706079 23920 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:58.706408 23990 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:16:58.706810 23886 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 10cd478aa7e9411bba254e94713f91de. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:58.707901 24067 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:16:58.709645 23920 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:16:58.709496 25352 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:58.709578 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:58.710719 23990 raft_consensus.cc:3055] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:58.711127 23990 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:16:58.711856 25327 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:58.711985 23990 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:58.713362 23990 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.709570 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:16:58.715425 24598 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:58.724615 23990 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:16:58.724642 24598 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:16:58.725885 23887 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:58.726645 25327 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.730471 25353 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:58.731009 25353 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:58.732122 25353 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:16:58.744474 24067 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.748674 23988 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.750466 23920 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:16:58.757288 25327 raft_consensus.cc:993] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:58.758857 25327 raft_consensus.cc:1081] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:16:58.761216 24067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57828
I20260709 12:16:58.762085 24067 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:58.762501 24067 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.754865 23817 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 3, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.769948 24067 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:58.772653 24067 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:16:58.772688 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:16:58.773638 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:16:58.774422 23990 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.775734 23819 catalog_manager.cc:5697] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 3, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
W20260709 12:16:58.783799 23886 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe5bb4f2e9f04fbb9241a5e24d5ae777. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:58.786332 23990 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:16:58.773623 23916 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:58.790222 23916 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:16:58.791239 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:16:58.791119 23916 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:58.792038 25180 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:58.792479 25180 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:16:58.792558 23916 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:58.793251 25180 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:16:58.795774 24067 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:16:58.799223 23990 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:16:58.799302 25383 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:58.800881 25353 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:58.798960 23916 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:16:58.808780 25383 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.810407 24067 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.823410 23818 catalog_manager.cc:5697] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 2 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.838426 23819 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 5, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 4 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.833613 23988 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index -1 to 5, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:16:58.999504 24067 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:59.000667 25383 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:59.016497 23988 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:59.017977 25383 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:59.190528 24598 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:16:59.214566 25327 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:16:59.342730 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:59.490157 25395 ts_tablet_manager.cc:933] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
W20260709 12:16:59.550813 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 68456.1us
I20260709 12:16:59.556043 25395 tablet_copy_client.cc:323] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:16:59.756114 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 10cd478aa7e9411bba254e94713f91de from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:16:59.756659 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 10cd478aa7e9411bba254e94713f91de from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-10cd478aa7e9411bba254e94713f91de
I20260709 12:16:59.765537 23930 tablet_copy_source_session.cc:215] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:16:59.860987 25396 ts_tablet_manager.cc:933] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:17:00.043329 25396 tablet_copy_client.cc:323] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
W20260709 12:17:00.564555 23887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.024s	sys 0.027s
W20260709 12:17:00.569674 23887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.024s	sys 0.027s
I20260709 12:17:00.327219 25405 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.572894 25407 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:00.617690 25406 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.629806 25406 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.626612 25398 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.632375 25398 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.620921 25407 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.613489 25405 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:00.656860 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1540) took 1485 ms. Trace:
W20260709 12:17:00.670437 23961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.022s	sys 0.022s
W20260709 12:17:00.670830 23961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.022s	sys 0.022s
I20260709 12:17:00.692420 25418 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.692932 25410 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.693030 25418 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.693506 25410 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.696715 25414 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:00.673264 25408 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.662554 23988 rpcz_store.cc:276] 0709 12:16:59.171799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:00.654035 (+1482236us) service_pool.cc:224] Handling call
0709 12:17:00.656320 (+  2285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:00.656511 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:00.656541 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:00.656575 (+    34us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:00.656602 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:00.656653 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:00.656771 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:00.697252 25414 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.698756 25409 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:17:00.699146 24600 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 1.394s	user 0.041s	sys 0.050s
W20260709 12:17:00.701169 24600 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 1.396s	user 0.041s	sys 0.050s
I20260709 12:17:00.698836 25422 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.706060 25420 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:00.706496 25398 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.707662 25398 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:00.706692 25420 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.708216 25406 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.708127 25398 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.709596 25406 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:00.709800 25420 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.710448 25412 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.710837 25407 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.713291 25398 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.716842 25405 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.716924 25419 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.711400 25407 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:00.711516 25418 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.710933 25412 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.710120 25406 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.717509 25419 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.702220 25408 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.739878 25412 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.739979 25408 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.740216 25327 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.740434 25412 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.740624 25415 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.733016 25398 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.740752 25327 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.703531 25409 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.743472 25414 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:00.734202 25405 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.744113 25409 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:00.744342 25405 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.746194 25406 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.741374 25398 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.752277 25405 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.753798 25403 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.754300 25405 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:00.741173 25415 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.715095 25422 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.737910 25418 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.754839 25405 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.766813 25413 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.772028 25428 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.778502 25406 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:00.774005 25429 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.742118 25407 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.784674 25419 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.785254 25419 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.785727 25419 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.787446 25424 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.787569 25407 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.788090 25398 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.762233 25410 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:00.790864 24598 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.014s	sys 0.011s
I20260709 12:17:00.794785 25415 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:00.754382 25403 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:00.792272 24598 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.015s	sys 0.011s
I20260709 12:17:00.755846 25412 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.783686 25422 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.813197 25415 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.813369 25405 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.813472 25422 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.783319 25413 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.779631 25418 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.791122 25429 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.786792 25406 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.813755 25415 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.787931 25424 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.814062 25422 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.857606 25425 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.818727 25405 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.807713 25410 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.929430 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:00.919570 25409 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.930668 25431 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.916103 25398 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.948366 25415 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.933548 25414 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:00.948530 25398 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:00.949280 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.398s	user 0.002s	sys 0.010s
W20260709 12:17:00.949767 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.398s	user 0.002s	sys 0.010s
I20260709 12:17:00.949342 25414 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.806463 25428 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:00.951606 25414 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.945755 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 299) took 1376 ms. Trace:
I20260709 12:17:00.940152 25408 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:00.946743 25411 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:00.926894 25407 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.958609 25424 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.959126 25428 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.966684 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:00.953927 24598 rpcz_store.cc:276] 0709 12:16:59.569843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.570825 (+   982us) service_pool.cc:224] Handling call
0709 12:16:59.571183 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:16:59.571425 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:00.808126 (+1236701us) log.cc:844] Serialized 14 byte log entry
0709 12:17:00.945398 (+137272us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:00.945451 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:00.945497 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:00.945559 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:00.945665 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":994662,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":92015,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"thread_start_us":1310775,"threads_started":3,"wal-append.queue_time_us":121980}
I20260709 12:17:00.984423 25418 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.953037 25410 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.987953 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:00.989543 25435 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.988827 25414 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.956353 25419 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.941443 25405 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.956670 25327 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:00.991459 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60140.8us
I20260709 12:17:01.002116 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:00.981794 25426 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.982245 25415 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:00.970456 25428 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:00.982023 25433 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:00.963948 25408 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:00.982419 25432 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:00.981331 25429 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.956955 25409 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.010190 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:00.990041 25435 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:00.969622 25407 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.015494 23991 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:17:00.998970 25414 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.020658 25414 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:01.022111 25422 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:00.965165 25431 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.008870 25428 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.018329 25416 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:00.990674 25411 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:01.018909 23942 debug-util.cc:398] Leaking SignalData structure 0x7b08000caaa0 after lost signal to thread 22723
I20260709 12:17:01.006016 25412 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:00.960968 25425 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:01.014992 25403 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.031970 25409 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:01.032708 25405 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.023300 25415 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.040318 23990 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:01.006834 25426 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.039503 25416 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.017520 25413 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.008513 25433 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.058945 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.064046 25433 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.070633 25438 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.051375 25383 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:01.067934 23942 debug-util.cc:398] Leaking SignalData structure 0x7b08001728e0 after lost signal to thread 23853
I20260709 12:17:01.066710 25415 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.077139 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.079106 25426 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.080719 25416 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.081511 25440 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:01.184893 23991 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:17:01.193315 25411 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:01.075024 25406 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.023407 25432 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.191601 25405 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:01.215597 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.660s	user 0.006s	sys 0.001s
I20260709 12:17:01.217080 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.219485 23993 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:17:01.211790 25410 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.071278 25438 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.192710 25383 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.233049 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:01.229292 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.678s	user 0.007s	sys 0.001s
I20260709 12:17:01.213220 25440 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.256036 25440 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.236714 25426 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.270998 25431 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:01.272585 25435 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.274539 25406 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.275177 25407 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.278666 25327 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.241384 25405 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.311839 25423 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.313892 25327 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.317691 25432 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:01.320057 23942 debug-util.cc:398] Leaking SignalData structure 0x7b08002de4a0 after lost signal to thread 23945
I20260709 12:17:01.277035 25408 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.276685 25441 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:01.286805 25410 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.320111 25327 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:01.322340 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 317794us
I20260709 12:17:01.288275 25440 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:01.318374 25423 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.310494 25428 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.276712 25406 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.337730 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.338294 23919 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:17:01.335646 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.336293 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.339210 23920 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
W20260709 12:17:01.336977 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 105842us
I20260709 12:17:01.337056 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.330353 25439 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.337512 25410 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.341861 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.342736 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.349535 23991 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:17:01.342994 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.350634 23993 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:01.366328 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.366920 23916 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:17:01.286583 25426 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.368880 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.368933 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.345403 25410 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.374677 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.376488 23916 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:17:01.321430 25441 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.343664 25439 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.339800 25440 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.381460 25425 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:01.473483 25445 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.673864 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.565917 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.662566 25410 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.663546 25444 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.475701 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.675596 25410 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.488804 25406 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.583269 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.676559 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.487941 25405 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.677564 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.677785 25410 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:01.638532 23942 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff5c0 after lost signal to thread 24020
I20260709 12:17:01.678778 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.675701 25444 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.676221 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.709190 25451 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:01.679073 25440 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:01.679553 23942 debug-util.cc:398] Leaking SignalData structure 0x7b0800059c20 after lost signal to thread 24094
I20260709 12:17:01.711333 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:01.711750 23942 debug-util.cc:398] Leaking SignalData structure 0x7b0800292ac0 after lost signal to thread 24624
I20260709 12:17:01.500100 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.726483 25416 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:01.727448 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.727248 25416 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:01.728109 23918 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:01.561131 25426 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.435081 25415 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.561843 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.730623 25415 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.730105 25416 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.440145 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.565734 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.486793 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.582979 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.682898 25441 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:01.535423 25438 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.742251 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.592316 25395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10cd478aa7e9411bba254e94713f91de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:01.748384 23819 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39282 (request call id 301) took 2157 ms. Trace:
I20260709 12:17:01.672533 25398 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.754061 23991 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:01.382777 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.490688 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.487639 25423 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.529917 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.566376 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.475265 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.622406 25442 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.528738 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.433698 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.443018 25383 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.486716 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.475421 25447 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:01.799053 24063 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:01.800205 23913 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:01.457902 25436 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.671654 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.490249 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.755081 25406 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.502640 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.456108 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.441186 25432 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.695508 25443 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.490949 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.806681 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.555385 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.474092 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.697786 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.570729 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.674659 25445 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.709800 25451 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.801435 25424 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.824620 24595 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:01.730913 24599 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:01.682596 25439 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.486513 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.748189 25415 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.752034 24596 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:01.752823 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.748764 23819 rpcz_store.cc:276] 0709 12:16:59.567914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.568090 (+   176us) service_pool.cc:224] Handling call
0709 12:17:01.078762 (+1510672us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b5400180510. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2e0b2 00007f75c6aa7759 00007f75c6a3fa76 00007f75c6a10d58 00007f75c6b0f04e 00007f75c4fd02a4 00007f75c4fd0232 00007f75c4fd0161 00007f75c4fd00dc
0709 12:17:01.725555 (+646793us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":13462912}
I20260709 12:17:01.768340 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.755550 23916 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
W20260709 12:17:01.777906 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 72897.3us
I20260709 12:17:01.764354 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:01.780230 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 106421us
W20260709 12:17:01.789732 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 413822us
I20260709 12:17:01.827010 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.848774 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.849637 23886 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:01.796365 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.850469 25423 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.850901 25423 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.851257 25423 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.854910 25418 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:01.767213 25369 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.855376 25418 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.503357 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:01.856649 23919 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:01.800690 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.691167 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.800177 25447 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.761595 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.806669 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.809837 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.810484 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.803278 23912 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:01.812227 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.877760 25439 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:01.824417 25424 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.802565 24062 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:01.819193 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.817310 25432 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:01.762014 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.795794 25420 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.792827 25438 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.819947 25443 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.723093 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.798833 25410 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:01.798549 25442 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.826910 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.831705 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.791533 23914 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:01.847620 25450 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:01.880764 25411 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:01.851106 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.796995 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.849927 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.855670 25369 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.863359 25418 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.864277 25426 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.866801 23960 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:01.916783 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 50107.4us
I20260709 12:17:01.917090 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.917665 23960 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.917742 23991 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:01.868767 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.863242 25444 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.813613 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.859498 23886 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:01.881814 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.881553 24067 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:01.877998 25447 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.806699 25436 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.887822 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.922300 23960 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.922904 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.892987 25445 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.889500 25420 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.899318 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.900444 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.885171 25432 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.925192 24036 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.925994 23960 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.883826 25424 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.847741 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.907601 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.908010 25443 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.882524 25415 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.878319 25451 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:01.878393 25439 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.914616 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.908524 25450 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.921237 25428 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.921393 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.924952 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:01.925433 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 66006.8us
I20260709 12:17:01.825891 25406 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.934790 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.945955 25436 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.946501 25395 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37708 (request call id 294) took 2682 ms. Trace:
I20260709 12:17:01.946655 25406 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.928189 25413 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.947502 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.947764 25413 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.933315 25417 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.948190 25413 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.948412 25417 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:01.948890 25417 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.928488 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.891635 25438 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.958998 24600 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:17:01.959993 25438 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.944561 25428 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.960940 25428 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.935712 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:01.935881 25448 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.924607 25426 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.936288 25415 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:01.939652 24067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:17:01.968492 24067 raft_consensus.cc:606] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:01.940021 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.932474 25433 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.924407 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:01.928884 25405 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.969930 25439 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:01.970427 25405 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:01.971068 25405 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.958997 25414 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:01.971606 25414 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:01.971987 25414 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:01.972594 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.926805 25408 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.915436 25411 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:01.930220 25430 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:01.949606 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:01.946899 25395 rpcz_store.cc:276] 0709 12:16:59.261367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.261540 (+   173us) service_pool.cc:224] Handling call
0709 12:16:59.490756 (+229216us) ts_tablet_manager.cc:934] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
0709 12:17:01.590965 (+2100209us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:01.801032 (+210067us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:01.811850 (+ 10818us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:01.897996 (+ 86146us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:01.909058 (+ 11062us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:01.934838 (+ 25780us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:01.938534 (+  3696us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":301,"tablet-copy.queue_time_us":227996,"thread_start_us":300477,"threads_started":2}
I20260709 12:17:01.976502 25395 tablet_copy_client.cc:806] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:01.976539 25442 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:01.977151 25395 tablet_copy_client.cc:670] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:01.953331 25369 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:01.909150 25410 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:01.949698 23960 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.963165 24036 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:01.944703 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:01.989388 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44768.7us
I20260709 12:17:01.936271 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:01.965382 25448 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:01.973198 23988 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:01.995385 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:02.011256 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 61618.1us
I20260709 12:17:01.972971 25433 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:01.974318 25408 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:01.975428 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.016966 23995 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:02.018647 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.022876 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.017652 25448 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:01.989454 25430 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:02.018201 25439 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:02.034549 25439 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:02.035064 25439 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.017756 25438 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.021845 25433 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.018863 25444 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.021720 25408 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.048285 25450 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.036676 25430 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:02.061857 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 112321us
I20260709 12:17:02.065120 23991 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:02.051884 25444 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:02.069393 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.071066 25444 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.063872 23960 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:02.071903 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.064127 25418 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:02.081187 25424 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.084702 25426 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.085429 25423 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.105199 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.087381 25413 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.087972 25405 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.075379 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:02.071838 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.101312 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.102761 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.109189 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.089501 25369 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:02.112596 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.112920 25369 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:02.113343 25369 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.093660 25415 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.114858 23990 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 2: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:02.093955 25418 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:02.111301 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.111729 23993 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.111794 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.115152 23960 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:02.107981 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.120579 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.121117 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.128114 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.121206 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.122117 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.123154 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.134320 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:02.125638 25444 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.115721 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.119784 25426 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.126556 25418 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.140389 25454 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:02.140919 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.166823 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.131451 25410 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:02.135895 25416 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.187906 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.137072 25426 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:02.204107 25426 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.189791 25428 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.191280 25433 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.195987 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.140969 25454 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.198170 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.136273 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.138751 25406 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:02.143090 25427 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.223899 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.227247 25433 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.228570 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.228843 25428 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:02.229314 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 92612.4us
I20260709 12:17:02.245092 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.247030 23988 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:02.247607 23962 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.255295 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.256275 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.257624 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.258877 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:02.206197 25410 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:02.264111 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.264322 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.264909 25423 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.265482 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.250505 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.230170 25444 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.240713 25413 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:02.304540 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.304762 23988 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:02.304766 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 172209us
I20260709 12:17:02.245893 25406 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.261348 25424 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:02.311615 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:02.261795 25427 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:02.267297 25410 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:02.302096 25428 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.325299 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:02.325912 23920 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.320254 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:02.326642 23916 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:02.320991 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:02.307868 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:02.329063 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:02.330379 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:02.331487 23917 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.332199 23916 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.317777 25427 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.330941 23912 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:02.339421 25455 ts_tablet_manager.cc:933] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:02.319908 25410 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.340526 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:02.382575 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:02.383252 23912 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:02.385757 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 145498us
I20260709 12:17:02.388831 23961 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:02.379559 25414 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.377245 25405 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:02.410485 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 162937us
I20260709 12:17:02.414034 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:02.418387 25444 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:02.414462 25435 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.431109 25450 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:02.431646 25450 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.433666 25450 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.460287 25415 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:02.460848 25415 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.483268 25420 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.492385 25454 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.493415 25411 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.449574 25450 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:02.495767 23962 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.496986 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.500140 25414 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:02.500370 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 591740us
I20260709 12:17:02.501276 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:02.502138 25450 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.504081 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:02.504539 23991 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.507419 23990 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:02.509006 23917 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:02.525106 23962 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.527870 24035 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:02.529613 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:02.541239 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:02.555812 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:02.542063 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:02.507301 25461 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.562459 24035 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:02.544821 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.526408 25454 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:02.559922 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:02.581003 23921 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.560550 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:02.560875 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:02.526575 25416 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.560601 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.583715 24061 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:02.548965 25406 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:02.557096 25457 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:02.562106 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.568581 23916 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:02.570605 25423 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:02.571276 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 67258.8us
I20260709 12:17:02.561806 23920 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:02.593956 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:02.562481 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 146444us
I20260709 12:17:02.564181 25409 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.595793 23961 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.595748 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:02.550159 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 134525us
I20260709 12:17:02.596885 25420 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:02.597592 25415 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.597379 25420 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.593190 25423 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:02.598449 25423 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.599392 23912 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
W20260709 12:17:02.602825 25439 consensus_meta.cc:287] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.005s
I20260709 12:17:02.603289 25439 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:02.583799 25408 consensus_meta.cc:287] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.006s
I20260709 12:17:02.605302 25439 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.605926 25459 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:02.582203 25454 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:02.606360 25459 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:02.611521 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.581720 25463 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.613603 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.618588 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.620983 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:02.625430 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:02.591056 25411 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:02.626477 23930 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:17:02.628281 23961 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.629509 23961 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:02.625936 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 58220.2us
I20260709 12:17:02.632891 25442 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.633594 25442 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.634433 25433 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.634800 25433 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:02.635154 25433 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.636766 25418 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.638978 25428 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.641163 23960 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.632777 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:02.627293 23930 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-fe5bb4f2e9f04fbb9241a5e24d5ae777
I20260709 12:17:02.643208 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.651826 25424 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.652355 24070 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:02.652912 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.638103 25426 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:02.611697 25432 consensus_meta.cc:287] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.682s	user 0.017s	sys 0.003s
I20260709 12:17:02.655803 23962 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:02.656361 23961 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.622815 25459 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:02.618055 25454 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.659444 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.599418 25420 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.627559 25413 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.617429 25407 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.650322 25460 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:02.645915 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:02.659956 23960 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:02.627015 25411 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:02.656385 25448 consensus_meta.cc:287] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.626s	user 0.005s	sys 0.008s
W20260709 12:17:02.665289 25430 consensus_meta.cc:287] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.005s
I20260709 12:17:02.675454 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:02.662743 25424 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.612155 25408 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.666836 23917 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:02.661633 25455 tablet_copy_client.cc:323] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:17:02.662461 25428 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.664605 25457 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.663933 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.668850 25407 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:02.669740 25460 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:02.679061 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:02.682749 23921 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:02.669171 25413 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:02.701783 25413 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.645608 25410 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.702562 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.703763 25460 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.686695 25464 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:17:02.688529 25423 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.689401 25426 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:02.691926 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.712826 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:02.693346 25415 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:02.679790 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:02.660117 25432 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.706108 23993 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:02.679352 25463 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.679987 25424 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:02.674190 25448 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.684396 25411 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.704639 25407 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.714658 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.707259 25457 raft_consensus.cc:697] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:02.721349 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:02.717317 23916 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:02.719868 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:02.713892 25409 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:02.679585 25430 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:02.724766 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:02.748126 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:02.716459 25447 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.713003 25418 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.749027 23921 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 2: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:02.722481 25450 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.752168 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.723496 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:02.747011 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:02.723488 25445 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:02.726426 25438 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.718487 25424 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.761940 25445 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:02.767151 23930 tablet_copy_source_session.cc:215] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:02.767351 25465 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:02.767921 25465 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.771555 23990 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.774223 24064 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.779090 25456 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.779443 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.779680 25456 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:02.775161 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:02.782153 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:02.782949 25383 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:02.783188 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.783344 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:02.783779 24063 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:02.784421 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.765511 25436 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.786751 24065 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:02.782960 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:02.766237 25439 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:02.792389 25439 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:02.792786 25439 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.801163 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:02.805267 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:02.806067 23987 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:02.741677 25463 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:02.808670 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:02.720312 25415 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.769274 25445 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:02.814754 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:02.816279 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "479416b99927471b8600549d94ad4873"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:17:02.822353 25423 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.822834 25457 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.824579 25448 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.825702 24564 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:02.813886 25463 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.829648 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:02.831744 25410 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:02.832427 25427 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.785967 25459 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:02.837258 23921 raft_consensus.cc:606] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.841253 24564 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:02.897053 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 237137us
W20260709 12:17:02.898202 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 56986.4us
I20260709 12:17:02.898203 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.787531 25465 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.842558 25436 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.845943 25408 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.842979 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:02.849888 25417 consensus_meta.cc:287] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.870s	user 0.014s	sys 0.008s
I20260709 12:17:02.899797 23960 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:02.881847 25407 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:02.904753 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 61843.3us
I20260709 12:17:02.724563 25411 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:17:02.842348 25456 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.908386 23960 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:02.915342 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:02.915671 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 161816us
I20260709 12:17:02.915974 23914 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:02.916195 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:02.916744 23919 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:02.914438 25463 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.908334 23912 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:02.853183 25433 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:02.904088 25426 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.905608 25465 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.930966 23917 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:02.913645 25410 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:02.934155 25467 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:02.919402 25436 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:02.940798 23919 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:02.924851 25468 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:02.938715 25432 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:02.934763 25467 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.943749 25410 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:02.908643 25417 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.967269 25420 raft_consensus.cc:993] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:17:02.973232 25427 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:02.974116 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 74942.8us
I20260709 12:17:02.967080 25410 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:02.976550 25369 consensus_meta.cc:287] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.863s	user 0.015s	sys 0.002s
I20260709 12:17:02.976962 25369 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.977979 23995 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.983134 23914 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:02.986227 24062 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:02.968065 25468 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:02.974260 25426 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:02.989897 25433 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:02.992931 25369 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:02.993443 25424 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:02.980948 25432 raft_consensus.cc:1081] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:17:03.017575 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:03.020385 25420 consensus_queue.cc:1059] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:03.020605 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:03.022163 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:03.022476 25424 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.023429 25426 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.024791 25413 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.026341 25408 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:03.027300 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:03.029151 25439 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.030212 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:03.030802 25459 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:02.978714 25467 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:03.034404 23992 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:02.993822 25468 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:03.087792 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 248399us
I20260709 12:17:02.994077 25438 consensus_queue.cc:1059] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:17:03.011531 25460 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.094002 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.095840 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.097764 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.034574 25430 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.100602 25406 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.033967 25431 consensus_queue.cc:1059] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.057s
I20260709 12:17:03.104429 25409 raft_consensus.cc:3055] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:03.141191 25409 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.141876 25417 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:03.142172 25409 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.143368 25439 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:03.144673 25413 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.104591 25460 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:03.146203 25407 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:03.147404 25447 raft_consensus.cc:3055] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:03.108389 23987 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37420
I20260709 12:17:03.148625 23987 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:03.148995 23987 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.033785 25414 consensus_queue.cc:1059] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:17:03.103374 25418 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.143411 25415 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:03.152801 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:03.153990 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:03.171509 25431 raft_consensus.cc:3055] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:03.171958 25431 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.172710 25431 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.173825 25431 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:03.174978 25454 consensus_meta.cc:287] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.002s
I20260709 12:17:03.175415 25454 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.177441 25454 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.178431 25469 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.147768 25447 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:03.188719 25447 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.189919 25447 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.191934 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:03.196700 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:03.198999 25478 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:03.202144 23988 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.204883 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.200824 25411 raft_consensus.cc:3055] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:03.204641 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.202363 25415 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:03.207044 25463 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.210059 25472 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:03.217774 25415 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:03.218760 25472 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.201763 25445 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.207465 25411 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.199570 25478 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.228621 25472 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.230613 25418 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:03.246695 25418 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.238734 25471 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:03.239046 24593 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.250489 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:03.240010 25445 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.240206 25467 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:03.241402 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1561) took 1178 ms. Trace:
I20260709 12:17:03.252555 25467 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.220086 25415 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.249209 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:03.252187 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:03.255385 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:03.255731 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:03.256021 25469 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:03.252660 23995 rpcz_store.cc:276] 0709 12:17:02.062938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.065078 (+  2140us) service_pool.cc:224] Handling call
0709 12:17:02.076919 (+ 11841us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:02.978380 (+901461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:03.241036 (+262656us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54000681d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:03.241278 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2071767936}
W20260709 12:17:03.261620 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.259630 25469 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.257045 25471 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:03.266458 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.570s (SENT) [suppressed 1 similar messages]
I20260709 12:17:03.270463 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:03.273648 23990 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.256407 25467 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.284228 25414 consensus_queue.cc:1059] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:03.277329 25432 consensus_queue.cc:1059] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:17:03.286032 25432 consensus_queue.cc:1243] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer ef0dd15ac654478b8371c22b8909240e log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:03.285421 25414 raft_consensus.cc:3055] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:03.288359 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:03.286772 25448 raft_consensus.cc:3055] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:03.290263 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:03.290557 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:03.290236 25448 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.291829 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:03.292291 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:03.294055 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 313973us
I20260709 12:17:03.295361 24564 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.297533 24564 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.299183 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.300597 23917 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.298760 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.301909 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.299913 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.308502 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.309252 23916 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.312332 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.292083 25448 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.265772 25415 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.323130 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:03.324326 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:03.324788 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.327431 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.321115 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:03.328034 23913 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.287488 25414 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.296181 25467 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.345366 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.349603 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.350293 23918 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.351428 25460 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:03.351930 25460 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:03.343956 23819 catalog_manager.cc:5697] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:03.352771 25460 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.321332 25445 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.321188 25472 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.326666 25438 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.290647 25471 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.364880 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:03.366791 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 269099us
I20260709 12:17:03.369269 25396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:03.367719 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.345799 25465 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:03.372359 23962 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.355165 25409 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.373708 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.342747 25478 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.375957 25465 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.376947 25454 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.378860 25407 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.373687 25415 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.376708 25448 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.375036 25418 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.370354 25424 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:17:03.398149 25464 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:17:03.388126 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.410755 25482 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:03.413192 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.391036 23961 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:03.387681 25430 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.415771 23916 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:03.417289 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.389559 25414 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.376420 25411 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:03.424067 25411 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.396742 25466 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.425530 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.390231 25465 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.430538 25465 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:03.415673 25454 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.420181 25418 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.411393 25482 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.441222 25482 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:03.446812 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.011s	sys 0.095s
I20260709 12:17:03.440239 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:03.445254 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 178795us
W20260709 12:17:03.447474 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.011s	sys 0.096s
W20260709 12:17:03.447789 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 531229us
I20260709 12:17:03.449322 25471 consensus_queue.cc:1059] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:03.450749 25471 raft_consensus.cc:3055] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:03.428977 25407 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.451045 25471 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:03.455369 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.447077 23918 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:03.446262 25414 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:03.457374 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 92104.2us
I20260709 12:17:03.456449 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:03.459013 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 86724us
I20260709 12:17:03.459643 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.459599 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.458307 25454 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.434639 25469 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.456610 25383 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.475116 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.475881 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:03.476267 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:03.482668 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.485383 23916 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.477610 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet def9be339f8f4adc820a6a1320fec425 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:17:03.486958 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet def9be339f8f4adc820a6a1320fec425 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-def9be339f8f4adc820a6a1320fec425
I20260709 12:17:03.487089 23918 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.477799 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:03.491304 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 101187us
I20260709 12:17:03.463770 25442 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.463645 25406 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.497421 23916 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.499197 23918 raft_consensus.cc:1240] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.467724 25426 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:03.507463 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 46573.7us
I20260709 12:17:03.508836 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.509750 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.514647 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:03.516072 23995 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:03.518990 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:03.519568 23992 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:03.491449 25454 raft_consensus.cc:2764] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
W20260709 12:17:03.537698 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:03.538262 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.494858 25478 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.479817 25469 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.542394 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.546703 23916 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:03.548187 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.500357 25484 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:03.550128 23914 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.547230 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.544804 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:03.523684 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.495016 25466 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:03.553419 25466 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.554641 24594 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:03.554826 23912 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.558461 25426 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:03.558910 25456 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:03.559019 25426 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.559516 25456 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.561592 25456 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.563136 25426 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:03.563983 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.564416 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.565237 23915 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:03.565519 23917 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:03.566039 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.566628 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.566725 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.567849 23915 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:03.567986 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.571964 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:03.572753 24069 raft_consensus.cc:2393] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 2: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:03.573679 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:03.575657 23919 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.578377 24062 raft_consensus.cc:2393] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 2: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:03.578630 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.582695 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.583104 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.583901 23919 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:03.562134 25456 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:17:03.587025 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:03.588727 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.585903 25445 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.474395 25471 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:03.595729 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 137942us
I20260709 12:17:03.595841 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.598351 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.599301 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.600075 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:03.619388 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:03.633752 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.634308 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:03.635716 23960 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.636835 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.637051 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.649108 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.652617 24063 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.655668 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.657687 23960 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.659204 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.660380 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.610016 24592 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.606986 23913 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
W20260709 12:17:03.657192 25476 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.375s	user 0.007s	sys 0.000s
I20260709 12:17:03.667243 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.654942 25477 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:03.673036 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.657466 25484 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:03.639437 23987 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.692414 23919 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:03.709076 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 99597.7us
I20260709 12:17:03.700229 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.710500 24066 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.712085 24064 raft_consensus.cc:2410] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:03.668625 25369 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.723992 23992 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:03.674139 25410 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.724562 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.711279 25477 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:03.728358 23988 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 3. Ops: []
I20260709 12:17:03.712085 25423 raft_consensus.cc:2764] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:03.710562 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.733852 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.732316 25461 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.735359 25439 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:03.735756 25439 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.736672 25439 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.737649 25447 consensus_queue.cc:1059] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:03.737982 25439 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.738698 25447 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:03.732100 25492 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.742415 23987 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:03.742997 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:03.690414 25468 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:17:03.756438 24063 raft_consensus.cc:3055] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:03.756924 24063 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.754205 25447 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:03.757936 24063 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.759125 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.746939 24062 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.747750 25477 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:03.754637 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:03.759193 25447 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.714628 25484 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:03.782953 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.759433 24063 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.772776 25457 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:03.764659 25396 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37708 (request call id 295) took 4459 ms. Trace:
I20260709 12:17:03.776643 25458 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:03.777439 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.778728 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:03.796442 25492 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.797026 25438 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:03.794512 25396 rpcz_store.cc:276] 0709 12:16:59.304975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.305122 (+   147us) service_pool.cc:224] Handling call
0709 12:16:59.861589 (+556467us) ts_tablet_manager.cc:934] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
0709 12:17:03.321251 (+3459662us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:03.587334 (+266083us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:03.587470 (+   136us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:03.763960 (+176490us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:03.764229 (+   269us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:03.764522 (+   293us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:03.764583 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":319,"tablet-copy.queue_time_us":555314,"thread_start_us":1561347,"threads_started":2}
I20260709 12:17:03.798084 25492 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:03.798491 25492 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:03.799381 25492 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.802331 24068 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:03.804864 24079 tablet_copy_source_session.cc:215] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:03.804993 25436 consensus_queue.cc:1059] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:03.806005 25472 raft_consensus.cc:3055] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:03.806373 25472 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:03.807160 25472 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.808418 25472 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.808559 25471 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.781361 25484 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:03.779793 25473 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:03.785097 23914 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.785377 23916 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:03.782027 25439 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:17:03.786597 23912 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.786957 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:03.823398 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.787489 23960 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:03.783941 25457 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:03.794214 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:03.815773 24063 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:03.772555 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.786597 23921 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:03.765261 25410 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.838533 23914 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:03.842932 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.798262 25396 tablet_copy_client.cc:806] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:03.844341 25492 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.845593 23915 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:03.849766 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:03.858841 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.843931 24593 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:17:03.868288 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.842123 25483 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:03.825017 25473 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:03.848170 25447 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.864969 25396 tablet_copy_client.cc:670] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
W20260709 12:17:03.881109 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.862598 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:03.847925 25413 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:17:03.845583 25426 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:17:03.850360 25428 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:17:03.877977 25473 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.877854 25442 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:03.881999 25369 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.883234 25424 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:17:03.917477 25456 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:03.918174 25467 raft_consensus.cc:3055] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:03.918735 25467 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:03.903816 25435 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:17:03.919872 25467 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.930816 25467 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.935093 24066 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:03.909631 25442 raft_consensus.cc:697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:03.901826 25430 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:17:03.951406 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.955304 25455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet def9be339f8f4adc820a6a1320fec425. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:03.966750 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:03.967571 25457 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:03.968693 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:03.969002 25457 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:03.983455 25473 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:03.987097 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:03.987814 23988 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:03.995656 23988 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:03.998683 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:03.999727 25472 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:04.004592 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.011253 25472 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:04.012348 25472 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:04.012938 24593 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:04.016805 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.016296 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.021690 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.021786 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.007398 25473 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:04.034220 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.048691 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.037235 23913 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:04.049737 23914 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:04.064289 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.064409 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.072387 24592 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:04.031208 25442 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:04.080250 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.078416 25430 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 12:17:04.091032 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.097579 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.098623 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:04.118777 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.133247 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.135185 23988 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.108256 25468 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:04.138481 24068 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.139532 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:04.139874 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:04.142623 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:04.143512 23991 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:04.144539 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:04.114625 25484 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:17:04.136584 25483 raft_consensus.cc:697] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:04.147099 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.181398 23916 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:04.181629 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:04.187429 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:04.161966 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.190243 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:04.184603 23989 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:04.174641 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:04.196902 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.155392 25447 consensus_queue.cc:1059] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:17:04.174525 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:04.171259 25489 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:17:04.160429 25468 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:04.192934 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:04.184823 25395 tablet_copy_client.cc:538] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:04.166517 25448 consensus_queue.cc:1059] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:17:04.226877 23917 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:04.169159 25467 consensus_queue.cc:1059] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:17:04.191972 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:04.220024 23994 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.220285 25439 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.245265 23918 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 2: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:17:04.361685 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 168809us
I20260709 12:17:04.363850 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:04.276234 25497 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:17:04.365938 24034 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:04.378985 24069 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:04.249238 25433 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.119s
I20260709 12:17:04.379416 24069 pending_rounds.cc:85] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 1
I20260709 12:17:04.383883 24069 pending_rounds.cc:107] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:04.392549 24069 raft_consensus.cc:2889] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:04.401234 24065 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:04.401628 25431 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:04.376291 25483 consensus_queue.cc:237] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:04.408948 25459 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:04.411329 25501 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:04.411908 24065 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:04.414623 25468 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:04.416477 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.421023 25468 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:17:04.425204 25498 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:17:04.432307 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:04.432749 25472 raft_consensus.cc:3055] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:04.433096 25472 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:04.447657 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:04.448704 24069 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 2: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:04.458935 25504 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:17:04.433984 25472 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:04.469615 25472 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.457353 25512 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.477483 25512 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.485275 25455 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37704 (request call id 612) took 2455 ms. Trace:
I20260709 12:17:04.485869 25455 rpcz_store.cc:276] 0709 12:17:02.030108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:02.030223 (+   115us) service_pool.cc:224] Handling call
0709 12:17:02.323398 (+293175us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2e1a2 00007f75c6a6f889 00007f75c5ba0d88 00007f75c5c64a07 00007f75c5c96f4e 00007f75c5c7bfdd 00007f75c5c7bf89 00007f75c5c7bf19 00007f75c5c7bee1
0709 12:17:02.339891 (+ 16493us) ts_tablet_manager.cc:934] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
0709 12:17:03.840433 (+1500542us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:04.069382 (+228949us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:04.069526 (+   144us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:04.447815 (+378289us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:04.463698 (+ 15883us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:04.482900 (+ 19202us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:04.485186 (+  2286us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":66148,"spinlock_wait_cycles":12410112,"tablet-copy.queue_time_us":80469,"thread_start_us":227058,"threads_started":2}
I20260709 12:17:04.489424 23994 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:04.490559 25455 tablet_copy_client.cc:806] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:04.491266 25455 tablet_copy_client.cc:670] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:04.494736 25492 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:04.497529 25436 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:04.495246 25492 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:04.517568 23987 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:04.511451 25492 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:04.519590 25492 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.530268 25424 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:04.539716 25395 tablet_bootstrap.cc:492] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
W20260709 12:17:04.559553 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.547607 25455 tablet_copy_client.cc:538] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:04.582804 25512 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:04.681399 25474 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:04.682018 25474 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:04.624078 25512 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:04.701095 24594 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.702713 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.705536 23919 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:04.705818 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:04.706699 23914 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:04.707039 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:04.707212 23914 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:04.708742 25423 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:04.709810 25423 consensus_queue.cc:1243] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer 71a48f59ff764d249519c6a53ec57f02 log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:04.712378 25418 consensus_queue.cc:1059] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:04.713104 23914 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:04.713729 25519 raft_consensus.cc:3055] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:04.714140 25519 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:04.714592 23914 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:04.714979 25519 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:04.716146 25519 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:04.714412 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:04.717895 25418 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.720093 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:04.744474 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:04.692710 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:04.743214 25418 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.744642 23914 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:17:04.790424 25507 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:17:04.745661 23887 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:04.825697 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 80111.3us
I20260709 12:17:04.826727 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:04.830690 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 73272.5us
I20260709 12:17:04.851948 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:04.876621 25474 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:04.889329 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:04.836712 25423 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.890172 24068 raft_consensus.cc:2393] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:04.869452 25448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.015s
I20260709 12:17:04.903971 23918 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:04.873999 25426 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:04.923540 23992 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.009s	sys 0.037s
I20260709 12:17:04.907346 25469 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:04.924623 23992 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.009s	sys 0.037s
I20260709 12:17:04.891567 25516 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:04.909226 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:04.934823 25483 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.019s
W20260709 12:17:04.908499 25448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.012s	sys 0.016s
W20260709 12:17:04.959930 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:04.961344 24034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.018s	sys 0.015s
W20260709 12:17:04.965898 24034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.018s	sys 0.016s
W20260709 12:17:04.966542 24067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.006s	sys 0.018s
I20260709 12:17:04.923640 25471 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:04.968763 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:04.966938 24067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.006s	sys 0.018s
W20260709 12:17:04.960590 25483 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.000s	sys 0.020s
I20260709 12:17:04.922466 25426 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:04.975458 25465 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.982134 25471 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:05.003633 25482 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:05.062743 24063 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.023s	sys 0.015s
I20260709 12:17:05.051826 25410 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:05.119357 25442 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.018s	sys 0.018s
I20260709 12:17:05.119549 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:05.119884 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 754005us
I20260709 12:17:05.132141 23817 catalog_manager.cc:5697] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:05.174233 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:05.175479 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:05.062567 25460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.015s	sys 0.037s
I20260709 12:17:05.176455 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:05.136804 25477 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:05.176954 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 302867us
I20260709 12:17:05.144631 25469 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:05.151998 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.165621 24063 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.028s	sys 0.017s
W20260709 12:17:05.023504 25508 log.cc:927] Time spent T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:17:05.111171 25468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.014s	sys 0.029s
W20260709 12:17:05.079346 25503 log.cc:927] Time spent T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:05.040650 25512 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:05.172991 25442 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.088s	user 0.019s	sys 0.018s
W20260709 12:17:05.179229 25460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.017s	sys 0.042s
W20260709 12:17:05.179548 25468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.015s	sys 0.030s
W20260709 12:17:05.185079 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:05.172750 25493 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:05.043035 25465 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:05.191781 23960 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:05.181470 25448 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.173558 25410 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:05.205982 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:05.195752 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.181703 25469 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:05.179472 25439 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:05.222137 25505 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 12:17:05.222383 25532 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:17:05.197224 25467 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.218050 23995 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:05.183456 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:05.243430 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60091us
I20260709 12:17:05.244151 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:05.171432 25482 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:05.295984 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:05.308681 25523 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.248502 25413 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:05.313758 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:05.362241 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 49859.1us
W20260709 12:17:05.362614 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45544.8us
W20260709 12:17:05.366807 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 160924us
W20260709 12:17:05.369648 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:05.308390 25448 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.237847 25418 consensus_queue.cc:1059] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:17:05.374536 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:05.372155 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:05.375741 25517 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.376937 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:05.377745 25517 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.309587 25526 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.381102 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:05.397346 23917 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:05.319414 25442 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.372035 25477 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.366168 25467 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.411482 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:05.417413 24034 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:05.395835 25426 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:05.414053 25536 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:17:05.423802 25477 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:05.426795 25477 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:05.420920 25455 tablet_bootstrap.cc:492] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:17:05.444119 25515 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:05.445086 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:05.415683 25523 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:05.434975 25526 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:05.412144 25442 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:05.473646 25442 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:05.470528 25539 log.cc:927] Time spent T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:17:05.482262 25547 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.465454 25471 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:05.479620 25523 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:05.489022 25540 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:17:05.475510 25465 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:05.489310 25523 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:05.482946 25410 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:05.491182 25471 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.494964 25471 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:05.497634 25521 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
W20260709 12:17:05.500907 25530 log.cc:927] Time spent T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:17:05.500428 25482 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:05.510802 25542 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:05.515920 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1223) took 1078 ms. Trace:
I20260709 12:17:05.516407 24067 rpcz_store.cc:276] 0709 12:17:04.435102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.435256 (+   154us) service_pool.cc:224] Handling call
0709 12:17:04.440014 (+  4758us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.440494 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.440532 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:04.441007 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:17:04.973868 (+532861us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:04.973925 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.974017 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:05.513224 (+539207us) raft_consensus.cc:1685] finished
0709 12:17:05.513244 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:05.513357 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":38752,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":521628,"threads_started":1,"wal-append.queue_time_us":980718}
I20260709 12:17:05.487543 25547 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:05.612914 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 360) took 1350 ms. Trace:
I20260709 12:17:05.636754 25546 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:05.639505 25523 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:05.665410 25546 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:05.742266 25531 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:17:05.838508 25413 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:05.842329 25469 consensus_meta.cc:287] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.005s
I20260709 12:17:05.843022 25469 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:05.853201 25469 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:06.066197 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.071147 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.080049 23887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.020s	sys 0.040s
W20260709 12:17:06.080720 23887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.020s	sys 0.040s
W20260709 12:17:06.082140 23912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.008s	sys 0.001s
W20260709 12:17:06.082703 23912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.008s	sys 0.002s
W20260709 12:17:06.086136 23918 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.006s	sys 0.005s
W20260709 12:17:06.086753 23918 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.007s	sys 0.005s
W20260709 12:17:06.089179 23921 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.162s	user 0.000s	sys 0.032s
W20260709 12:17:06.089731 23921 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.163s	user 0.000s	sys 0.032s
W20260709 12:17:06.096647 24034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.005s	sys 0.028s
W20260709 12:17:06.097287 24034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.006s	sys 0.028s
W20260709 12:17:06.116396 24564 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.103s	user 0.008s	sys 0.006s
W20260709 12:17:06.117046 24564 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.104s	user 0.009s	sys 0.006s
W20260709 12:17:06.117621 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 1.10503e+06us
W20260709 12:17:06.116500 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.003s	sys 0.011s
W20260709 12:17:06.137010 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 762462us
I20260709 12:17:06.137777 25523 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.138983 25546 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.141604 25526 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:06.142705 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.143360 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.142809 25526 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:06.144016 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1384) took 1313 ms. Trace:
I20260709 12:17:06.143157 25516 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:06.146375 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.004s	sys 0.011s
W20260709 12:17:06.120025 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 702601us
I20260709 12:17:06.149668 25561 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.150559 25561 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.139250 25523 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.144562 23919 rpcz_store.cc:276] 0709 12:17:04.830009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.830120 (+   111us) service_pool.cc:224] Handling call
0709 12:17:06.142685 (+1312565us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:06.143021 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.143428 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.143456 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.143519 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:06.143542 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.143607 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.143767 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9203584}
W20260709 12:17:06.159085 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 758472us
I20260709 12:17:05.636835 24593 rpcz_store.cc:276] 0709 12:17:04.262292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.264093 (+  1801us) service_pool.cc:224] Handling call
0709 12:17:04.380362 (+116269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.416192 (+ 35830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.423763 (+  7571us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:04.450359 (+ 26596us) log.cc:844] Serialized 26 byte log entry
0709 12:17:04.917580 (+467221us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:04.920590 (+  3010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:04.932249 (+ 11659us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:05.586583 (+654334us) raft_consensus.cc:1685] finished
0709 12:17:05.589994 (+  3411us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:05.612325 (+ 22331us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1067,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":17678,"thread_start_us":455064,"threads_started":1,"wal-append.queue_time_us":722117}
I20260709 12:17:06.170715 25553 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:06.171918 25553 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.173584 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:06.167266 25512 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.175827 25557 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.173638 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 364) took 1342 ms. Trace:
I20260709 12:17:06.178092 25526 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.185304 25553 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.180034 24597 rpcz_store.cc:276] 0709 12:17:04.830629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.836931 (+  6302us) service_pool.cc:224] Handling call
0709 12:17:06.172118 (+1335187us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2deee 000000000036eb39 00007f75c5ba11e0 00007f75c5c6a0c4 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:06.172485 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.172988 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.173027 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.173116 (+    89us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:06.173161 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.173243 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.173422 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25949952}
I20260709 12:17:06.196360 25553 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.196768 25512 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.199676 25512 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.197247 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:06.206475 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.207597 24064 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:06.208003 25557 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.210409 25559 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.211503 25471 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.214852 25554 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.217830 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.211194 25559 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.215711 25554 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:06.221927 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.201529 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.191843 25526 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.218308 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:06.197228 25553 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.236904 25460 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:06.244007 25415 raft_consensus.cc:3055] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:06.244424 25561 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.244818 23917 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:06.239018 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:06.234740 25512 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.252081 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1608) took 1288 ms. Trace:
I20260709 12:17:06.252540 23992 rpcz_store.cc:276] 0709 12:17:04.963629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.963809 (+   180us) service_pool.cc:224] Handling call
0709 12:17:06.250661 (+1286852us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:06.251008 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.251402 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.251442 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.251530 (+    88us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:06.251613 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.251694 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.251835 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16065280}
I20260709 12:17:06.255934 25517 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.256588 25566 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.256836 25517 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.257375 25566 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:06.259276 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.259373 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.242571 25557 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.244446 25415 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:06.277323 25552 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.277968 25552 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.278735 25554 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.279625 25553 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.288319 25469 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.289196 25431 raft_consensus.cc:3055] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:06.289721 25431 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:06.296458 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.297369 24595 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:06.297863 25439 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:06.298444 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 66983us
I20260709 12:17:06.298779 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.298553 25439 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.300943 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:06.301038 24064 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:06.300961 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1370) took 2169 ms. Trace:
I20260709 12:17:06.302608 23912 rpcz_store.cc:276] 0709 12:17:04.131494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.136409 (+  4915us) service_pool.cc:224] Handling call
0709 12:17:04.401639 (+265230us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:04.401821 (+   182us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.906456 (+504635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.909187 (+  2731us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:04.975821 (+ 66634us) log.cc:844] Serialized 26 byte log entry
0709 12:17:06.083452 (+1107631us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:06.083614 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.083804 (+   190us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.290027 (+206223us) raft_consensus.cc:1685] finished
0709 12:17:06.290046 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.300871 (+ 10825us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54255,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":4377,"spinlock_wait_cycles":6197632,"thread_start_us":1488349,"threads_started":2,"wal-append.queue_time_us":1124701}
I20260709 12:17:06.303669 25415 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.270242 24593 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:06.289233 25525 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:06.318727 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 366) took 1487 ms. Trace:
I20260709 12:17:06.283061 25526 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.319319 24596 rpcz_store.cc:276] 0709 12:17:04.831516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.831638 (+   122us) service_pool.cc:224] Handling call
0709 12:17:06.317108 (+1485470us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:06.318514 (+  1406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13285248}
I20260709 12:17:06.321666 23819 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39296 (request call id 304) took 3031 ms. Trace:
I20260709 12:17:06.323349 25569 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:17:06.323624 23886 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:17:06.324558 25525 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.292232 25546 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.326260 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:06.334645 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 161409us
I20260709 12:17:06.284463 25460 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.340116 25552 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.341325 25423 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.342157 25423 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.342895 25439 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.345582 25423 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.349646 25424 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.350260 25431 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.350657 25424 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.323246 25547 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.353750 25431 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.319234 25507 raft_consensus.cc:3055] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:06.320195 25469 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.269541 25519 consensus_queue.cc:1059] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.113s
I20260709 12:17:06.357725 25415 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.358811 25525 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.359414 25424 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.360893 25573 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.360536 25546 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.361510 25567 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.362246 25423 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.365738 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.366266 25526 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.350965 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:06.338688 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 367) took 1454 ms. Trace:
I20260709 12:17:06.394423 24600 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 2: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:06.356487 25507 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:06.399124 24599 rpcz_store.cc:276] 0709 12:17:04.831827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.831952 (+   125us) service_pool.cc:224] Handling call
0709 12:17:04.873424 (+ 41472us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:06.201593 (+1328169us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2de9c 00007f75bdb2da5b 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:06.201887 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.265765 (+ 63878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.266927 (+  1162us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.270240 (+  3313us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:06.270301 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.270372 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.285960 (+ 15588us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42821,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":1167,"spinlock_wait_cycles":37848320,"thread_start_us":63146,"threads_started":1}
W20260709 12:17:06.407930 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 57177.8us
I20260709 12:17:06.398774 25569 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.410429 25566 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.412421 25569 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.413223 25430 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:06.414393 25466 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:06.415187 25466 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.417098 25507 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.417418 25423 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.418385 25547 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:06.418558 25507 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.418946 25547 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.419411 25547 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.407361 25567 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.422420 25568 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.423131 25568 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.423568 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:06.424397 25552 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.409435 25562 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.432927 25567 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.433182 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.435312 25423 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.436295 25559 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.438210 25568 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:06.440399 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 139691us
I20260709 12:17:06.434132 24064 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:06.405015 25525 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.408648 25574 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.470644 25525 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.472939 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.425135 25552 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.486711 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.490588 25428 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:06.501169 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.491065 25424 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.501338 25428 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.502482 25576 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:06.502252 25424 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:06.503041 25576 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.503710 25428 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.504559 25424 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.491696 25423 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.504887 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 363) took 1674 ms. Trace:
I20260709 12:17:06.505336 25423 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.506549 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:06.493662 25525 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.495208 25444 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.408676 25469 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.464838 25568 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:06.498754 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 81764.1us
I20260709 12:17:06.500217 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.505940 24065 raft_consensus.cc:2410] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:06.505256 24598 rpcz_store.cc:276] 0709 12:17:04.830140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.830258 (+   118us) service_pool.cc:224] Handling call
0709 12:17:06.320439 (+1490181us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:06.340577 (+ 20138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:06.404043 (+ 63466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:06.404071 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:06.406357 (+  2286us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:06.406398 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.504533 (+ 98135us) spinlock_profiling.cc:243] Waited 62.1 ms on lock 0x7b5400483354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:06.504582 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.504731 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":154743552}
W20260709 12:17:06.495569 25524 log.cc:927] Time spent T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.869s	user 0.051s	sys 0.047s
I20260709 12:17:06.457794 25554 consensus_queue.cc:1059] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
I20260709 12:17:06.474645 25562 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:06.550802 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 84659.9us
I20260709 12:17:06.611119 25568 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:06.542474 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.611558 23960 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:06.535952 25556 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.359s	user 0.000s	sys 0.004s
I20260709 12:17:06.498039 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.536059 25428 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:06.633204 24593 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:06.636497 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.637503 24065 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:06.638748 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.639111 24064 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.639518 24065 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
W20260709 12:17:06.641373 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 165802us
I20260709 12:17:06.642161 24034 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:06.642679 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.643044 25559 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.643523 24061 raft_consensus.cc:2393] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:06.643687 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:06.644418 25559 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.610373 25554 raft_consensus.cc:3055] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:06.610486 24063 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:06.557235 25512 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.563844 25517 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.558192 25444 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.611631 25568 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:06.575536 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.556524 25574 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.570923 25460 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.655606 25552 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.656383 25428 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:06.535378 25469 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.505359 25576 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.658836 25428 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.644421 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.536245 25424 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:06.537129 25567 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.510643 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:06.627825 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.535665 25579 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:06.650452 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1385) took 1820 ms. Trace:
I20260709 12:17:06.653985 24035 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:06.654525 25448 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.654728 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.495561 25455 tablet_bootstrap.cc:492] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:17:06.665516 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54118.7us
W20260709 12:17:06.667477 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.664143 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:06.664462 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.649215 25554 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:06.669829 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 159254us
I20260709 12:17:06.662205 25423 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.673619 24066 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
W20260709 12:17:06.676277 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.675971 25567 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.676088 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.677117 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.677513 25546 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.678016 23994 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:06.683707 25455 tablet_bootstrap.cc:492] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:17:06.684633 25444 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.684870 25455 ts_tablet_manager.cc:1403] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 1.285s	user 0.056s	sys 0.028s
W20260709 12:17:06.686093 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 98405.4us
I20260709 12:17:06.674960 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:06.694741 25584 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.665031 23921 rpcz_store.cc:276] 0709 12:17:04.830338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.830461 (+   123us) service_pool.cc:224] Handling call
0709 12:17:04.830833 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:04.837811 (+  6978us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:04.837844 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:04.838304 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:17:04.926437 (+ 88133us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b180014b300. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:17:06.090600 (+1164163us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:06.090711 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:06.090849 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:06.533302 (+442453us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b2400132908. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bd9eb9c4 00007f75bd9e9acb 00007f75bdba4dc9 00007f75bdba4a55 00007f75bdba409d 00007f75c07d610e 00007f75c07ed88c 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221
0709 12:17:06.631562 (+ 98260us) raft_consensus.cc:1685] finished
0709 12:17:06.631584 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:06.650395 (+ 18811us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19139,"raft.queue_time_us":6671,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6923,"spinlock_wait_cycles":61930624,"thread_start_us":1163561,"threads_started":1,"wal-append.queue_time_us":1337471}
I20260709 12:17:06.695407 25584 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.696997 25555 raft_consensus.cc:3055] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:06.674598 25552 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:06.697469 25555 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:06.697630 25552 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.698063 25552 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.697844 25584 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.697494 23960 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:06.687506 25567 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.703020 25555 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.736935 25584 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:06.737061 25555 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:06.703572 25516 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.737409 25584 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.737792 25516 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:06.737870 25584 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.738260 25516 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.746232 25424 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.746181 25547 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.747786 25516 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.748423 25424 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.748426 25547 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.749985 25516 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.756228 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.757941 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.746165 25584 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.759394 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.760306 25584 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.327754 23819 rpcz_store.cc:276] 0709 12:17:03.289633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:03.289795 (+   162us) service_pool.cc:224] Handling call
0709 12:17:06.321384 (+3031589us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:03.660516 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:03.699933 (+ 39417us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:03.699966 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:17:03.699983 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:03.700325 (+   342us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:03.700401 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:03.700436 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:17:03.700613 (+   177us) tablet.cc:701] Row locks acquired
0709 12:17:03.700632 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:17:03.700775 (+   143us) write_op.cc:270] Start()
0709 12:17:03.700888 (+   113us) write_op.cc:276] Timestamp: P: 1783599423700731 usec, L: 0
0709 12:17:03.700907 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:17:03.701506 (+   599us) log.cc:844] Serialized 531 byte log entry
0709 12:17:04.380212 (+678706us) op_driver.cc:464] REPLICATION: finished
0709 12:17:04.971912 (+591700us) write_op.cc:301] APPLY: starting
0709 12:17:04.972011 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:04.972113 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:05.039210 (+ 67097us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:05.083504 (+ 44294us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:05.111653 (+ 28149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:17:05.112256 (+   603us) write_op.cc:312] APPLY: finished
0709 12:17:05.112508 (+   252us) log.cc:844] Serialized 23 byte log entry
0709 12:17:05.114251 (+  1743us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:05.165759 (+ 51508us) write_op.cc:454] Released schema lock
0709 12:17:05.168711 (+  2952us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:05.203602 (+ 34891us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:05.217466 (+ 13864us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":587416,"apply.run_cpu_time_us":2660,"apply.run_wall_time_us":213595,"num_ops":1,"prepare.queue_time_us":252345,"prepare.run_cpu_time_us":21230,"prepare.run_wall_time_us":115608,"raft.queue_time_us":903412,"raft.run_cpu_time_us":69081,"raft.run_wall_time_us":782130,"replication_time_us":548063,"thread_start_us":1148913,"threads_started":5,"wal-append.queue_time_us":126626}]]}
I20260709 12:17:06.801358 23817 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39282 (request call id 306) took 2272 ms. Trace:
I20260709 12:17:06.796236 23921 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:06.786207 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 44922us
I20260709 12:17:06.761675 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:06.821213 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.803452 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.705133 25512 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:06.834358 25459 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:06.835181 25459 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.833928 25512 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.837563 25459 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.840250 25512 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.794672 25574 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.889170 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:06.797520 25577 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.320s	user 0.000s	sys 0.001s
I20260709 12:17:06.765698 25465 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:06.766443 25582 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:06.849509 25559 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.766108 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.896786 25582 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.896586 25465 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:06.763552 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.898404 25465 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.796149 25581 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:06.796073 25466 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.897215 25559 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.903658 25559 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.791579 25423 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:06.900224 25581 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:06.853027 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 91404.8us
I20260709 12:17:06.764578 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.908658 25546 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:06.805246 23816 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 3, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:17:06.910935 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 280436us
I20260709 12:17:06.911753 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:06.911633 23816 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 3, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 3 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:06.823626 23817 rpcz_store.cc:276] 0709 12:17:04.528766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.528989 (+   223us) service_pool.cc:224] Handling call
0709 12:17:04.869269 (+340280us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b54002e4354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbc090 00007f75c0c5af3a 00007f75c6a10e9c 00007f75c6b0f04e 00007f75c4fd02a4 00007f75c4fd0232 00007f75c4fd0161 00007f75c4fd00dc 00007f75c4fcf392 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:06.801132 (+1931863us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:05.504456 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:05.505046 (+   590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:05.505097 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:17:05.505122 (+    25us) tablet.cc:662] Decoding operations
0709 12:17:05.505544 (+   422us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:05.505598 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:05.505629 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:17:05.505846 (+   217us) tablet.cc:701] Row locks acquired
0709 12:17:05.505870 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:17:05.506049 (+   179us) write_op.cc:270] Start()
0709 12:17:05.506183 (+   134us) write_op.cc:276] Timestamp: P: 1783599425506003 usec, L: 0
0709 12:17:05.506210 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:17:05.614263 (+108053us) log.cc:844] Serialized 535 byte log entry
0709 12:17:06.182499 (+568236us) op_driver.cc:464] REPLICATION: finished
0709 12:17:06.351853 (+169354us) write_op.cc:301] APPLY: starting
0709 12:17:06.352000 (+   147us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:06.352183 (+   183us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:06.396318 (+ 44135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:06.472686 (+ 76368us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:06.477454 (+  4768us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:17:06.477530 (+    76us) write_op.cc:312] APPLY: finished
0709 12:17:06.486891 (+  9361us) log.cc:844] Serialized 23 byte log entry
0709 12:17:06.487201 (+   310us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:06.487346 (+   145us) write_op.cc:454] Released schema lock
0709 12:17:06.487415 (+    69us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:06.488028 (+   613us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:06.488074 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":758159616,"child_traces":[["op",{"apply.queue_time_us":162373,"apply.run_cpu_time_us":3785,"apply.run_wall_time_us":136135,"num_ops":1,"prepare.queue_time_us":328298,"prepare.run_cpu_time_us":3367,"prepare.run_wall_time_us":110428,"replication_time_us":657496,"thread_start_us":257653,"threads_started":2}]]}
I20260709 12:17:06.764180 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.914659 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.914765 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.910612 25546 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:06.916148 25546 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:06.916205 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:06.917208 24597 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:06.917372 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:06.918992 25467 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.913529 23816 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 3, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:06.922317 25566 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:06.922892 25566 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.923213 25455 raft_consensus.cc:359] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:06.924074 25455 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:17:06.924744 25455 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:06.925253 25566 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.926826 25554 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.927606 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:06.927991 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:06.929339 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:06.806041 25519 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.930191 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:06.930773 25519 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.931001 23913 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:06.933203 25519 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.932924 23818 catalog_manager.cc:5697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:06.924705 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.935504 24069 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:06.937662 25448 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.938205 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.938977 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.939579 23992 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:06.940478 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.940591 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.941228 23996 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:06.941637 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.913538 25583 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.942819 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.943572 23991 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:06.931052 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:06.819366 24034 connection.cc:256] RPC call timeout handler was delayed by -1.2275371650000579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 12:17:06.942431 23818 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 3 to 4, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 4 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:06.790524 25579 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.939530 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.964102 25562 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:06.964006 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:07.009840 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:07.010185 23990 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:07.011415 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:06.964797 25523 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:06.965153 25569 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:06.970515 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.971366 24035 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:06.919629 25467 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:06.976195 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:06.977070 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 289417us
W20260709 12:17:07.016235 23961 consensus_peers.cc:597] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:07.012110 23920 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:06.978370 25507 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:06.978751 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.979419 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.965950 25555 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:06.981266 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.981650 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:06.983443 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:07.018813 23991 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:06.984014 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:06.907413 25516 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:07.020171 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.987130 25444 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:06.987185 25546 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:06.970521 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:06.988552 23962 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:17:06.990309 24034 leader_election.cc:336] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.520s (SENT)
I20260709 12:17:06.991744 24594 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:06.994976 25581 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:06.999173 25455 ts_tablet_manager.cc:1434] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.314s	user 0.009s	sys 0.000s
I20260709 12:17:06.999756 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:07.000453 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:07.002858 25465 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.005919 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:07.008553 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:07.008769 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:06.919531 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:06.971195 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.916231 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:06.986213 25582 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:07.020956 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 49659.5us
W20260709 12:17:07.025787 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55343.7us
I20260709 12:17:07.025238 24061 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:17:07.028193 24069 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:07.021977 24062 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:07.031215 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:07.019755 25431 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:07.035229 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:06.972069 25552 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.037864 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:07.020054 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:07.029624 25415 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.030565 25547 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.028386 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:07.045897 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:07.046203 25468 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.046766 25424 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.017616 25569 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.039283 25581 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.067622 24063 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
W20260709 12:17:07.055536 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 67159.1us
I20260709 12:17:07.060346 24066 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:07.039069 24597 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:07.061108 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:07.061796 24065 raft_consensus.cc:2393] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:07.051684 24067 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
W20260709 12:17:07.072158 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 96247.1us
W20260709 12:17:07.073177 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 82972.7us
W20260709 12:17:07.067660 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.052930 25415 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.038924 25516 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.082901 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:07.087486 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:07.064697 25582 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.050347 24593 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
W20260709 12:17:07.082970 24034 leader_election.cc:336] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.863s (SENT)
I20260709 12:17:07.061910 25568 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.085876 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:07.102923 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:07.103168 25554 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.103806 24597 raft_consensus.cc:2393] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:07.051313 25431 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.104957 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:07.081046 25567 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.063097 25547 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.087193 25467 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:07.107461 25547 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:07.107728 25588 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 12:17:07.108537 23991 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:07.084789 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:07.092772 24034 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:07.069033 25424 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.121007 25424 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.123865 25567 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.124305 25567 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.125487 25584 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:07.125873 25584 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:07.064519 25573 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:07.088526 25546 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:07.096834 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:07.097596 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:07.126775 25573 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.126837 25584 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.127604 24598 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.128314 25584 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.129166 25573 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.120334 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:07.131134 24593 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:07.132279 25516 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:07.133107 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 50324.5us
I20260709 12:17:07.133196 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:07.133812 23916 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:07.134496 25507 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.134702 24598 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:07.086826 25465 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.135022 25562 consensus_queue.cc:1059] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:07.101046 25519 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:07.135776 25581 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:07.136528 25555 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:07.136899 25555 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:07.136955 25581 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:07.137341 25581 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:07.137766 25555 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:07.102743 25569 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:07.080775 25517 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.139444 25555 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.141067 25582 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:07.134757 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 47360us
I20260709 12:17:07.143069 25583 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.143667 25468 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:07.138151 25581 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.144196 25468 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.081652 25448 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.144837 25581 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.145180 25448 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.146517 23987 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
W20260709 12:17:07.146785 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 62073.8us
I20260709 12:17:07.147258 25448 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:07.086113 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:07.147804 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:07.148118 23918 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:07.149410 25413 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:07.149765 25413 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:07.135883 25519 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:07.153505 25413 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.153770 25519 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.101193 25552 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:07.135996 25562 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.142089 25582 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.120427 25579 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:07.117551 24036 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:07.151640 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:07.135443 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:07.084370 25415 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.156812 23960 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:07.162591 24035 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:07.083827 25444 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:17:07.150045 25459 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.155062 25519 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:07.172101 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 89186.8us
W20260709 12:17:07.167270 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49776us
I20260709 12:17:07.133575 25567 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:07.172191 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.162325 25562 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.177966 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:07.212632 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 147051us
W20260709 12:17:07.211194 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 46297us
I20260709 12:17:07.213932 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:07.216109 24034 leader_election.cc:336] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.968s (SENT)
W20260709 12:17:07.182883 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.216740 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:07.218039 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 82676.8us
W20260709 12:17:07.211714 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54980us
I20260709 12:17:07.219550 23960 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:07.223616 24036 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:07.227654 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:07.229561 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:07.252614 24063 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 2: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:07.253746 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:07.254390 23990 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:17:07.170848 25467 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.172006 25448 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:07.170413 25517 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.261082 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:07.270334 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:07.171108 25507 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.215534 25562 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.218731 24594 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.290793 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-def9be339f8f4adc820a6a1320fec425 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:17:07.291488 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-def9be339f8f4adc820a6a1320fec425 on tablet def9be339f8f4adc820a6a1320fec425 with peer 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:07.293454 25599 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:17:07.275053 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:07.275772 23988 raft_consensus.cc:2393] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:07.277379 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.278406 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.221987 25523 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.251224 25576 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.270028 25585 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.286862 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:07.264909 25573 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:07.314425 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:07.262930 25460 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.260905 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:07.269101 25512 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:07.323249 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 71320.9us
I20260709 12:17:07.269145 25448 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:07.325287 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:07.278003 25569 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:07.319645 25467 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.334689 25573 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.341779 25471 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:07.344859 25563 log.cc:927] Time spent T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:17:07.345194 25395 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:17:07.364787 25467 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.410606 25467 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.412586 25395 tablet_bootstrap.cc:492] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:17:07.322233 25556 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:17:07.345990 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 93233.6us
I20260709 12:17:07.345270 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:07.319974 25576 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.414183 25576 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.327724 23961 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:07.346764 24069 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:07.416186 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 88530.5us
W20260709 12:17:07.367971 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 151900us
I20260709 12:17:07.334990 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:07.371812 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.419205 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 156753us
I20260709 12:17:07.412181 25413 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.416891 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:07.370863 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.352505 25448 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:07.419894 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:07.423661 24063 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:07.424852 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 79662.2us
I20260709 12:17:07.419996 23962 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:07.333781 25555 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:17:07.428566 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:07.429831 24034 leader_election.cc:336] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 2.230s (SENT)
I20260709 12:17:07.371265 25573 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:07.426401 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:07.436587 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:07.468176 24065 raft_consensus.cc:2393] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:07.424549 25523 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:07.429553 25430 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:07.470336 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44051.6us
I20260709 12:17:07.423336 25444 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.432507 25459 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:07.474079 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 45691.6us
I20260709 12:17:07.433322 25546 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:07.476416 23962 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:07.477001 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:07.477993 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:07.440546 25568 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:07.487107 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 134264us
I20260709 12:17:07.484972 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:17:07.489910 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60111.5us
I20260709 12:17:07.478183 25469 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:07.494773 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:07.495370 23990 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.482430 25444 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.500572 25431 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.498850 25618 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.500062 25459 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.489240 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:07.483263 25546 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.548027 25546 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:07.549154 25424 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.481489 25430 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:07.508046 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:07.581607 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 96708.2us
I20260709 12:17:07.581830 24066 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.487779 25512 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.489430 25561 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:07.506968 25471 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.591675 25424 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:07.500635 25493 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:17:07.592999 24066 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:07.533833 25413 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.538542 23990 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:07.508800 25395 tablet_bootstrap.cc:492] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
W20260709 12:17:07.543295 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.543800 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:07.594558 25395 ts_tablet_manager.cc:1403] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 3.079s	user 0.028s	sys 0.025s
I20260709 12:17:07.595132 24599 raft_consensus.cc:2368] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:07.546430 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:07.507198 25444 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:07.550977 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.582640 23962 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:07.490100 25523 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.587368 25430 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.595348 24069 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:07.512844 25469 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:07.591988 25467 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.539075 25459 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:07.606184 23962 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:07.625097 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:07.536258 25618 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:07.597709 25613 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.611212 24065 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:07.630323 25574 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.630874 25574 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.614573 25523 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.615407 25413 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:07.631597 25413 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:07.631989 25413 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.616228 23990 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:07.594797 25415 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.628566 23987 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:07.628167 25469 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.629655 25591 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:07.629926 25431 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.631228 25574 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.623270 25448 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.642517 25613 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.630407 23961 leader_election.cc:400] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:07.608844 25561 raft_consensus.cc:697] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:07.800680 23961 leader_election.cc:403] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:17:07.801249 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 181464us
W20260709 12:17:07.697583 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 91468.2us
I20260709 12:17:07.802621 25424 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
W20260709 12:17:07.802857 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:07.804416 25562 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.630529 25618 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.705075 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:07.706514 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 53457.3us
I20260709 12:17:07.742619 24063 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
W20260709 12:17:07.705724 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 165090us
W20260709 12:17:07.702536 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:07.719727 25468 consensus_meta.cc:287] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.575s	user 0.014s	sys 0.006s
I20260709 12:17:07.696426 25459 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:07.786294 25615 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:07.790947 24065 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:07.791570 25431 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.744120 25523 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:07.710073 25584 consensus_meta.cc:287] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.005s
I20260709 12:17:07.790957 25467 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:07.800203 25613 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.816020 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:07.842157 25415 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.852108 25622 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.854239 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:07.854403 25622 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.855037 25569 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:07.856025 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:07.856541 25622 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:07.719920 25581 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:07.818197 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:07.711212 25512 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:07.825337 25562 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.825044 25615 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.796838 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:07.814754 25493 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:17:07.801491 25561 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.721246 25546 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.812697 25517 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:07.832804 25396 tablet_copy_client.cc:538] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:07.839426 25413 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:07.826606 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:07.819325 25468 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.710834 25591 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:07.893337 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 64051.9us
I20260709 12:17:07.895573 25467 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:07.842056 25431 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:07.898535 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:07.858173 25547 consensus_meta.cc:287] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.750s	user 0.017s	sys 0.004s
W20260709 12:17:07.837636 25554 consensus_meta.cc:287] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.000s
I20260709 12:17:07.836515 24593 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:07.833673 25623 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:07.844178 25448 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.884053 25568 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:07.838603 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:07.836925 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:07.851854 25444 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.174445 25444 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.916590 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:07.908077 25591 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:07.838737 25523 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:07.922485 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:08.175318 24599 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:08.175382 24592 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.176630 25523 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.916240 25623 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.178592 25623 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:07.895403 25581 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.180449 25581 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.900506 25512 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.182580 25512 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:07.931030 25576 consensus_meta.cc:287] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.003s
I20260709 12:17:07.913357 25467 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.183905 25591 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:08.185035 25467 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.934966 25395 raft_consensus.cc:359] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:07.935664 25468 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:07.939175 25618 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:08.186082 25591 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:07.944437 25546 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:07.946674 25413 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:07.938090 24035 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:08.347494 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 409460us
I20260709 12:17:08.348611 25467 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:07.934804 24066 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:08.392534 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.393107 24066 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:07.913743 24067 raft_consensus.cc:2368] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:08.396412 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.397473 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.397980 24067 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:08.015442 25631 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.051402 25632 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:08.187430 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1427) took 1153 ms. Trace:
I20260709 12:17:08.400882 25631 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:08.400877 23912 rpcz_store.cc:276] 0709 12:17:07.034088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.042658 (+  8570us) service_pool.cc:224] Handling call
0709 12:17:07.084601 (+ 41943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:07.086512 (+  1911us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:07.266572 (+180060us) log.cc:844] Serialized 14 byte log entry
0709 12:17:08.186940 (+920368us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b1800402040. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75c07fa4bc 00007f75bdb4848b 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb62455 00007f75c0c4a060 00007f75c0c5c716 00007f75c0c6d287
0709 12:17:08.187047 (+   107us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:08.187099 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:08.187153 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.187231 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:08.187354 (+   123us) inbound_call.cc:177] Queueing success response
0709 12:17:08.248488 (+ 61134us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b1800402040. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdadfc0a 00007f75c721f219 00007f75c4b2658f 00007f75bdb65571 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd
Metrics: {"mutex_wait_us":24791,"prepare.queue_time_us":266083,"prepare.run_cpu_time_us":7928,"prepare.run_wall_time_us":49550,"raft.queue_time_us":52133,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":6231,"spinlock_wait_cycles":11807360,"thread_start_us":276196,"threads_started":2}
I20260709 12:17:08.402110 25631 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.403558 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.404229 23912 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
W20260709 12:17:08.404908 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.582s (SENT) [suppressed 20 similar messages]
I20260709 12:17:08.405270 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.202396 23990 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 3. Ops: []
I20260709 12:17:08.205564 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.405891 23912 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:08.213119 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.407132 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.407869 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.408216 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.406098 23920 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:08.408895 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.409057 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.393990 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.409704 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.216722 23915 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:08.410399 24067 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:08.225831 23917 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:08.408895 23919 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:08.411602 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 1435) took 1314 ms. Trace:
I20260709 12:17:08.411952 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.412111 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.412037 23915 rpcz_store.cc:276] 0709 12:17:07.097406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.104601 (+  7195us) service_pool.cc:224] Handling call
0709 12:17:08.411411 (+1306810us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002eca54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:08.411537 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2555166592}
I20260709 12:17:08.413117 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.245219 25630 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:08.246765 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:08.249356 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 835572us
I20260709 12:17:08.250010 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.413793 25630 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.414511 24065 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.414479 23960 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:08.416047 25630 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:08.245105 25627 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:08.416811 25460 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:08.416725 25627 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.417265 25460 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:08.417716 25460 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.419298 25627 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:08.261991 25624 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.444s	user 0.004s	sys 0.000s
I20260709 12:17:08.263038 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.262758 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.420682 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.421311 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.421687 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.421860 23916 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
W20260709 12:17:08.270539 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.422685 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:07.966207 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 47491.5us
I20260709 12:17:08.429241 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 385) took 1006 ms. Trace:
I20260709 12:17:08.183235 24592 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:08.413506 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.432889 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:08.283001 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.410183 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.435621 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.436659 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.283804 23988 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.189692 25395 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
W20260709 12:17:08.056951 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 200971us
I20260709 12:17:08.014462 25459 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.050030 25396 tablet_bootstrap.cc:492] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:17:08.542667 25459 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.543012 25631 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:17:08.545034 25632 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:08.545452 25632 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:08.545501 25395 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:08.546450 25632 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.547744 25632 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.548511 25395 ts_tablet_manager.cc:1434] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.954s	user 0.006s	sys 0.012s
W20260709 12:17:07.970682 25519 consensus_meta.cc:287] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.790s	user 0.010s	sys 0.002s
I20260709 12:17:08.245735 25523 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:08.553671 25523 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.554669 23816 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43626 (request call id 192) took 3368 ms. Trace:
I20260709 12:17:08.237383 25525 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.557102 25525 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:08.555042 23816 rpcz_store.cc:276] 0709 12:17:05.186146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:05.203210 (+ 17064us) service_pool.cc:224] Handling call
0709 12:17:08.554607 (+3351397us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:07.295684 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:07.442484 (+146800us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:07.468014 (+ 25530us) write_op.cc:435] Acquired schema lock
0709 12:17:07.468034 (+    20us) tablet.cc:662] Decoding operations
0709 12:17:07.468609 (+   575us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:07.468669 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:07.468701 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:17:07.469022 (+   321us) tablet.cc:701] Row locks acquired
0709 12:17:07.469037 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:17:07.469187 (+   150us) write_op.cc:270] Start()
0709 12:17:07.469307 (+   120us) write_op.cc:276] Timestamp: P: 1783599427469137 usec, L: 0
0709 12:17:07.469334 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:17:07.500766 (+ 31432us) log.cc:844] Serialized 1284 byte log entry
0709 12:17:07.938760 (+437994us) op_driver.cc:464] REPLICATION: finished
0709 12:17:07.957310 (+ 18550us) write_op.cc:301] APPLY: starting
0709 12:17:07.957393 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:07.957548 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:07.957635 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:07.958165 (+   530us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:07.966780 (+  8615us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:17:07.969103 (+  2323us) write_op.cc:312] APPLY: finished
0709 12:17:07.999768 (+ 30665us) log.cc:844] Serialized 35 byte log entry
0709 12:17:08.000075 (+   307us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:08.000202 (+   127us) write_op.cc:454] Released schema lock
0709 12:17:08.000263 (+    61us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":1094224,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":18326,"apply.run_cpu_time_us":2495,"apply.run_wall_time_us":43310,"mutex_wait_us":2924,"num_ops":3,"prepare.queue_time_us":273075,"prepare.run_cpu_time_us":3989,"prepare.run_wall_time_us":261362,"replication_time_us":466545,"thread_start_us":43770,"threads_started":1}]]}
I20260709 12:17:08.250627 25566 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:08.237105 25567 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.121141 25569 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:07.940975 25573 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.562305 25569 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.564666 25573 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:08.049397 25574 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.567344 25574 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.005630 25568 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:08.188805 25576 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.573239 25576 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.204501 25581 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:08.575157 25581 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.575479 25519 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:08.576131 25519 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.577169 25581 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.008666 25615 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.187430 25618 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.316823 23918 raft_consensus.cc:1240] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:08.579628 25519 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:08.580097 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.580772 23918 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:08.581627 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:08.322062 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:08.582760 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.323936 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:08.324587 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.584504 23991 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:08.325322 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.333088 25468 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.338150 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.342998 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 1430) took 1277 ms. Trace:
I20260709 12:17:08.586153 25468 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.586534 25523 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:08.586432 23913 rpcz_store.cc:276] 0709 12:17:07.066047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.067520 (+  1473us) service_pool.cc:224] Handling call
0709 12:17:08.342774 (+1275254us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b5400200654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:08.342912 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189511424}
I20260709 12:17:08.587777 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.587894 23994 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:08.588999 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.378419 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.591156 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.592185 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.592831 24062 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:08.429873 23960 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:08.596462 25468 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:08.596683 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 166909us
I20260709 12:17:08.385272 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.612576 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.388293 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.615406 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:08.616427 23992 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:07.923767 24069 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.410776 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.410940 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.413203 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:08.256747 25628 log.cc:927] Time spent T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.431s	user 0.005s	sys 0.000s
I20260709 12:17:08.423728 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:07.833284 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:08.424396 23919 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 2: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:08.414479 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.444252 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.452518 23962 leader_election.cc:400] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
W20260709 12:17:08.453166 25619 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.711s	user 0.000s	sys 0.006s
I20260709 12:17:08.457331 25460 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:08.461777 24564 leader_election.cc:336] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.619s (SENT)
I20260709 12:17:08.434126 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.462944 25584 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:08.472350 25562 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:08.476786 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.487020 24598 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:08.492728 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:08.494762 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:08.495688 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:08.429637 24596 rpcz_store.cc:276] 0709 12:17:07.422872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.423372 (+   500us) service_pool.cc:224] Handling call
0709 12:17:07.831380 (+408008us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2de9c 00007f75bdb2da5b 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:08.428504 (+597124us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2deee 000000000036eb39 00007f75c5ba11e0 00007f75c5c6a0c4 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:08.428661 (+   157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:08.428832 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:08.428859 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:08.428974 (+   115us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:08.429017 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.429082 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:08.429186 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49458944}
I20260709 12:17:08.499527 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:08.500483 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 95608.2us
I20260709 12:17:08.501919 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:08.503857 24035 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:08.505529 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.505564 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:08.217504 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.501960 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.507198 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.512271 24065 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:08.514952 23921 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:08.548449 23818 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39310 (request call id 310) took 4035 ms. Trace:
W20260709 12:17:08.548998 25395 ts_tablet_manager.cc:1467] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Tablet startup took 954ms
I20260709 12:17:08.254733 25469 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:08.549793 23819 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 3, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:07.914860 25547 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.559405 25566 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.574182 24063 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 5. Ops: []
I20260709 12:17:08.569581 25568 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.582175 23918 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:08.382364 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.595206 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.384069 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.597010 25468 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:08.649964 25615 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:08.682355 25584 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.682710 25615 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.682833 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.683652 23918 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:08.684185 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.684513 23920 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:08.685056 25584 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:08.685379 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.685493 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.685935 23920 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.686501 24591 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:17:08.687572 23916 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:08.705911 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.707227 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.600720 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:08.601055 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:08.708328 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 107347us
I20260709 12:17:08.708945 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:08.711762 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.590138 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.712386 23914 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:17:08.713053 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.713263 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.713676 23913 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.713886 23914 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:08.714608 24594 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:17:08.716271 23990 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:08.718648 23990 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:08.607142 25519 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:08.715795 25460 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.719301 25519 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:08.720492 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 258723us
W20260709 12:17:08.721112 24564 leader_election.cc:336] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.701s (SENT)
I20260709 12:17:08.721328 25519 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.721506 24564 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:08.723490 25567 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:08.682355 24070 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:08.724299 25615 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.724730 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:08.725071 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.725646 23912 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.726508 25567 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:08.690721 23991 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.689746 23989 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:08.726559 23818 rpcz_store.cc:276] 0709 12:17:04.513333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:04.513445 (+   112us) service_pool.cc:224] Handling call
0709 12:17:04.871559 (+358114us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54002e4354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbc090 00007f75c0c5af3a 00007f75c6a10e9c 00007f75c6b0f04e 00007f75c4fd02a4 00007f75c4fd0232 00007f75c4fd0161 00007f75c4fd00dc 00007f75c4fcf392 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:08.548372 (+3676813us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:07.072995 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:07.078014 (+  5019us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:07.078085 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:17:07.078116 (+    31us) tablet.cc:662] Decoding operations
0709 12:17:07.078747 (+   631us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:07.078882 (+   135us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:07.078933 (+    51us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:07.079428 (+   495us) tablet.cc:701] Row locks acquired
0709 12:17:07.079491 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:17:07.079691 (+   200us) write_op.cc:270] Start()
0709 12:17:07.079878 (+   187us) write_op.cc:276] Timestamp: P: 1783599427079622 usec, L: 0
0709 12:17:07.079912 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:17:07.164632 (+ 84720us) log.cc:844] Serialized 917 byte log entry
0709 12:17:07.708019 (+543387us) op_driver.cc:464] REPLICATION: finished
0709 12:17:07.949905 (+241886us) write_op.cc:301] APPLY: starting
0709 12:17:07.950025 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:07.950192 (+   167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:07.953168 (+  2976us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:07.955699 (+  2531us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:07.955894 (+   195us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:07.955952 (+    58us) write_op.cc:312] APPLY: finished
0709 12:17:07.956183 (+   231us) log.cc:844] Serialized 29 byte log entry
0709 12:17:07.956359 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:07.956445 (+    86us) write_op.cc:454] Released schema lock
0709 12:17:07.956499 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:07.956897 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:07.956926 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":162597,"reported_tablets":4,"spinlock_wait_cycles":796510464,"child_traces":[["op",{"apply.queue_time_us":233576,"apply.run_cpu_time_us":2811,"apply.run_wall_time_us":6949,"num_ops":2,"prepare.queue_time_us":95931,"prepare.run_cpu_time_us":4641,"prepare.run_wall_time_us":98952,"replication_time_us":627899,"thread_start_us":215050,"threads_started":2}]]}
I20260709 12:17:08.729804 25618 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:17:08.730504 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 226703us
I20260709 12:17:08.731387 25573 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:08.731729 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 279348us
I20260709 12:17:08.731885 25573 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.732276 25573 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.734836 24035 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:08.735728 25630 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.736292 25630 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.736661 25512 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:08.737322 25512 raft_consensus.cc:697] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:17:08.730944 25395 ts_tablet_manager.cc:1469] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Trace:
0709 12:16:59.261367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:16:59.261540 (+   173us) service_pool.cc:224] Handling call
0709 12:16:59.490756 (+229216us) ts_tablet_manager.cc:934] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
0709 12:17:01.590965 (+2100209us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:17:01.801032 (+210067us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:01.811850 (+ 10818us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:17:01.897996 (+ 86146us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:17:01.909058 (+ 11062us) tablet_replica.cc:206] Creating consensus instance
0709 12:17:01.934838 (+ 25780us) ts_tablet_manager.cc:989] Replica registered.
0709 12:17:01.938534 (+  3696us) inbound_call.cc:177] Queueing success response
0709 12:17:04.510182 (+2571648us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:17:07.594941 (+3084759us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:17:07.932411 (+337470us) tablet_replica.cc:261] Starting instrumentation
0709 12:17:07.933080 (+   669us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":301,"raft.queue_time_us":96,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":93,"tablet-copy.queue_time_us":227996,"tablet-download-pool.queue_time_us":9306,"tablet-download-pool.run_cpu_time_us":2384,"tablet-download-pool.run_wall_time_us":2183840,"thread_start_us":300477,"threads_started":2}
I20260709 12:17:08.698410 24599 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:08.699303 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.754309 25573 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.759151 23919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:60290
I20260709 12:17:08.699409 25566 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:08.699882 23917 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:08.700809 23915 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.698452 25525 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.614230 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.764063 25525 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.702567 23960 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:08.765018 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 62534.5us
I20260709 12:17:08.765120 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:08.765781 23995 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.702695 23819 catalog_manager.cc:5697] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:08.703152 25469 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.701953 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:08.771943 23918 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:08.773227 23915 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:08.704244 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1591) took 1082 ms. Trace:
I20260709 12:17:08.774464 24069 rpcz_store.cc:276] 0709 12:17:07.621905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.622049 (+   144us) service_pool.cc:224] Handling call
0709 12:17:07.810748 (+188699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:08.702367 (+891619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:08.703088 (+   721us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54001b85d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:08.703988 (+   900us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001b85d0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:08.704130 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":675949056}
I20260709 12:17:08.673246 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:08.775710 23992 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:08.707819 23916 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:08.719086 24592 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
W20260709 12:17:08.730662 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:08.779455 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.736763 25630 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.738880 25465 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:08.782521 25465 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.782892 25465 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.784886 25519 consensus_queue.cc:1059] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:08.785969 25519 raft_consensus.cc:3055] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:08.786306 25519 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:08.786999 25519 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.787424 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.788157 25519 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.789791 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:08.789942 25562 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.789994 25465 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.791494 25581 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:08.791859 25581 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.739918 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:08.740114 24035 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:08.792198 25581 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:08.792557 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 52525.9us
I20260709 12:17:08.797745 25566 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:08.798213 25566 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.798564 25566 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.799253 23887 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.799465 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.800083 24069 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.800712 25562 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:08.801901 25562 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.803350 25562 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:08.804338 25555 raft_consensus.cc:3055] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.804662 25555 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:08.805519 25555 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:08.806994 25555 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.807659 25615 raft_consensus.cc:3055] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:08.808019 25615 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:08.809608 23917 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:08.810743 23921 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.741844 23920 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:08.742821 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.697345 25468 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:08.743325 25512 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.690769 24067 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:08.599496 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:08.810011 23917 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:08.824378 23917 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.825239 23917 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.692610 25547 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.696424 23988 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.751704 23912 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:08.752573 23913 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:08.753502 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.753756 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.837245 24061 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.754161 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.754506 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.838778 24066 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:08.755076 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.756776 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.760232 25573 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:08.768239 23819 catalog_manager.cc:5697] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 3, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:08.771437 25469 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.814018 23992 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:08.808789 25615 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.818397 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:08.819125 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:08.819939 25468 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.718640 23987 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:08.823225 24067 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:08.826494 23961 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:08.809152 23962 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:08.784871 23914 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:08.850885 25459 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:08.851379 25459 raft_consensus.cc:697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:08.851600 23919 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.827701 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.817678 25566 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.832067 24069 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:08.833401 25581 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.846068 24068 raft_consensus.cc:2368] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
W20260709 12:17:08.862452 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 139801us
I20260709 12:17:08.846859 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.852006 23919 raft_consensus.cc:614] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:08.849555 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.845856 24065 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:17:08.856174 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 44088.3us
I20260709 12:17:08.856451 24036 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:08.864439 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.792204 25465 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:08.868124 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:08.864638 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:08.859308 25627 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:08.870409 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.868706 24599 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:08.871460 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.855616 25460 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:08.873538 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.869427 24600 raft_consensus.cc:1217] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:08.857602 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:08.879946 23921 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:08.880151 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:08.862294 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 1551) took 1041 ms. Trace:
I20260709 12:17:08.909327 23886 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
W20260709 12:17:08.922693 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 58092.1us
I20260709 12:17:08.907778 24598 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:08.865527 25629 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:17:08.923440 24564 leader_election.cc:336] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 2.091s (SENT)
I20260709 12:17:08.881713 25469 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:08.867446 25568 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:08.870934 25467 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:08.907114 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:08.940024 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:08.874423 24070 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:08.868291 25519 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.931082 25516 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:08.881862 25525 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.908206 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:08.932693 24596 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.929474 25569 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:08.958585 25467 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:08.959656 25467 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.962880 25519 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:08.963380 25519 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:08.963728 25519 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:08.965507 25566 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:08.945549 25585 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:08.951469 25629 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:08.942685 25469 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:08.967500 25469 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:08.967571 25629 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.971230 25581 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:08.973827 24595 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:08.880748 25423 consensus_queue.cc:1059] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 12:17:08.875070 25632 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:17:08.975242 25423 raft_consensus.cc:3055] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:08.975637 25423 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:08.976460 25423 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:08.867237 25630 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:08.977666 25423 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.978861 25630 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:08.982791 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:08.983506 24061 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:08.945338 25554 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:08.946573 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:08.990844 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 110837us
I20260709 12:17:08.932955 23987 rpcz_store.cc:276] 0709 12:17:07.819936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.822690 (+  2754us) service_pool.cc:224] Handling call
0709 12:17:08.857350 (+1034660us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:08.992245 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 116926us
I20260709 12:17:08.951894 25516 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:08.996357 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:08.997915 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:08.993691 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:08.992621 25631 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:09.003659 25631 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:09.004510 25631 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.004979 25460 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.005466 25460 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:09.006385 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.017660 23962 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:09.019440 23962 leader_election.cc:400] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:09.019896 23962 leader_election.cc:403] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:09.020849 23962 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:09.024981 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:09.026183 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 116927us
I20260709 12:17:08.979646 25569 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.031162 25562 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.031554 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:09.046231 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:09.091567 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.007666 25516 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:08.945067 25459 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:09.121515 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 90016.4us
I20260709 12:17:09.032236 25444 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.032338 25579 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:09.119721 24592 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:09.034447 25656 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.015336 25554 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.028620 25574 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.140048 23995 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:09.034204 25512 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:09.119491 25581 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.172834 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:09.177402 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.151247 25632 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:09.229465 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:09.234411 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:09.235862 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:09.237139 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:09.188678 25471 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:09.192902 25579 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:09.226161 24597 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:17:09.231761 25396 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:17:09.245734 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 311175us
I20260709 12:17:09.239854 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:09.226790 25627 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.258850 23917 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:17:09.193980 25512 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.265633 24065 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:09.266088 25512 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:09.266664 24067 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.268599 25519 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.249387 25471 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.240767 25566 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:09.241431 25465 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.263969 23917 pending_rounds.cc:85] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 5
I20260709 12:17:09.272239 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:09.238711 25632 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.273634 23917 pending_rounds.cc:107] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:17:09.281426 23917 raft_consensus.cc:2889] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:09.292682 23886 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.293433 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:09.295518 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 61180us
I20260709 12:17:09.297816 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:09.299134 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:09.300132 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:09.276711 25566 raft_consensus.cc:697] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:09.330672 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:09.331326 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:09.275033 25512 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:09.293623 24091 debug-util.cc:398] Leaking SignalData structure 0x7b08001c35e0 after lost signal to thread 22720
I20260709 12:17:09.300063 25554 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:09.336674 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 87198.2us
W20260709 12:17:09.335016 25663 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:17:09.303404 25657 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.338862 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:09.339587 24064 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:09.337139 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 160268us
I20260709 12:17:09.332551 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:09.337740 24091 debug-util.cc:398] Leaking SignalData structure 0x7b08001a00c0 after lost signal to thread 22723
I20260709 12:17:09.333503 25627 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:09.334049 25467 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:09.344705 23994 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:09.348037 25396 tablet_bootstrap.cc:492] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:09.348824 24596 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:09.349138 25471 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:09.354465 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:17:09.354661 25519 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:09.358246 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.290350 25579 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.424474 25396 tablet_bootstrap.cc:492] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:17:09.424536 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.385210 25460 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.383293 25423 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:09.387271 25666 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:09.387408 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:09.388167 25469 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:09.390653 25468 consensus_meta.cc:287] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.001s
I20260709 12:17:09.394550 25566 consensus_queue.cc:237] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.395300 24066 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:09.426258 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.401526 25632 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:09.382090 25569 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:09.403985 25444 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:09.383832 25627 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.406210 25516 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:09.406992 24091 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd8a0 after lost signal to thread 23853
I20260709 12:17:09.410316 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.411500 23931 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-10cd478aa7e9411bba254e94713f91de received from {username='slave'} at 127.0.0.1:56870
I20260709 12:17:09.414791 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:09.332654 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:09.423519 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.425287 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:09.431658 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:09.425544 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.432878 23921 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:09.384021 23960 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:09.434598 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.434716 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.446108 23919 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:09.419299 25512 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:09.425412 25656 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:09.451881 25396 ts_tablet_manager.cc:1403] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 1.402s	user 0.028s	sys 0.028s
I20260709 12:17:09.400067 24067 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:17:09.507141 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 123382us
I20260709 12:17:09.511528 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.511657 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:09.506985 23916 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
W20260709 12:17:09.508502 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:09.512349 23988 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:09.449522 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.512607 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.512929 23960 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:09.513128 23920 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:09.476949 24035 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:09.478534 23995 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:09.506664 23914 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:09.516690 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.516963 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:09.480953 24091 debug-util.cc:398] Leaking SignalData structure 0x7b080037c4a0 after lost signal to thread 23945
I20260709 12:17:09.517692 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.515780 25655 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:09.520798 25655 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:09.478729 23915 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:09.478338 25460 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:09.451598 25468 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.521780 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.491882 25627 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:09.522928 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.523157 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.440464 25467 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:09.523450 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:09.519678 24091 debug-util.cc:398] Leaking SignalData structure 0x7b080037c420 after lost signal to thread 23946
I20260709 12:17:09.510614 25444 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:09.507853 25658 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.449846 25423 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.486615 25469 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:09.487383 25516 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:09.525763 23919 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:09.511009 23918 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.530440 23917 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:09.520012 23914 raft_consensus.cc:2393] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:09.509620 24597 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:09.519054 25583 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:09.541378 25618 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:17:09.517542 25656 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:09.550634 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.524468 23913 raft_consensus.cc:2368] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:09.522862 25674 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:09.522975 25573 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:09.561002 25573 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.562542 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.562673 25674 raft_consensus.cc:697] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:09.563674 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.563534 25674 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.564308 23916 raft_consensus.cc:2368] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:09.565047 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.546720 25658 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.554531 25444 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:09.568989 25658 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:09.550693 25519 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:09.569023 25444 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.570168 25519 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:09.571072 25519 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.539686 23990 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.539889 25467 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:09.580224 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.544198 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.581440 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.582082 23919 raft_consensus.cc:2368] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:09.582297 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.582939 25583 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:09.583685 25469 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.583863 25583 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:09.589201 23990 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:09.539067 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.546059 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.511138 25512 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.604292 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:09.604897 24063 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:09.553429 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.606460 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.601161 24035 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:09.607782 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.608474 23914 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.554433 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.555352 23921 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.558440 25615 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.558933 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:09.557489 25655 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:09.578063 25468 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:09.621376 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:09.526539 23931 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-10cd478aa7e9411bba254e94713f91de on tablet 10cd478aa7e9411bba254e94713f91de with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:09.603714 23920 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:09.610383 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.612717 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:09.639027 23917 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.620508 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:09.621651 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:09.632357 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 65868.2us
I20260709 12:17:09.640336 24034 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.632262 25512 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:09.604602 25567 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.632714 25566 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:09.633107 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:09.633311 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:09.551743 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.633937 25423 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:09.634786 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:09.640759 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.642920 23921 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:09.643054 24063 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:09.643476 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:09.643968 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:09.659083 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.662518 23920 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:09.646293 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.647572 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.656402 24564 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:09.657364 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:09.664268 23914 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:09.664284 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:09.655483 23917 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
W20260709 12:17:09.639036 24091 debug-util.cc:398] Leaking SignalData structure 0x7b08003960c0 after lost signal to thread 24020
I20260709 12:17:09.666049 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.669864 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:09.671368 24063 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:09.672849 23960 leader_election.cc:400] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:09.674882 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:09.675616 24063 raft_consensus.cc:2368] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:09.676419 23920 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:09.655736 25523 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.648988 25627 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.639734 23912 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:09.668349 23915 raft_consensus.cc:2376] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2. Re-sending same reply.
I20260709 12:17:09.668038 25512 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.668076 25423 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.706614 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:09.714998 23919 raft_consensus.cc:2368] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:09.703718 23914 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:09.707183 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.705607 24594 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:09.666838 25672 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:17:09.738021 24068 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:09.693531 25630 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.685024 25662 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.678630 25660 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.674983 25659 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:17:09.669210 25632 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 12:17:09.737835 24091 debug-util.cc:398] Leaking SignalData structure 0x7b080036b860 after lost signal to thread 24094
W20260709 12:17:09.755365 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 91154us
I20260709 12:17:09.759527 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:09.760593 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.762564 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.767967 23916 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:09.746523 25547 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:09.764233 25682 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.214s	user 0.001s	sys 0.001s
I20260709 12:17:09.771212 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:09.688012 25656 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.769114 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:09.784634 24591 raft_consensus.cc:2393] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:09.770817 25573 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:09.785840 25573 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:09.786362 25573 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:09.787817 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:09.774598 25677 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:17:09.788877 25547 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.763855 25465 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.791822 25573 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.793882 23988 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:09.797956 24068 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:09.779196 25469 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:09.780149 23918 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:09.762403 25568 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:17:09.783842 25396 raft_consensus.cc:359] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:09.766089 25567 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:17:09.772689 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:09.778848 24091 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc160 after lost signal to thread 24624
I20260709 12:17:09.801313 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:09.802408 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 62273.1us
W20260709 12:17:09.806800 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 44305.6us
W20260709 12:17:09.813400 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 144246us
I20260709 12:17:09.814750 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.815666 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.815796 25615 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.769436 25566 raft_consensus.cc:697] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:09.816733 25674 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.817524 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.817524 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:09.820665 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:09.821458 23987 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:09.809872 25547 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:17:09.823530 23913 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:09.803480 25469 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:09.810295 25465 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.831501 25674 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:09.812072 25396 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:17:09.835604 25396 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:09.824879 25469 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:09.837476 25469 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:09.837833 25396 ts_tablet_manager.cc:1434] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.324s	user 0.004s	sys 0.004s
I20260709 12:17:09.843336 24034 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.848839 25465 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:17:09.854715 23916 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:09.853173 24034 leader_election.cc:400] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:09.855232 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:09.855592 24034 leader_election.cc:403] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:09.817067 25566 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:09.858736 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 264171us
I20260709 12:17:09.860391 24034 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.860013 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.864612 23917 raft_consensus.cc:2368] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3.
I20260709 12:17:09.865542 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.866247 23917 raft_consensus.cc:2376] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4. Re-sending same reply.
I20260709 12:17:09.862063 23988 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:09.867993 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.852721 25615 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.868846 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.869802 23917 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:09.872098 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.873086 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.854902 25686 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.880833 25670 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:09.883332 24564 leader_election.cc:400] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3.
I20260709 12:17:09.860467 25627 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:09.883723 24564 leader_election.cc:403] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:09.884341 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.884543 23962 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:09.888649 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:09.885651 24034 leader_election.cc:400] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:09.889164 24034 leader_election.cc:403] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:09.889946 24034 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.891098 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.891101 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:09.898680 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.922775 25523 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.927071 25424 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:09.927505 25424 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:09.927876 25424 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:09.924777 25547 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3.
I20260709 12:17:09.933423 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:09.937353 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54157.1us
I20260709 12:17:09.885430 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.939013 24564 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.922537 25621 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:09.886703 25630 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.923048 25467 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.944640 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.945245 23916 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:09.922921 25687 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.946074 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.947441 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:09.951184 23916 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:09.952440 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.953541 23916 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:09.944990 24564 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.931941 25674 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:09.935195 25615 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.924747 25691 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:09.957716 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:09.942241 25516 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:09.962194 23916 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:09.965616 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:09.966588 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 77983.2us
I20260709 12:17:09.967451 23962 leader_election.cc:400] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:09.950408 25665 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:09.974701 23912 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:09.967198 23916 raft_consensus.cc:2376] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4. Re-sending same reply.
I20260709 12:17:09.969806 23962 leader_election.cc:403] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:17:10.041428 25693 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:10.043358 24597 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:17:10.045832 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 100894us
I20260709 12:17:09.964443 25662 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.059674 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:09.958664 25621 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:10.047358 24035 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:10.058692 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 167626us
W20260709 12:17:10.047878 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 80553.4us
W20260709 12:17:10.048799 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 107465us
I20260709 12:17:09.969892 25691 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:10.063059 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.070312 24034 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.070683 25627 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:10.052987 25468 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:10.079391 25621 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:10.083870 25691 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:10.071141 25630 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:10.071591 25424 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:10.077466 25523 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:10.074030 25568 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.071859 25674 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.090480 25630 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:10.092278 25424 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:10.097052 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:10.104091 24034 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.116900 25689 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:10.117476 25689 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:10.117933 25689 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.106056 25630 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.126749 25701 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.105495 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:10.113044 25467 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:10.165735 25467 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:10.166316 25467 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:10.120836 25686 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:17:10.145220 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:10.147944 25444 raft_consensus.cc:1064] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:17:10.151028 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:10.154870 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:10.177174 25692 log.cc:927] Time spent T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 12:17:10.180919 23914 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:10.182808 23916 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:10.196570 25465 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:10.198701 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:10.185384 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 125763us
I20260709 12:17:10.189195 23913 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:17:10.191015 24068 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:10.199566 23919 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:10.205005 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:10.208521 23931 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-fe5bb4f2e9f04fbb9241a5e24d5ae777 received from {username='slave'} at 127.0.0.1:56870
I20260709 12:17:10.209139 23931 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-fe5bb4f2e9f04fbb9241a5e24d5ae777 on tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:10.204210 25465 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:17:10.210518 25469 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:10.211681 25469 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:10.212060 25469 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:10.212921 25469 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:10.215144 24564 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.219729 24564 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:10.218273 25465 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:10.190901 25674 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:17:10.222425 25465 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.223353 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:10.230876 25672 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:10.220407 25469 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:10.220768 25471 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.224159 25465 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.240896 25630 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:10.245884 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:10.232060 25665 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:10.250171 24066 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:10.223353 25670 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:17:10.256788 25444 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:10.261902 25674 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:10.262763 25674 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:10.263186 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:10.280984 25674 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:10.281968 25630 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:10.281634 25467 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:10.293426 25615 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:10.314304 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.295989 25687 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:10.322772 23960 leader_election.cc:400] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:10.320390 25465 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:10.322696 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:10.327158 25573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.006s	sys 0.015s
I20260709 12:17:10.323771 25615 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:10.341769 25573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.007s	sys 0.016s
I20260709 12:17:10.341503 25705 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:17:10.325846 25687 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:10.346654 25705 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:10.348461 25687 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:10.349589 23921 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:10.350705 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:10.352451 25465 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:10.353005 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:10.353575 23921 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.354305 25689 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:10.329694 25430 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:17:10.356681 25689 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:10.356961 25430 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:10.357779 25430 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:10.359368 25467 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:10.359449 25554 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:10.371302 25430 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:10.371209 25554 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:10.372680 25430 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.373903 25554 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:10.375826 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:10.364389 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:10.379087 24594 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:17:10.380625 24600 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:10.378211 24593 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:10.384591 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:10.365321 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:10.386969 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:10.388545 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:10.392474 25468 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:10.398685 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:10.398671 25630 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:10.400563 25574 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:10.403929 23990 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:10.406829 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.365959 23921 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:10.415445 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:10.418641 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:10.419409 23917 raft_consensus.cc:2368] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4.
I20260709 12:17:10.417800 23818 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 3, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 3 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.427269 25700 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.427783 25700 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:10.429833 25700 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:10.429836 25632 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:10.431185 25632 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:10.431288 25630 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:10.431546 25632 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:10.431807 25630 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:10.432399 25632 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:10.432652 25630 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:10.433349 24600 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:10.434223 25632 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:10.436178 24564 leader_election.cc:400] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4.
I20260709 12:17:10.419459 25519 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.443845 23921 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:10.448745 25579 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:10.470815 23914 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:10.445405 25621 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:17:10.480341 23914 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:17:10.480752 23914 pending_rounds.cc:85] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 1
I20260709 12:17:10.480955 23914 pending_rounds.cc:107] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:10.481184 23914 raft_consensus.cc:2889] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:10.464125 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:10.478484 23913 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:10.509734 25699 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:17:10.494300 25519 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.515452 25690 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:17:10.521667 23918 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:10.529526 23914 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:10.523087 25660 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.526171 25519 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:10.575948 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:10.577656 23993 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:10.578377 23990 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:10.579754 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:10.581161 23819 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39282 (request call id 307) took 3327 ms. Trace:
I20260709 12:17:10.582056 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:10.584097 23818 catalog_manager.cc:5697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 3, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:10.585160 23992 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:10.532408 25444 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:17:10.571195 23912 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:10.591024 25519 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:10.581424 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:10.592159 25615 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:10.592546 23987 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:10.598805 25569 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:10.585620 23818 catalog_manager.cc:5697] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.613878 23818 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 4, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 4 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:10.616493 23886 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.581514 23819 rpcz_store.cc:276] 0709 12:17:07.254072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:07.255089 (+  1017us) service_pool.cc:224] Handling call
0709 12:17:10.581102 (+3326013us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:09.007325 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:09.254395 (+247070us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:09.254428 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:17:09.254441 (+    13us) tablet.cc:662] Decoding operations
0709 12:17:09.255397 (+   956us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:09.255452 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:09.255478 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:17:09.255808 (+   330us) tablet.cc:701] Row locks acquired
0709 12:17:09.255826 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:17:09.255954 (+   128us) write_op.cc:270] Start()
0709 12:17:09.256060 (+   106us) write_op.cc:276] Timestamp: P: 1783599429255910 usec, L: 0
0709 12:17:09.256087 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:17:09.256770 (+   683us) log.cc:844] Serialized 1299 byte log entry
0709 12:17:09.520780 (+264010us) op_driver.cc:464] REPLICATION: finished
0709 12:17:09.734514 (+213734us) write_op.cc:301] APPLY: starting
0709 12:17:09.742812 (+  8298us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:09.748724 (+  5912us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:09.761442 (+ 12718us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:09.818121 (+ 56679us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:09.819704 (+  1583us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:17:09.819745 (+    41us) write_op.cc:312] APPLY: finished
0709 12:17:09.819975 (+   230us) log.cc:844] Serialized 35 byte log entry
0709 12:17:09.820139 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:09.820239 (+   100us) write_op.cc:454] Released schema lock
0709 12:17:09.820278 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:09.820639 (+   361us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:09.820665 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":100973,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":192848,"apply.run_cpu_time_us":2974,"apply.run_wall_time_us":106770,"num_ops":3,"prepare.queue_time_us":157285,"prepare.run_cpu_time_us":14193,"prepare.run_wall_time_us":329954,"raft.queue_time_us":106812,"raft.run_cpu_time_us":55863,"raft.run_wall_time_us":90033,"replication_time_us":264567,"spinlock_wait_cycles":1280,"thread_start_us":279926,"threads_started":4,"wal-append.queue_time_us":139595}]]}
I20260709 12:17:10.624292 24036 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.619454 23818 catalog_manager.cc:5697] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 2 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:17:10.626260 23818 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 3, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 3 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.621191 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:10.644493 23818 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:10.644155 25460 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.625516 25615 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:10.601639 25660 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:10.631436 25701 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:10.673177 25660 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:10.674749 23916 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:10.690922 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:10.693728 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 66561.7us
I20260709 12:17:10.701421 24036 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.713068 24067 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:10.705317 25523 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:10.705119 25627 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:17:10.726398 24034 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:10.727744 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:10.727669 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.729208 25467 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:10.731415 25467 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:10.697767 25674 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:17:10.738047 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:10.738580 25701 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:10.705719 25444 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:10.740650 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:10.751075 23992 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:10.752389 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:10.743997 24068 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:10.719763 25459 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.760814 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:10.761511 24065 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:10.754768 25618 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:10.764149 25444 raft_consensus.cc:3055] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:10.764087 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:10.766139 25459 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:10.767269 23915 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:10.739162 25701 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:10.768529 25467 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:10.775435 23921 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:17:10.778824 23921 pending_rounds.cc:85] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 4
I20260709 12:17:10.779170 23921 pending_rounds.cc:107] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:17:10.779467 23921 raft_consensus.cc:2889] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:10.781198 23921 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:10.776039 24564 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.754056 25424 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:17:10.793435 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.795078 25554 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:10.794620 25591 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:10.798507 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:10.772266 25444 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:10.808827 25708 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:10.810989 25708 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:10.806424 25423 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:10.815580 25423 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:10.815976 25423 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:10.819048 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:10.906447 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 68347.6us
I20260709 12:17:10.813522 25708 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:10.774432 25618 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:11.000204 24066 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:10.822619 25631 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:17:10.949281 25627 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:17:11.015062 25632 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:11.036815 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 1619) took 1408 ms. Trace:
I20260709 12:17:11.037329 24061 rpcz_store.cc:276] 0709 12:17:09.620159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.620285 (+   126us) service_pool.cc:224] Handling call
0709 12:17:11.028303 (+1408018us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400264b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:11.028458 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3151814016}
I20260709 12:17:11.038507 24591 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEARNER]: Advancing to term 6
I20260709 12:17:11.039096 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:10.963961 25701 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.015484 25632 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:11.064864 25660 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.065325 23915 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:11.065516 24063 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:11.065485 25660 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:11.070628 25423 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.073244 25459 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:11.072289 25660 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:11.088685 24600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.051s	sys 0.060s
W20260709 12:17:11.089270 24600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.052s	sys 0.060s
I20260709 12:17:11.092849 25674 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:11.093538 25566 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:11.093477 25674 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.094178 25566 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.096865 25566 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:11.013402 25444 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.099843 24061 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:11.081454 25569 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:17:11.097263 25674 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:11.133942 24063 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:11.104189 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:11.146653 25423 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:11.142118 25569 consensus_queue.cc:1243] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer a46beb8868d749fdbaa732dd1ef6b89b log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:11.167686 25708 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.169943 25708 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:11.170598 25618 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:11.171489 23912 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:11.171592 24068 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:11.171983 25618 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:11.172473 25444 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.173784 25621 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.180410 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:11.181363 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:11.143463 24594 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:11.184813 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:11.205755 24063 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:11.207604 24599 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:11.207715 24062 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:11.200603 25660 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:11.217707 25674 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:11.215225 25523 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.218395 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:11.219378 25660 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:11.225919 25687 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:11.225559 25699 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260709 12:17:11.328809 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 98054.3us
W20260709 12:17:11.334414 23917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.002s	sys 0.039s
W20260709 12:17:11.327711 23914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.010s	sys 0.018s
I20260709 12:17:11.213594 25661 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
I20260709 12:17:11.278230 25660 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:11.315038 24596 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.021s	sys 0.051s
I20260709 12:17:11.337719 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:11.344229 24066 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:11.346824 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:11.324877 23913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.016s	sys 0.023s
I20260709 12:17:11.350029 25519 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:11.453640 24591 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:11.332962 25423 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:11.455475 23919 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:17:11.335489 25732 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.227s	user 0.000s	sys 0.004s
I20260709 12:17:11.458474 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:11.462756 23917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.002s	sys 0.039s
W20260709 12:17:11.462657 23914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.011s	sys 0.018s
W20260709 12:17:11.491277 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 140668us
W20260709 12:17:11.490674 23960 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.017s	sys 0.009s
W20260709 12:17:11.516578 23960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.018s	sys 0.009s
I20260709 12:17:11.479163 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:11.460222 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:11.471342 23913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.016s	sys 0.023s
I20260709 12:17:11.335666 25523 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:11.466041 24596 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.021s	sys 0.052s
W20260709 12:17:11.564235 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 47884.8us
I20260709 12:17:11.464808 25688 consensus_queue.cc:1059] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
W20260709 12:17:11.556885 25467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.020s	sys 0.036s
I20260709 12:17:11.584262 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:11.597868 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.072s
W20260709 12:17:11.598507 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.000s	sys 0.072s
W20260709 12:17:11.598901 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 512793us
I20260709 12:17:11.514614 25618 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:17:11.553977 24065 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:11.524473 25423 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:11.585917 25467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.021s	sys 0.036s
I20260709 12:17:11.552250 25708 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:17:11.550045 25689 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:17:11.632474 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:11.586598 25469 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:11.628950 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 56907.3us
I20260709 12:17:11.582026 25627 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.604982 25674 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:11.644070 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:11.621572 25673 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:11.582209 25585 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:17:11.684430 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:11.642192 25615 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:11.743352 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 55430.6us
I20260709 12:17:11.745043 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:11.745754 23919 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
W20260709 12:17:11.696141 25726 log.cc:927] Time spent T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.063s	user 0.003s	sys 0.000s
I20260709 12:17:11.643575 25469 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.645205 25627 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.648442 25574 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:17:11.649492 25674 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.712124 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:11.713683 25465 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:11.753456 25573 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:11.790377 25615 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:11.802038 25742 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
W20260709 12:17:11.802891 25734 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:17:11.797013 23915 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
W20260709 12:17:11.805361 25741 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:17:11.760077 25730 log.cc:927] Time spent T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 12:17:11.831986 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1637) took 1008 ms. Trace:
I20260709 12:17:11.832758 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 682) took 1368 ms. Trace:
I20260709 12:17:11.832432 23920 rpcz_store.cc:276] 0709 12:17:10.823365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.823482 (+   117us) service_pool.cc:224] Handling call
0709 12:17:10.823773 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.823957 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.823980 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.824393 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.223437 (+399044us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:11.223479 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.223556 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.831768 (+608212us) raft_consensus.cc:1685] finished
0709 12:17:11.831795 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.831931 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":267509,"threads_started":1,"wal-append.queue_time_us":754366}
I20260709 12:17:11.837152 25627 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:11.837440 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1511) took 1139 ms. Trace:
I20260709 12:17:11.837934 23913 rpcz_store.cc:276] 0709 12:17:10.697593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.702014 (+  4421us) service_pool.cc:224] Handling call
0709 12:17:10.730808 (+ 28794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.731172 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.731206 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.737370 (+  6164us) log.cc:844] Serialized 548 byte log entry
0709 12:17:11.566309 (+828939us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:11.577669 (+ 11360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.583288 (+  5619us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.827347 (+244059us) raft_consensus.cc:1685] finished
0709 12:17:11.837169 (+  9822us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.837372 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":793865,"threads_started":1,"wal-append.queue_time_us":952125}
I20260709 12:17:11.833271 24600 rpcz_store.cc:276] 0709 12:17:10.464448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.464571 (+   123us) service_pool.cc:224] Handling call
0709 12:17:10.464837 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.465165 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.465191 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.471914 (+  6723us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.089787 (+617873us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:11.089844 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.089937 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.832562 (+742625us) raft_consensus.cc:1685] finished
0709 12:17:11.832581 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.832707 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2429,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"thread_start_us":593086,"threads_started":1,"wal-append.queue_time_us":788014}
I20260709 12:17:11.818181 23919 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:11.790153 25632 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:11.789855 25460 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:11.823356 25739 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:17:11.824337 25674 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:11.857919 23987 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.004s	sys 0.013s
W20260709 12:17:11.861133 23987 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.005s	sys 0.013s
I20260709 12:17:11.812469 25469 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:11.815286 25523 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:11.796554 25465 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:11.901079 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1518) took 1158 ms. Trace:
I20260709 12:17:11.904388 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1491) took 1491 ms. Trace:
I20260709 12:17:11.816835 25615 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:11.905189 23917 rpcz_store.cc:276] 0709 12:17:10.413125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.420912 (+  7787us) service_pool.cc:224] Handling call
0709 12:17:10.421166 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.421817 (+   651us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.421844 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.434979 (+ 13135us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.515657 (+1080678us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:11.515711 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.515776 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.904045 (+388269us) raft_consensus.cc:1685] finished
0709 12:17:11.904080 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.904293 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6436,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"thread_start_us":1080274,"threads_started":1,"wal-append.queue_time_us":1193801}
I20260709 12:17:11.901921 23916 rpcz_store.cc:276] 0709 12:17:10.743051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.757563 (+ 14512us) service_pool.cc:224] Handling call
0709 12:17:10.757863 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.758059 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.758085 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.792683 (+ 34598us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.142615 (+349932us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:11.142652 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.142714 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.900751 (+758037us) raft_consensus.cc:1685] finished
0709 12:17:11.900782 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.900996 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":320949,"threads_started":1,"wal-append.queue_time_us":812250}
I20260709 12:17:11.864295 25632 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:11.916301 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:11.917547 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:11.917645 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:11.919664 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1510) took 1224 ms. Trace:
I20260709 12:17:11.920106 25584 raft_consensus.cc:3055] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:11.926604 25584 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:11.927561 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 431) took 1271 ms. Trace:
I20260709 12:17:11.927517 25584 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:11.928791 25584 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:11.866365 25460 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:11.911463 25423 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:11.932794 23989 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:11.936832 23919 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:11.935005 25615 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:11.939747 25760 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.943706 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:11.944458 23996 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:11.943152 25465 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:11.925524 25749 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:11.925253 23918 rpcz_store.cc:276] 0709 12:17:10.695493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.698926 (+  3433us) service_pool.cc:224] Handling call
0709 12:17:10.716866 (+ 17940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.754332 (+ 37466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.756767 (+  2435us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.761898 (+  5131us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.161300 (+399402us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:11.197604 (+ 36304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.203664 (+  6060us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.909265 (+705601us) raft_consensus.cc:1685] finished
0709 12:17:11.911145 (+  1880us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.919597 (+  8452us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7650,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":5667,"thread_start_us":324914,"threads_started":1,"wal-append.queue_time_us":792298}
W20260709 12:17:12.014694 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.022761 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:11.947391 25737 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
W20260709 12:17:12.036850 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 212881us
I20260709 12:17:12.034991 25519 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.079973 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:11.961825 25660 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.108961 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:12.109663 24068 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
W20260709 12:17:12.117668 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 305483us
I20260709 12:17:12.147469 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.116420 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.151705 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:12.148809 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1514) took 1450 ms. Trace:
I20260709 12:17:12.054965 25469 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.157116 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:12.038177 25423 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:12.158658 25754 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.336s	user 0.004s	sys 0.000s
I20260709 12:17:12.158514 25621 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:12.159337 25621 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:12.159708 25621 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:12.160709 25621 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.161896 25621 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:12.163511 25658 consensus_queue.cc:1059] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:12.164507 25413 raft_consensus.cc:3055] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:12.164856 25413 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:12.165467 25469 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.166051 23960 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:12.167753 25469 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:12.168234 25413 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.170044 25413 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:11.928010 24596 rpcz_store.cc:276] 0709 12:17:10.655826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.656341 (+   515us) service_pool.cc:224] Handling call
0709 12:17:10.656722 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.677304 (+ 20582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.677342 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.677861 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.586850 (+908989us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:11.615365 (+ 28515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.620279 (+  4914us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:11.922667 (+302388us) raft_consensus.cc:1685] finished
0709 12:17:11.922690 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:11.927496 (+  4806us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1128,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":13164,"thread_start_us":893738,"threads_started":1,"wal-append.queue_time_us":1005302}
I20260709 12:17:12.173202 25660 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:12.153102 23914 rpcz_store.cc:276] 0709 12:17:10.698501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.699988 (+  1487us) service_pool.cc:224] Handling call
0709 12:17:10.700253 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.702931 (+  2678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.702962 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.703436 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.516072 (+812636us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:11.516118 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.516194 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:12.148635 (+632441us) raft_consensus.cc:1685] finished
0709 12:17:12.148654 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.148759 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3076,"raft.queue_time_us":3377,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4029,"thread_start_us":812346,"threads_started":1,"wal-append.queue_time_us":934278}
I20260709 12:17:12.125630 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:12.085929 25744 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260709 12:17:12.175100 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.085705 25519 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.178491 24599 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:12.019366 25749 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.086194 25766 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.147500 25740 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:12.234253 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 178589us
I20260709 12:17:12.241291 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:12.255049 23914 raft_consensus.cc:2410] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:12.241930 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:12.243172 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:12.204550 25469 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.158133 25423 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.230733 25430 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.232295 25659 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.235689 24063 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:12.259714 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:12.239629 25758 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.268570 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:12.254289 25576 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.271934 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1520) took 1478 ms. Trace:
I20260709 12:17:12.251379 25627 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.273890 23921 rpcz_store.cc:276] 0709 12:17:10.793891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.794179 (+   288us) service_pool.cc:224] Handling call
0709 12:17:10.796245 (+  2066us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:10.796672 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:10.796717 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:10.797288 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.348730 (+551442us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:11.348768 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.348890 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:12.271742 (+922852us) raft_consensus.cc:1685] finished
0709 12:17:12.271762 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:12.271879 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8934,"thread_start_us":396569,"threads_started":1,"wal-append.queue_time_us":824160}
I20260709 12:17:12.262830 25615 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.236116 25740 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.284185 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:12.312325 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:12.313097 24064 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.276084 25566 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.281296 24591 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:17:12.262620 25469 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.284823 25658 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.314754 25701 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:12.274048 25758 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.325013 25423 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:12.328394 24035 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:12.329596 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 61106.8us
I20260709 12:17:12.335790 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:12.316009 23913 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:12.322118 24591 pending_rounds.cc:85] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 5
I20260709 12:17:12.340427 24591 pending_rounds.cc:107] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:17:12.340818 24591 raft_consensus.cc:2889] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:12.277462 25576 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.343799 25576 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:12.280113 25627 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.268851 25659 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.326447 25523 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.348644 25778 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:12.352408 25519 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:12.363327 25512 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:12.307379 25615 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.347288 25672 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.363827 25512 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:12.364449 25523 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.379856 25512 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:12.389513 25701 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:12.365073 25778 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:12.400916 25769 log.cc:927] Time spent T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:17:12.396935 25615 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:12.372520 25672 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.403247 25749 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:12.416540 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:12.420804 24064 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:12.418355 25659 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:12.439047 25778 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:12.414104 25627 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:12.449834 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:12.451872 25512 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.454017 25512 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:12.456429 25781 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:17:12.460719 25771 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.462850 25771 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.436966 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:12.464967 25771 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:12.444615 25776 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.087s	user 0.001s	sys 0.001s
I20260709 12:17:12.470160 25758 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:12.432920 25740 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:12.472805 25523 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:12.445770 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:12.485126 25672 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:12.487061 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.480047 23994 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:12.461575 25469 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:12.520407 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 192096us
I20260709 12:17:12.535873 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:12.512198 23994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 1587) took 1157 ms. Trace:
I20260709 12:17:12.536775 23916 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
W20260709 12:17:12.771490 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 435722us
I20260709 12:17:12.733945 25471 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.801992 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.736505 25573 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.736866 25740 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.737126 25758 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.736732 25523 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.763886 25627 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.736456 23994 rpcz_store.cc:276] 0709 12:17:11.345160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.347958 (+  2798us) service_pool.cc:224] Handling call
0709 12:17:12.424551 (+1076593us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:12.501746 (+ 77195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2932608}
I20260709 12:17:12.775254 25665 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:12.790879 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.815661 25573 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:12.891558 23918 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.023s	sys 0.051s
I20260709 12:17:12.902222 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.903692 23993 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:12.903930 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:12.813745 25471 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.905334 23996 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:12.914040 25512 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:12.817291 25740 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:12.900496 23918 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.023s	sys 0.052s
I20260709 12:17:12.817054 25758 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.835029 25665 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.915093 25573 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:12.819166 25523 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.896836 25672 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.931027 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.932408 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.824009 25627 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:17:12.944977 23887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.004s	sys 0.012s
W20260709 12:17:12.945379 23887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.004s	sys 0.012s
W20260709 12:17:12.945703 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 662885us
I20260709 12:17:12.946480 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:12.940081 25460 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:12.954779 25795 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.927779 25512 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.955933 25758 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:12.957943 25790 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.949193 25615 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:12.959757 25792 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.955474 25627 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:12.952921 25573 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.964298 25793 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:12.961681 25773 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:17:12.956000 25566 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.963207 25615 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.944847 25672 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.963364 25674 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:12.955353 25795 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.969547 25792 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.974491 25615 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:12.988384 23887 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:12.973311 25573 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:12.989401 25783 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.008s	sys 0.013s
W20260709 12:17:13.046948 24600 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.012s	sys 0.008s
W20260709 12:17:13.048857 24600 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.012s	sys 0.008s
I20260709 12:17:13.053129 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:13.055155 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 63298.7us
I20260709 12:17:12.973110 25790 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:12.976024 25566 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:12.980114 25793 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:13.052588 25783 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.008s	sys 0.014s
I20260709 12:17:13.048273 25469 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.071636 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:12.985181 25674 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.073578 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.084683 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.088256 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.088824 25471 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.089002 23996 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:13.089367 25471 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.088236 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.089920 23993 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:13.089841 25471 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.094458 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:13.095981 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:13.101178 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 444) took 1469 ms. Trace:
I20260709 12:17:13.101680 24595 rpcz_store.cc:276] 0709 12:17:11.631364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.631510 (+   146us) service_pool.cc:224] Handling call
0709 12:17:13.100331 (+1468821us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:13.100562 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.100773 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.100809 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.100863 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:13.100917 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.100986 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.101112 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5205376}
I20260709 12:17:13.067567 25630 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:13.072288 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.074357 25740 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.076982 25660 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:13.110368 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.086684 25469 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:13.097833 25796 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:17:13.134181 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.127107 25471 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.103940 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.109247 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.120105 25804 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:13.118932 25793 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.120291 25792 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.120918 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.184783 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.183099 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.239373 24599 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:13.240096 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.185451 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.247596 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.248631 24064 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
W20260709 12:17:13.250384 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 154493us
I20260709 12:17:13.241348 24062 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:13.117766 25795 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.185964 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.121806 25523 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.252692 24067 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:13.219767 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.124147 25660 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.244952 24035 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:13.115938 25800 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.254019 24068 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:13.231117 25775 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.905s	user 0.005s	sys 0.009s
I20260709 12:17:13.134064 25512 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.197260 25584 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:13.197202 25519 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:13.262917 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.255007 25804 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.262247 25573 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.254709 23995 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:13.254654 24070 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:13.259407 25523 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:13.275584 25674 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.276779 23913 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:13.264703 25660 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.264683 25469 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.285633 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1367) took 1366 ms. Trace:
I20260709 12:17:13.268074 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:13.265601 25672 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.292858 24061 rpcz_store.cc:276] 0709 12:17:11.919467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.919581 (+   114us) service_pool.cc:224] Handling call
0709 12:17:11.919847 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:11.920197 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.920222 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:11.920692 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:17:12.228609 (+307917us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:12.228652 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:12.228725 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.222584 (+993859us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:13.279558 (+ 56974us) raft_consensus.cc:1685] finished
0709 12:17:13.279580 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.285571 (+  5991us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7167,"raft.queue_time_us":2609,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":2105,"spinlock_wait_cycles":4270976,"thread_start_us":283975,"threads_started":1,"wal-append.queue_time_us":387771}
I20260709 12:17:13.266347 25670 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.296670 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:13.279588 25584 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.298552 25554 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.300959 25512 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:13.306211 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:13.279428 25519 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.295310 25523 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:13.279011 25800 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.319778 25660 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:13.320292 25512 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.318192 25670 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.330631 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.330313 25615 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.344300 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1544) took 1095 ms. Trace:
I20260709 12:17:13.349473 23913 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:13.349660 25523 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.360898 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.363529 25584 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.364091 25800 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.365437 25790 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.367925 25512 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.369043 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1651) took 1119 ms. Trace:
I20260709 12:17:13.370685 25815 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:13.369522 23912 rpcz_store.cc:276] 0709 12:17:12.249256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.284590 (+ 35334us) service_pool.cc:224] Handling call
0709 12:17:12.330999 (+ 46409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:12.816602 (+485603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:12.819798 (+  3196us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:12.825296 (+  5498us) log.cc:844] Serialized 26 byte log entry
0709 12:17:13.138537 (+313241us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:13.167955 (+ 29418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.197087 (+ 29132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.368779 (+171692us) raft_consensus.cc:1685] finished
0709 12:17:13.368803 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.368967 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68039,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":25438,"thread_start_us":742462,"threads_started":2,"wal-append.queue_time_us":503278}
I20260709 12:17:13.371325 25815 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:13.371999 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.378638 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.379190 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.383104 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1645) took 1723 ms. Trace:
I20260709 12:17:13.380988 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.372515 25815 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.383550 23919 rpcz_store.cc:276] 0709 12:17:11.659276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.876824 (+217548us) service_pool.cc:224] Handling call
0709 12:17:11.877177 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:11.937234 (+ 60057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.382853 (+1445619us) spinlock_profiling.cc:243] Waited 59.3 ms on lock 0x7b54002eca54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:13.383040 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136439168}
I20260709 12:17:13.388803 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.393743 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.394670 23913 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:17:13.397189 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 260) took 1356 ms. Trace:
I20260709 12:17:13.399715 25670 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.399462 23915 rpcz_store.cc:276] 0709 12:17:12.040851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.052299 (+ 11448us) service_pool.cc:224] Handling call
0709 12:17:12.959816 (+907517us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2deee 000000000036eb39 00007f75c5ba11e0 00007f75c5c6a0c4 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:12.959989 (+   173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.960200 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:12.960500 (+   300us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.351314 (+390814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.356053 (+  4739us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:13.357360 (+  1307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.381207 (+ 23847us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.391045 (+  9838us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1347,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"spinlock_wait_cycles":67447552,"thread_start_us":383655,"threads_started":1}
I20260709 12:17:13.404102 25615 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.405557 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:13.406358 24594 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.400684 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.412496 23921 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:13.411693 25804 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.388098 25817 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:13.413128 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1652) took 1163 ms. Trace:
I20260709 12:17:13.413358 25817 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.419370 25787 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.383939 25800 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.419966 25787 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.423565 25512 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.413829 25817 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.413544 23921 rpcz_store.cc:276] 0709 12:17:12.249815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.411856 (+1162041us) service_pool.cc:224] Handling call
0709 12:17:13.412185 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.412875 (+   690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.413076 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:13.426115 23919 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:13.420451 25615 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.433394 25800 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.437748 24594 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:13.424731 25512 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.382303 23912 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:13.481899 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.482064 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.471663 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1541) took 1224 ms. Trace:
I20260709 12:17:13.484105 24067 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:13.484422 23920 rpcz_store.cc:276] 0709 12:17:12.247532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.256733 (+  9201us) service_pool.cc:224] Handling call
0709 12:17:13.470897 (+1214164us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:13.471117 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.471307 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.471335 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.471377 (+    42us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:13.471416 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.471478 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.471603 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7182080}
I20260709 12:17:13.488130 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:13.495963 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.458804 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37708 (request call id 415) took 1284 ms. Trace:
I20260709 12:17:13.504266 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.504662 24594 rpcz_store.cc:276] 0709 12:17:12.174069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.182341 (+  8272us) service_pool.cc:224] Handling call
0709 12:17:13.405360 (+1223019us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:13.458710 (+ 53350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6316800}
W20260709 12:17:13.473081 25770 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 1.268s	user 0.006s	sys 0.022s
I20260709 12:17:13.460307 25512 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.464525 25665 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.510106 25670 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:13.519529 25787 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.443835 25615 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.519454 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.516484 25554 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.519351 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.535189 25822 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.537921 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.535732 25670 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.445312 25800 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.547463 24070 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:13.545621 23995 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:13.548682 25670 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:13.551388 25687 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.328s	user 0.003s	sys 0.010s
I20260709 12:17:13.551033 25789 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:13.552242 25687 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.347s	user 0.003s	sys 0.010s
I20260709 12:17:13.358456 23918 rpcz_store.cc:276] 0709 12:17:12.248409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.264358 (+ 15949us) service_pool.cc:224] Handling call
0709 12:17:12.306957 (+ 42599us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.322294 (+ 15337us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:12.942756 (+620462us) log.cc:844] Serialized 14 byte log entry
0709 12:17:13.328901 (+386145us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.328969 (+    68us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:13.331414 (+  2445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.336831 (+  5417us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.344014 (+  7183us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":112660,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":137333,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":824,"spinlock_wait_cycles":2451200,"thread_start_us":903000,"threads_started":3,"wal-append.queue_time_us":393395}
I20260709 12:17:13.543855 25554 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.552482 25789 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.566040 25430 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:13.566847 25430 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:13.571379 25767 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 1.322s	user 0.003s	sys 0.000s
I20260709 12:17:13.575821 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1664) took 2395 ms. Trace:
I20260709 12:17:13.576313 23987 rpcz_store.cc:276] 0709 12:17:11.180370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.182431 (+  2061us) service_pool.cc:224] Handling call
0709 12:17:11.182819 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:11.183275 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:11.183308 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:11.183794 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:17:11.861582 (+677788us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:11.861633 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:11.861719 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:13.548970 (+1687251us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:13.575410 (+ 26440us) raft_consensus.cc:1685] finished
0709 12:17:13.575442 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.575712 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":77,"spinlock_wait_cycles":32458112,"thread_start_us":677378,"threads_started":1,"wal-append.queue_time_us":968023}
I20260709 12:17:13.549072 25822 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.605475 25708 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:13.605899 25829 log.cc:927] Time spent T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:13.606105 25708 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.561655 25820 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.563987 25824 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.586495 25823 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:13.625741 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 319577us
I20260709 12:17:13.627588 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:13.637210 24034 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:13.638193 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.638797 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.639510 24062 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:13.628093 25823 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.640789 25708 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.641948 25823 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.642648 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.643113 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:13.643308 23917 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:13.644405 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:13.648437 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.649255 25573 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:13.650983 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 688) took 2058 ms. Trace:
I20260709 12:17:13.651716 24592 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEARNER]: Advancing to term 3
I20260709 12:17:13.652904 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.654515 25757 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:13.655001 25813 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.314s	user 0.002s	sys 0.000s
I20260709 12:17:13.655053 25757 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.655661 25757 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.656563 25658 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:13.657001 25658 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:13.660836 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.663849 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:13.664631 24062 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:13.700888 25661 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:13.701742 25661 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.703928 25430 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:13.704799 25661 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.705994 25430 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.707839 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:13.623891 25820 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.633496 25831 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:13.660108 25787 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:13.651446 24591 rpcz_store.cc:276] 0709 12:17:11.592690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.604795 (+ 12105us) service_pool.cc:224] Handling call
0709 12:17:11.639326 (+ 34531us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:12.341439 (+702113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.650723 (+1309284us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400556c54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:13.650920 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1417671424}
I20260709 12:17:13.641959 25554 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.624393 25824 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.698117 25672 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:13.645116 25827 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:13.637302 25566 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.709471 25823 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.707044 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.719292 25674 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:13.708967 25423 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.707610 25708 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.723632 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:13.766402 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.710482 25573 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:17:13.747542 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.750922 25827 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:13.767827 25787 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:17:13.757946 25661 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:13.724952 25831 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.763326 25832 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.761713 25615 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.763741 25823 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.810081 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1542) took 1562 ms. Trace:
I20260709 12:17:13.811378 23914 rpcz_store.cc:276] 0709 12:17:12.247856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.258865 (+ 11009us) service_pool.cc:224] Handling call
0709 12:17:13.809471 (+1550606us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:13.809637 (+   166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.809789 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.809816 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.809853 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:13.809883 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.809934 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:13.810031 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2590464}
I20260709 12:17:13.763015 25674 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.770537 25423 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.815627 24597 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:13.816764 25823 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.817044 25423 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.807655 25661 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.821126 25824 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.811419 25832 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:13.824671 25832 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.776791 25815 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.825523 25815 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:13.828293 25815 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.835237 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.836747 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.837431 24064 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:17:13.838443 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:13.757570 25672 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.774528 25827 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:13.839061 24064 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:13.768003 23912 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:13.780725 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.775516 23987 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:13.805229 25837 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.903270 25837 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.905422 25837 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:13.853382 24592 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:13.861411 25815 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:13.847774 25795 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.864634 25519 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:13.866819 25834 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 12:17:13.867841 25658 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:13.868906 25836 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:17:13.874482 25831 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.875438 25820 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:13.890030 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 52480.3us
I20260709 12:17:13.891916 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.766373 25757 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.892491 24062 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:13.895134 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.877977 25800 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.896744 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.901446 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.840899 25674 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.770850 25708 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:13.908504 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 142875us
I20260709 12:17:13.911917 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:13.908385 25749 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.957371 24600 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:13.908417 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:13.958750 24066 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:13.962589 24067 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:13.963781 23960 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:13.956540 25690 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:13.929374 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 690) took 1818 ms. Trace:
I20260709 12:17:13.970368 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:13.955832 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:13.959275 25699 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:13.974822 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:13.919996 25815 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.973755 25519 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:13.963238 25787 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:13.960527 25629 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:13.985814 25787 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.986045 25629 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.988778 25708 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.963099 25824 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.989437 25824 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.990824 25658 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.991374 25824 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:13.977191 25690 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:13.940063 25670 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:14.000509 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:17:13.983369 25817 consensus_meta.cc:287] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.005s
I20260709 12:17:13.980713 23913 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.002149 24036 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:13.919507 25795 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.988874 25579 raft_consensus.cc:1064] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:17:13.980144 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:13.963495 25584 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:13.976292 25444 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:13.975111 25800 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:13.998118 25690 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:13.968650 25749 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:14.028170 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 47154.4us
I20260709 12:17:14.029022 24599 raft_consensus.cc:2393] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 2: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:14.001794 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:14.032456 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 53450.2us
I20260709 12:17:14.033339 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:14.092911 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 59669.3us
I20260709 12:17:14.094506 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:14.095691 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:13.983021 25699 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:13.975340 24592 rpcz_store.cc:276] 0709 12:17:12.110166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.114382 (+  4216us) service_pool.cc:224] Handling call
0709 12:17:13.651375 (+1536993us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:13.651578 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.912885 (+261307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:13.926013 (+ 13128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12477184}
I20260709 12:17:14.030750 25832 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:14.097196 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:14.112854 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.113034 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.114143 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.114181 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.115473 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.034236 25584 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:14.118151 25584 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:14.119848 23914 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:14.120635 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.121670 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.121840 23818 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43626 (request call id 193) took 4638 ms. Trace:
I20260709 12:17:14.122753 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.123878 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.125443 23819 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 2 to 4, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 4 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.127297 23819 catalog_manager.cc:5697] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 3, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.129851 25841 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:14.130460 25841 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:14.130885 25841 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:13.958164 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:14.091584 25523 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:14.133476 25523 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:14.136418 25579 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:14.142814 25629 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.147478 25670 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.148463 25749 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.149194 25757 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:14.149547 25795 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:14.092947 25790 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:14.150177 25790 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:14.150586 25790 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.151626 25815 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:14.152776 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:14.154050 25672 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.093469 25800 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:14.156247 25800 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:14.157250 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:14.162943 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.036191 25846 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:14.097615 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.030937 25444 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:14.028615 25574 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:14.106498 25519 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:14.097695 25708 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.129724 23819 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 3, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.193751 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.190572 25444 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.194708 23987 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:14.194995 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.145967 25827 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.206779 23915 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:14.208279 25789 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.192057 23989 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:14.193286 23819 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 4 to 6, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.193727 25574 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.192322 25519 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:14.229655 23819 catalog_manager.cc:5697] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.232012 23819 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 4, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 4 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:14.234989 25519 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:14.107976 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 105907us
I20260709 12:17:14.037046 25766 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:14.013633 25817 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.096771 25824 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:14.172116 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:14.242581 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:14.242970 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.243441 24036 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:14.245319 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:14.122195 23818 rpcz_store.cc:276] 0709 12:17:09.483176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:09.483330 (+   154us) service_pool.cc:224] Handling call
0709 12:17:14.121755 (+4638425us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:11.822184 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:11.939121 (+116937us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:11.939154 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:17:11.939172 (+    18us) tablet.cc:662] Decoding operations
0709 12:17:11.940043 (+   871us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:11.940109 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:11.940138 (+    29us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:17:11.940687 (+   549us) tablet.cc:701] Row locks acquired
0709 12:17:11.940702 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:17:11.940840 (+   138us) write_op.cc:270] Start()
0709 12:17:11.940964 (+   124us) write_op.cc:276] Timestamp: P: 1783599431940795 usec, L: 0
0709 12:17:11.940989 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:17:11.941597 (+   608us) log.cc:844] Serialized 2854 byte log entry
0709 12:17:13.140934 (+1199337us) op_driver.cc:464] REPLICATION: finished
0709 12:17:13.470322 (+329388us) write_op.cc:301] APPLY: starting
0709 12:17:13.470442 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:13.470664 (+   222us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:13.470806 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:13.471797 (+   991us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:13.472002 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:17:13.472064 (+    62us) write_op.cc:312] APPLY: finished
0709 12:17:13.472387 (+   323us) log.cc:844] Serialized 59 byte log entry
0709 12:17:13.472557 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:13.472708 (+   151us) write_op.cc:454] Released schema lock
0709 12:17:13.472780 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:13.473254 (+   474us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:13.473284 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":751010,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":263028,"apply.run_cpu_time_us":2884,"apply.run_wall_time_us":28333,"num_ops":7,"prepare.queue_time_us":1124675,"prepare.run_cpu_time_us":13494,"prepare.run_wall_time_us":440321,"raft.queue_time_us":693874,"raft.run_cpu_time_us":12384,"raft.run_wall_time_us":244618,"replication_time_us":1167130,"thread_start_us":1566416,"threads_started":4,"wal-append.queue_time_us":413618}]]}
I20260709 12:17:14.249405 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:14.217602 25841 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.251232 25766 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:14.253945 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.254601 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.255347 25817 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.256182 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.256883 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.248035 25824 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:14.258466 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.258800 24596 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:14.259446 25661 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:14.260231 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:14.260788 25827 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.261053 25699 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.265043 25444 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.266878 25708 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:14.266971 25787 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:14.268546 23913 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:14.270668 23921 raft_consensus.cc:2368] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3.
I20260709 12:17:14.271441 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.272148 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:14.272889 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.272198 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:14.274503 25670 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:14.275674 25804 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:14.277971 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.277967 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.285848 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:14.289467 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.295608 23886 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:14.436724 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.439174 25444 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.442843 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.443608 25790 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:14.444173 25783 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:17:14.445684 25790 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:14.450397 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.451608 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.452620 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.453265 23989 raft_consensus.cc:2368] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3.
I20260709 12:17:14.391057 25850 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:14.306586 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 57239.3us
I20260709 12:17:14.304538 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.471892 24064 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:14.398903 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.377758 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:14.305256 25824 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.435269 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 452) took 1925 ms. Trace:
I20260709 12:17:14.473377 24596 rpcz_store.cc:276] 0709 12:17:12.506857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:12.512079 (+  5222us) service_pool.cc:224] Handling call
0709 12:17:14.258439 (+1746360us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:14.258624 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.400590 (+141966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.432167 (+ 31577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5535616}
I20260709 12:17:14.260196 25674 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.480139 25824 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.480996 25674 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:14.285817 25519 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.484041 24063 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:14.429036 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.297765 25820 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.103s
I20260709 12:17:14.461027 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:14.463879 25766 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:14.432588 25804 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:14.432781 25670 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:14.427251 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.482916 25519 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.486698 25757 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:14.453994 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.495617 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:14.497445 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 201894us
I20260709 12:17:14.458947 24065 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.516402 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.518373 24062 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:14.518638 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.482156 25824 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.491492 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.622009 23887 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:14.576511 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:14.889292 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 267341us
I20260709 12:17:14.644156 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:14.538873 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 266717us
I20260709 12:17:14.889706 24064 raft_consensus.cc:2410] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:14.636904 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.643114 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:14.891789 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 514069us
I20260709 12:17:14.563753 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:14.895666 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 331966us
I20260709 12:17:14.891661 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.584820 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.897512 23991 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:14.898221 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.890236 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:14.899319 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:14.901350 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.902645 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.902839 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.903578 23996 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 2: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:14.903785 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.573408 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.908274 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.908495 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.908816 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1562) took 1008 ms. Trace:
I20260709 12:17:14.513532 25804 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:14.566542 25853 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.133s	user 0.002s	sys 0.017s
I20260709 12:17:14.910919 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.560091 25841 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.911976 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:14.912580 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.517366 25794 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:14.914058 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:14.914466 23920 rpcz_store.cc:276] 0709 12:17:13.900105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.901035 (+   930us) service_pool.cc:224] Handling call
0709 12:17:13.901270 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:13.975599 (+ 74329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.975619 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:13.975644 (+    25us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:13.975661 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.908607 (+932946us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b54001fed54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:14.908652 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:14.908767 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170581376}
I20260709 12:17:14.916862 24061 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:14.955520 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:14.956342 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:14.917069 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.901052 25832 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:14.905514 25852 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:14.918646 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:14.920789 25774 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.923355 23989 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.907873 25566 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:14.568871 25665 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:14.570060 25672 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:14.926009 25618 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:14.927130 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.928259 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:14.905386 25708 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:14.929250 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.896947 25512 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:14.935281 23987 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:14.887023 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.521617 25757 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:14.948029 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.959348 24065 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:14.908772 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:14.571873 25837 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:14.960641 25665 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:14.953747 23988 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:17:14.959054 23921 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:14.959455 24036 leader_election.cc:400] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3.
I20260709 12:17:14.960420 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:14.989565 24061 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.971712 25591 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:14.990247 24036 leader_election.cc:403] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:14.991946 24036 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:14.959913 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 48013us
I20260709 12:17:14.955482 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:14.992436 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.992985 23920 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:14.884872 25822 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.954357 25794 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:14.958819 25523 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.981403 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:14.982331 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:14.949450 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.997377 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.961465 25790 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:14.914383 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:14.967968 25820 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:14.965296 25672 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:14.987716 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 95580.7us
I20260709 12:17:14.993793 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:14.972095 25708 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:14.976501 24070 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.983688 25757 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:14.965152 25852 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.001546 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:14.979260 23913 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:15.004956 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:15.012342 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:14.965909 25774 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:14.999595 25794 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.978986 25670 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:14.985379 25669 raft_consensus.cc:1027] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: attempt to promote peer 71a48f59ff764d249519c6a53ec57f02: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:17:15.007007 25574 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:14.965736 25566 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:14.970618 25618 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.991629 25665 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:14.989631 23994 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:15.014621 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:15.039486 24062 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.000149 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:14.994563 25760 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:15.002494 25708 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:15.002630 25672 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:14.998231 24067 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:15.006031 25827 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.063450 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.005968 25674 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.028199 24061 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:15.008817 25850 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.011943 25820 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:15.031960 25673 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:15.016605 25824 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:15.000869 25591 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:14.994634 25837 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.022508 25822 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.043900 25774 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.021855 23912 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:17:15.045571 23913 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:15.047575 25852 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:15.055672 25566 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.065960 24595 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:15.040860 24066 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:15.077637 25618 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.103396 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1548) took 1224 ms. Trace:
I20260709 12:17:15.107239 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.114938 23988 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:15.106513 23919 rpcz_store.cc:276] 0709 12:17:13.878641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.894478 (+ 15837us) service_pool.cc:224] Handling call
0709 12:17:14.968054 (+1073576us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:14.968268 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.968483 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:14.979888 (+ 11405us) log.cc:844] Serialized 14 byte log entry
0709 12:17:15.100165 (+120277us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:15.100242 (+    77us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:15.100301 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.100390 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.103338 (+  2948us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":11606,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4791,"raft.queue_time_us":94,"spinlock_wait_cycles":2699520,"thread_start_us":119847,"threads_started":1}
I20260709 12:17:15.093883 25824 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.124800 23919 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:15.127816 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.072244 25760 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:15.130908 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 138894us
W20260709 12:17:15.136691 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 124437us
I20260709 12:17:15.108309 25869 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.105507 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.132339 24062 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:15.136830 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:15.075845 25804 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.144582 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.144737 24036 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.094262 25850 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.097972 25673 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.120455 25832 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:15.127099 25824 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:15.139132 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:15.137235 25822 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:15.188668 25822 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.191370 25822 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.192550 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.193403 25665 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:15.195194 25864 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:17:15.128887 25674 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:17:15.201167 24597 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:15.169308 25566 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:15.202464 25566 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.204113 25837 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.205490 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.206050 25804 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:15.137603 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.151890 25787 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:15.151811 25774 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:15.154307 25869 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.175952 24070 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:15.177664 25673 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.180950 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.153542 25820 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.165505 25832 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.184314 25760 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.187806 25523 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:15.159157 25790 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.207428 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:15.217414 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:15.223538 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 61298.8us
I20260709 12:17:15.217980 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.245378 24598 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:15.249778 24035 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:15.198112 25672 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.204573 25566 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.254803 24036 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.219034 25822 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:15.251634 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 44289us
I20260709 12:17:15.257808 23960 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:15.234822 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 234743us
I20260709 12:17:15.234308 25512 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3.
I20260709 12:17:15.254174 23962 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:15.268024 23962 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:15.219130 25787 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.259275 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.266151 23960 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:15.268462 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 129400us
I20260709 12:17:15.269699 25665 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.271621 25883 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:15.272078 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.256089 25413 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:15.273727 24036 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.272197 25822 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:17:15.257174 25523 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:15.275810 25762 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.291854 25762 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.292266 25762 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.294589 25413 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:15.276168 25875 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:17:15.295751 25875 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:15.279266 25583 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:15.256881 25573 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:15.285445 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.295842 25413 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:15.296159 25875 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:15.297992 24036 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.297870 25875 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.298846 25852 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.296808 25573 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:15.299093 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.299394 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.299093 25875 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:15.300283 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 466) took 1024 ms. Trace:
I20260709 12:17:15.274541 25574 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.300642 25766 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.301033 25574 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:15.301472 25766 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.270334 25618 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:15.302198 25766 raft_consensus.cc:3055] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:15.302523 25618 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:15.302570 25766 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:15.303017 25618 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.290989 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:15.299922 25852 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.299556 25573 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.287242 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:15.305135 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.732s (SENT) [suppressed 21 similar messages]
I20260709 12:17:15.305172 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:15.300495 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:15.309608 25879 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:15.316689 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.317952 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.321067 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.324342 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:15.325943 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 59863.9us
I20260709 12:17:15.329363 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:15.330122 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:15.332818 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:15.333576 24061 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:15.318706 23995 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:15.335803 25886 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:15.337240 25886 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:15.337750 25886 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:15.338639 25886 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.300482 25672 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:15.286947 25883 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.301481 25574 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:15.344278 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 72692.8us
I20260709 12:17:15.304311 25674 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:15.348766 23962 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:15.310128 25879 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.354785 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.290527 25841 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:15.345325 25566 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.306666 25800 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.356755 23917 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:15.310577 25804 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:15.285544 25865 consensus_queue.cc:1059] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:17:15.300746 24593 rpcz_store.cc:276] 0709 12:17:14.276267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.284856 (+  8589us) service_pool.cc:224] Handling call
0709 12:17:15.299275 (+1014419us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2deee 000000000036eb39 00007f75c5ba11e0 00007f75c5c6a0c4 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:15.300223 (+   948us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4896128}
I20260709 12:17:15.303519 25766 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:15.387627 25766 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.389599 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:15.391238 25881 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:17:15.400303 25790 consensus_queue.cc:1175] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71a48f59ff764d249519c6a53ec57f02" responder_term: 3 status { last_received { term: 3 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 3 index: 4 } }
I20260709 12:17:15.361847 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:15.374814 25665 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.360944 25566 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.375748 25618 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.409206 25566 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.356980 25669 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:17:15.361340 25708 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.363611 25841 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.419247 23918 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:15.419824 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1571) took 1258 ms. Trace:
I20260709 12:17:15.420656 23921 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:15.420888 23915 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 1554) took 1540 ms (client timeout 1898 ms). Trace:
I20260709 12:17:15.363435 25869 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.421761 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1679) took 1232 ms. Trace:
I20260709 12:17:15.422118 23921 rpcz_store.cc:276] 0709 12:17:14.189201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.000439 (+811238us) service_pool.cc:224] Handling call
0709 12:17:15.004006 (+  3567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.421059 (+417053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.421580 (+   521us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54002c4054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:15.421714 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957703040}
I20260709 12:17:15.406244 25804 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:15.423386 25804 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.426374 25804 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.426954 25591 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:15.427362 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 65596.5us
I20260709 12:17:15.427927 25669 raft_consensus.cc:3055] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:15.427220 25873 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.428308 23962 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:15.428280 25669 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:15.429663 25618 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.429802 25669 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.430958 25669 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.420142 25841 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.439443 24566 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:15.354592 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.442690 25670 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:15.443253 25670 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:15.443488 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.420087 25708 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.420110 23918 rpcz_store.cc:276] 0709 12:17:14.160961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.418774 (+1257813us) service_pool.cc:224] Handling call
0709 12:17:15.419086 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.419615 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.419775 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:15.384668 25583 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:15.414942 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 51502.9us
I20260709 12:17:15.360491 25827 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.358215 25879 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:15.417707 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 471) took 1122 ms. Trace:
W20260709 12:17:15.447687 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.448024 25591 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:15.448244 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.448518 25591 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:15.421326 23915 rpcz_store.cc:269] 0709 12:17:13.880195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.886130 (+  5935us) service_pool.cc:224] Handling call
0709 12:17:15.420690 (+1534560us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b5400159ad4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:15.420829 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545244544}
I20260709 12:17:15.417390 25865 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:15.450845 25865 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:15.421265 25824 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:15.451478 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:15.451669 25865 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.452456 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.452653 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:15.453066 25865 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.453665 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.453763 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.454756 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.455027 25444 consensus_queue.cc:1059] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.456022 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.456470 25444 raft_consensus.cc:3055] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:15.456831 25444 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:15.457573 25444 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.458182 25888 consensus_queue.cc:1059] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.458856 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.459120 25871 raft_consensus.cc:3055] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:15.459524 25871 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:15.459659 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1376) took 1625 ms. Trace:
I20260709 12:17:15.407392 25665 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.460212 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.447310 24594 rpcz_store.cc:276] 0709 12:17:14.295383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.297590 (+  2207us) service_pool.cc:224] Handling call
0709 12:17:15.389385 (+1091795us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:15.417623 (+ 28238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167091968}
I20260709 12:17:15.461714 25832 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.453193 23988 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:15.461155 25824 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.463613 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.443792 25670 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:15.472679 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:15.429462 23989 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:15.468611 24598 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:15.475855 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.469878 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.470706 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.436277 25794 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.460043 24063 rpcz_store.cc:276] 0709 12:17:13.834571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.836156 (+  1585us) service_pool.cc:224] Handling call
0709 12:17:13.836395 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:14.487707 (+651312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.459405 (+971698us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54002d3054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:15.459595 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489037056}
I20260709 12:17:15.473338 23918 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:15.474339 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 46092.4us
I20260709 12:17:15.479276 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:15.470873 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 159442us
I20260709 12:17:15.492081 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.475926 25618 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.495275 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.503453 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:15.505954 24063 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:15.506440 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.507112 23916 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:15.511732 25893 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.512650 25893 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.513266 25893 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.516477 25893 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:15.517218 25893 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:15.517848 25893 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.522166 25893 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.522383 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:15.507304 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:15.488003 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.492487 25512 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:17:15.506748 25665 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.497057 25444 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:15.494740 25787 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.479336 25762 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.530447 24596 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:15.534497 25869 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:15.561568 25857 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 1.174s	user 0.003s	sys 0.015s
I20260709 12:17:15.460399 25871 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:15.584040 25757 consensus_meta.cc:287] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.004s
I20260709 12:17:15.546808 23918 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
W20260709 12:17:15.594704 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.579989 25869 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:15.603238 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.603888 23961 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:15.608242 25884 log.cc:927] Time spent T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.333s	user 0.001s	sys 0.000s
I20260709 12:17:15.608449 25579 consensus_queue.cc:1059] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:15.608312 25746 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:15.613360 24593 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:15.616077 23961 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:15.620445 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:15.621865 25804 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:15.622370 25804 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:15.622838 25804 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.629657 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:15.630693 25665 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:15.638779 25804 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.642341 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.642697 25674 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.643067 23992 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:15.643579 25674 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.646778 25674 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:15.652433 23992 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:15.653967 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:15.655028 25837 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:15.655685 25837 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:15.656688 25837 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.659930 25794 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.661944 25762 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.666452 23987 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:15.601768 25869 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:15.673450 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:15.674676 25804 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:15.683924 25591 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:15.687222 25566 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.589429 25757 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.697135 25757 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:15.698318 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1380) took 1862 ms. Trace:
I20260709 12:17:15.698568 24068 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:15.698732 24069 rpcz_store.cc:276] 0709 12:17:13.835740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:13.841685 (+  5945us) service_pool.cc:224] Handling call
0709 12:17:13.842039 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:13.890194 (+ 48155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:13.890233 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:13.896018 (+  5785us) log.cc:844] Serialized 26 byte log entry
0709 12:17:14.261970 (+365952us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b1800332980. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:17:14.390178 (+128208us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:14.390234 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:14.390346 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:15.486666 (+1096320us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:15.698079 (+211413us) raft_consensus.cc:1685] finished
0709 12:17:15.698107 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:15.698243 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50196,"raft.queue_time_us":53566,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"spinlock_wait_cycles":19559040,"thread_start_us":128001,"threads_started":1,"wal-append.queue_time_us":481023}
W20260709 12:17:15.715152 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 390775us
I20260709 12:17:15.715927 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:15.717139 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:15.718948 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:15.719909 23993 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:15.734542 23921 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:15.736078 23916 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:15.735987 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 246480us
W20260709 12:17:15.737833 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 121842us
W20260709 12:17:15.738538 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.738571 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:15.739916 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.739921 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.748459 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.749233 23916 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:15.731374 25794 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:15.714970 25757 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:15.731673 25832 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:15.725455 25512 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.815994 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.654099 25574 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:15.844771 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.845288 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.846123 23921 raft_consensus.cc:2368] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3.
I20260709 12:17:15.740406 25690 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:15.743875 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:15.847919 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 109427us
I20260709 12:17:15.848624 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.609321 25879 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.814728 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:15.901276 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.904357 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:15.907545 23993 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: [3.5-4.6]
I20260709 12:17:15.914697 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.914887 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1388) took 1034 ms. Trace:
I20260709 12:17:15.816079 25837 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.916855 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.919687 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:15.920421 23993 raft_consensus.cc:2368] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:15.920787 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.921479 23916 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
W20260709 12:17:15.932410 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 83035.4us
I20260709 12:17:15.839749 25672 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.841212 25566 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:15.939785 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.933207 23994 raft_consensus.cc:2368] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
W20260709 12:17:15.950701 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 192591us
I20260709 12:17:15.845126 25794 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:15.915387 24068 rpcz_store.cc:276] 0709 12:17:14.880647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:14.880792 (+   145us) service_pool.cc:224] Handling call
0709 12:17:14.881119 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.715686 (+834567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.914717 (+199031us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540021c354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:15.914839 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1879445760}
I20260709 12:17:15.954664 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:15.955375 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:15.956156 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:15.951964 24069 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:15.957049 23916 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:15.952066 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:15.957537 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:15.958029 24069 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:15.958232 24062 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:15.956058 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:15.958926 24061 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:15.956341 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:15.952728 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:15.953804 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:15.849764 25832 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:15.917137 25591 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:15.965852 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:15.841418 25573 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.844244 25757 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.932040 25883 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:15.975840 25690 consensus_queue.cc:1059] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.977681 25690 raft_consensus.cc:3055] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:15.978549 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.979447 23918 raft_consensus.cc:2410] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:15.962719 25794 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:15.847468 25512 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.982187 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.989144 23921 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:15.985309 23960 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:15.974951 25865 consensus_meta.cc:287] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.002s
I20260709 12:17:15.988003 24069 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:15.989743 24066 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:15.933276 25764 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:17:15.978052 25690 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:15.991634 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 106837us
I20260709 12:17:15.992945 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.955250 25672 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.937274 25837 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:15.983664 25574 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.034960 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.035614 23921 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:15.992660 25760 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:17:15.983263 25883 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:15.999920 25901 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:16.039253 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.039855 25708 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:16.040134 25573 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:16.042465 25832 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.043761 25690 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:16.045872 25670 consensus_meta.cc:287] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.003s
I20260709 12:17:16.034880 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:15.995852 25665 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:16.047400 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 78697.8us
I20260709 12:17:16.052047 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:16.052564 24598 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEARNER]: Advancing to term 4
I20260709 12:17:16.068369 24599 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:16.053378 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.069840 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:16.070466 23961 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:16.057282 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73117.3us
I20260709 12:17:16.062661 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:16.064821 25837 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:16.071329 25444 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.071759 25444 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.072154 25444 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.072968 25911 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:16.073510 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:16.074134 23987 raft_consensus.cc:606] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.075074 25573 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:16.075621 25573 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:17:16.066236 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 89842.5us
I20260709 12:17:16.055436 25819 raft_consensus.cc:3055] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.077967 24036 leader_election.cc:400] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:16.079391 24036 leader_election.cc:403] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:16.080286 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.082482 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.058161 25901 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:16.079312 25819 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:16.089342 25512 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:16.057425 25708 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.092381 25708 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.081756 25879 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.094127 25764 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:16.095976 25766 consensus_meta.cc:287] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.004s
I20260709 12:17:16.096053 25764 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:16.096874 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:16.097637 25690 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.085062 25674 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:16.055778 25762 consensus_queue.cc:1059] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:16.102907 25764 raft_consensus.cc:3055] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:16.103291 25764 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:16.086985 25902 consensus_queue.cc:1059] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:17:16.104146 25764 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.104547 25902 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:16.105005 25902 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:16.105273 25764 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.067626 25670 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.096179 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:16.107808 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.111097 24598 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:16.111874 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:16.112159 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:16.113356 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:16.115666 24595 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.118382 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:16.118780 25901 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.124490 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.059528 25895 consensus_queue.cc:1059] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:17:16.129513 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:16.130564 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.130795 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:16.131361 23913 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:16.131875 25893 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.131960 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:16.132174 25850 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:16.132755 25850 consensus_queue.cc:1059] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:16.133692 25850 raft_consensus.cc:3055] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:16.079509 25665 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.134482 25902 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.135303 25819 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.076498 25573 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.135735 25902 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.147090 24564 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.134034 25850 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:16.148124 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.149730 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:16.146721 25819 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.116185 25899 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:16.154448 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:16.154660 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.121771 25875 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.163993 24034 leader_election.cc:400] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3.
I20260709 12:17:16.163932 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.165122 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.166290 25824 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.168128 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.168861 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.168952 25914 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.169266 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:16.170408 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.172401 24564 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.173749 24564 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.176335 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.179909 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:16.180648 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 109660us
I20260709 12:17:16.180575 25919 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.184393 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:16.185504 25920 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:16.186009 25920 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:16.185999 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.186820 25920 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.189968 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:16.190212 25921 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.163312 25573 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.194054 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.163589 25899 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:16.194342 25912 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.136723 25869 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.167588 25519 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.151367 25790 consensus_queue.cc:1059] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:17:16.170727 25898 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:16.170564 25893 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.173753 25879 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.197749 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.175450 25824 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:16.201397 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45108.7us
I20260709 12:17:16.173530 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:16.178949 25708 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:16.208418 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.195430 25841 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.211001 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.197407 25800 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.198525 25899 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.217407 23996 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:17:16.219189 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.197533 25903 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.213313 23962 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:16.207309 25882 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:16.204916 25898 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:16.226588 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 707) took 1164 ms. Trace:
I20260709 12:17:16.227527 24597 rpcz_store.cc:276] 0709 12:17:15.061842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.071402 (+  9560us) service_pool.cc:224] Handling call
0709 12:17:15.077123 (+  5721us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:15.201815 (+124692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.226315 (+1024500us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54006112d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:16.226515 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284606336}
I20260709 12:17:16.214663 25846 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.213536 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:16.234779 25908 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:16.235498 25908 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:16.236572 25908 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.220427 24594 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.220359 25893 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.230574 25898 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.223057 25882 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:16.244488 24065 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:17:16.267766 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:16.280570 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 106901us
I20260709 12:17:16.282709 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.209515 25850 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.268759 25882 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.308569 25924 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:16.319588 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.321228 25444 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:16.324370 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 127253us
I20260709 12:17:16.429364 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.432148 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.435067 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.436928 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.439481 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.441783 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.446511 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:16.448036 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.448295 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.449023 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.449880 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.446676 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.452039 23915 raft_consensus.cc:2393] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:16.453261 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.453325 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.454232 23915 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:16.349567 24068 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:16.457621 23988 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.459398 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:16.353928 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:16.370090 25444 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:16.462069 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.463965 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:16.475018 25708 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:17:16.478767 25827 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.479760 25827 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.480543 25827 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.481356 25827 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.486914 25832 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:16.488009 25832 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.376516 25794 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.500530 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:16.502686 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:16.371640 25916 log.cc:927] Time spent T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:17:16.384012 25899 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.385990 25920 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.509326 25899 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.364154 25869 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.494908 25708 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.512007 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.519954 24065 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:16.520514 24070 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:16.523341 24065 raft_consensus.cc:1240] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:16.524942 23994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 1708) took 1414 ms (client timeout 1802 ms). Trace:
W20260709 12:17:16.525506 23994 rpcz_store.cc:269] 0709 12:17:15.109915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.111360 (+  1445us) service_pool.cc:224] Handling call
0709 12:17:15.430356 (+318996us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:16.524465 (+1094109us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54003d86d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:16.524723 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143220224}
I20260709 12:17:16.394640 25898 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.510224 25920 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:16.529549 25898 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:16.515771 25766 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.371076 25922 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.155s
I20260709 12:17:16.537122 23918 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:16.532208 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 291) took 1203 ms. Trace:
I20260709 12:17:16.532310 25794 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.545621 24069 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:16.548163 25932 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:16.548712 25468 raft_consensus.cc:3055] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:16.550014 25523 raft_consensus.cc:3055] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:16.541934 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 180123us
I20260709 12:17:16.552563 25523 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:16.554257 25523 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.555773 25523 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:16.557109 24599 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.549292 25932 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:16.549293 25468 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:16.562601 25468 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.563462 25932 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:16.564216 25468 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.566485 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.569569 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:16.544409 24066 rpcz_store.cc:276] 0709 12:17:15.328913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.329060 (+   147us) service_pool.cc:224] Handling call
0709 12:17:16.531828 (+1202768us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b540010fc54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:16.532022 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1514672384}
I20260709 12:17:16.571522 25832 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:16.572104 25757 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:16.572521 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 289736us
I20260709 12:17:16.572635 25935 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:16.573135 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.573590 24564 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.577445 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:16.577760 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:16.581755 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:16.585631 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:16.585292 25882 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.589330 23919 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:16.595311 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:16.595818 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:16.593953 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.602759 25804 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:16.602985 25832 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.603940 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.605055 23915 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:16.604972 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:16.608203 25882 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:16.608814 25670 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.608901 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:16.611225 24066 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.611706 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.610037 23995 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:16.613003 25850 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.613943 25670 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.614847 25670 consensus_queue.cc:1059] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:16.618340 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:16.619143 25804 raft_consensus.cc:3055] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:16.619957 25883 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:16.613716 24566 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:16.632448 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 58931us
I20260709 12:17:16.627054 25804 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:16.638226 24063 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:16.640830 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:16.641587 25794 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:16.639313 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.644266 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:16.643736 25883 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.649143 23995 raft_consensus.cc:2410] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:17:16.650461 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:16.651342 24564 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.652011 24066 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:16.652872 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.654454 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:16.653575 25708 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:16.658578 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 89355us
I20260709 12:17:16.657152 24564 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.660696 25837 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.754287 25882 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:16.780341 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 118307us
I20260709 12:17:16.721146 25922 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:16.784067 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 128348us
W20260709 12:17:16.783676 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 125622us
I20260709 12:17:16.789743 25912 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:16.721990 25938 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.846926 25912 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:16.847462 25912 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.790709 24066 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:16.799592 25583 raft_consensus.cc:3055] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:16.848186 25827 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:16.848618 25583 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:16.848450 25804 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.848920 25827 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.849484 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.850051 25804 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:16.849926 25583 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.851650 25583 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.801812 25665 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.803292 25672 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:16.817489 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 444) took 1229 ms. Trace:
I20260709 12:17:16.820020 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 476) took 1355 ms. Trace:
I20260709 12:17:16.853924 24595 rpcz_store.cc:276] 0709 12:17:15.587458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.588219 (+   761us) service_pool.cc:224] Handling call
0709 12:17:15.588565 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.121209 (+532644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.816857 (+695648us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b540057b054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:16.817235 (+   378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1211765504}
I20260709 12:17:16.854059 24594 rpcz_store.cc:276] 0709 12:17:15.464372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.473836 (+  9464us) service_pool.cc:224] Handling call
0709 12:17:16.064655 (+590819us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:16.064859 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:16.248797 (+183938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:16.819489 (+570692us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540064da54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:16.819829 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341764736}
I20260709 12:17:16.855494 23918 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:16.841704 25882 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:16.857592 25882 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:16.858777 25871 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.823562 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:16.721786 25787 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:16.844722 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.845626 25928 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:16.846524 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.864764 23993 raft_consensus.cc:606] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.870568 23993 raft_consensus.cc:614] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:16.871878 25665 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:16.874758 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:16.875192 25938 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:16.875804 25938 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.876199 25787 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.877808 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:16.878532 23921 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:16.879038 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.881686 25869 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:16.883687 25914 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:16.884600 24063 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:16.853909 25827 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:16.889809 25928 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.899422 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:16.907086 25900 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:16.907794 25900 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.918704 25900 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:16.922652 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.925177 25911 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.925897 25911 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:16.926488 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:16.927541 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.902544 25914 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
W20260709 12:17:16.933326 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 86873.3us
I20260709 12:17:16.934005 24036 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:16.938597 25902 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.939150 25902 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.941326 25902 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.942399 25938 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:16.942641 25519 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.915442 25787 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:16.943779 23916 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:16.944335 25888 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:16.944986 25888 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:16.945804 23913 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:16.945935 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:16.947233 25888 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:16.947983 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:16.950093 25824 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:16.951202 25824 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:16.951542 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:16.951552 25824 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:16.952688 25760 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:16.954429 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:16.954833 23921 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:16.952708 25824 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:16.955498 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 46845.5us
I20260709 12:17:16.956681 25929 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:16.915051 25827 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:16.960232 23916 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:16.963018 23914 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.928654 25766 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:16.963864 25760 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:16.924190 25670 consensus_queue.cc:1059] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:17:16.945129 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
W20260709 12:17:16.975319 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 66108.4us
I20260709 12:17:16.964193 25766 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:16.974165 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:16.988610 23917 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:16.989575 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:16.997960 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:16.998487 25883 consensus_queue.cc:1059] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:16.983036 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:16.990974 25900 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:16.987362 25911 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.006217 25841 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:16.988353 23987 raft_consensus.cc:606] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:17.008950 24595 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:17.012530 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.018157 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.007572 25900 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:16.994791 25827 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.011171 25824 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:17.030047 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:17.029383 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49591.4us
W20260709 12:17:17.032490 25940 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.143s	user 0.000s	sys 0.002s
I20260709 12:17:17.032769 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 718) took 1820 ms. Trace:
I20260709 12:17:17.033211 24591 rpcz_store.cc:276] 0709 12:17:15.212091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:15.215925 (+  3834us) service_pool.cc:224] Handling call
0709 12:17:15.239872 (+ 23947us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:15.273433 (+ 33561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:15.282389 (+  8956us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:15.301874 (+ 19485us) log.cc:844] Serialized 26 byte log entry
0709 12:17:15.350036 (+ 48162us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:15.350111 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:15.350217 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:16.381015 (+1030798us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b2400318e18. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bd9eb9c4 00007f75bd9e9acb 00007f75bdba4dc9 00007f75bdba4a55 00007f75bdba3fb0 00007f75c081a488 00007f75c081abe8 00007f75c07f2398 00007f75c07ed76a 00007f75c07ecbb6
0709 12:17:16.976499 (+595484us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400682520. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0bc7dbe 00007f75c0bd2930 00007f75c0bd28d8 00007f75c0bd2858 00007f75c0bd2813 00007f75c0bd1a9c 00007f75c6abd2f6 00007f75c6ab7aa8 00007f75c0c0e7cb 00007f75c0c112c0
0709 12:17:17.021104 (+ 44605us) raft_consensus.cc:1685] finished
0709 12:17:17.022916 (+  1812us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:17.032604 (+  9688us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14115,"raft.queue_time_us":16770,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":10888,"spinlock_wait_cycles":363634304,"thread_start_us":47748,"threads_started":1,"wal-append.queue_time_us":48108}
I20260709 12:17:17.035578 25519 consensus_queue.cc:1059] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:17.036170 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.036743 25519 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:17.036675 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.023187 25900 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.023324 25932 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:17.041258 25832 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:17.041718 23919 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:17.042040 25832 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.042807 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.044473 25841 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:17.045044 25841 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.035054 25708 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:17.023579 25928 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.049813 24564 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.037213 25519 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:17.045297 25832 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.056052 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.059124 24564 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.059247 23917 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:17.048659 25841 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.068091 25766 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:17.069408 25757 raft_consensus.cc:3055] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:17.069847 25757 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:17.070847 24034 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:17.077382 25757 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.079416 25757 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:17.065130 25945 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:17:17.082456 24034 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:17.084339 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.027542 25914 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.072821 25670 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:17.094743 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.095223 24564 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.096537 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.081915 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:17.098520 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.087312 23912 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:17.085052 25928 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:17.086349 25850 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.101202 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.101131 25910 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.090200 25766 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.076782 25882 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.106531 23991 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:17.106771 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:17.110523 24035 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:17.098701 25670 raft_consensus.cc:697] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:17.113794 23993 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:17.114765 24063 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:17.115267 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:17.113788 25618 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.115410 25928 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.144960 25912 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.118237 23990 raft_consensus.cc:606] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:17.149262 25760 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:17.150425 24069 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:17:17.105484 25766 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.143519 25618 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.103941 25850 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.107117 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.159307 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:17.162796 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 132216us
I20260709 12:17:17.151080 24065 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:17.165812 24070 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.166834 24062 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:17.170521 25924 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.155367 25519 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.154464 24591 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.175083 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:17.156697 25850 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.176937 24035 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:17.156153 25766 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.190371 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.191105 23918 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:17.163049 25760 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.191830 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.192469 23917 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.196648 25519 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.197379 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.198118 23915 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:17.198639 25931 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:17.199712 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.199498 25931 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:17.182618 23987 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
W20260709 12:17:17.202930 25890 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:17.203143 25591 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.183301 25670 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.207047 25760 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.184695 23988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:17.149367 25900 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.188217 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.208576 23988 raft_consensus.cc:606] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:17.208978 23988 raft_consensus.cc:614] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:17.209648 25591 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.210695 25900 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.211714 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:17.231444 24070 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:17.232390 24035 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:17.239379 24035 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:17.228003 25665 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.234704 25871 consensus_queue.cc:1059] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:17:17.257104 25674 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.262355 25918 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:17.262780 25673 raft_consensus.cc:3055] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:17.263219 25673 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:17.264134 25673 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.266842 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:17.267275 25912 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.272214 24595 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:17.265321 25673 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.287017 23917 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:17.288587 25897 consensus_queue.cc:1059] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:17.289686 25468 consensus_queue.cc:1059] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.247762 25760 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.244558 25583 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:17:17.299924 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.286707 25928 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.303786 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.297294 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.281639 25902 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:17:17.306532 25919 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:17.307085 25919 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.309829 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.309948 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.310420 23919 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:17.303097 23987 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:17.313370 25919 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.315973 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.317456 23917 raft_consensus.cc:2393] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:17.316583 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:17.322289 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:17.250061 25774 consensus_queue.cc:1059] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:17:17.284456 25850 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.331568 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.338049 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.338894 24064 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:17.348565 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.349952 24066 raft_consensus.cc:2368] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:17.327415 25787 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:17.339519 25946 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:17:17.351831 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.354338 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.346923 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.337054 25882 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:17.366019 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 84855.7us
I20260709 12:17:17.368644 24063 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:17.372428 25591 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.373205 25591 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:17.373615 25591 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.374857 25591 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.376535 25591 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.337401 25931 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.344056 25832 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.376363 25618 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.428997 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.436743 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:17.437577 25837 consensus_meta.cc:287] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 12:17:17.364046 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.428484 23988 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:17.444106 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 57186.6us
I20260709 12:17:17.362776 25871 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:17.444398 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55992.4us
I20260709 12:17:17.364192 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.448427 23995 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:17.449863 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:17.452142 24063 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:17.456698 23912 raft_consensus.cc:2368] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4.
I20260709 12:17:17.457108 25827 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.453687 24069 raft_consensus.cc:2368] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4.
I20260709 12:17:17.466899 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 1630) took 1349 ms. Trace:
I20260709 12:17:17.468994 23992 rpcz_store.cc:276] 0709 12:17:16.117240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.117385 (+   145us) service_pool.cc:224] Handling call
0709 12:17:17.295536 (+1178151us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:17.466826 (+171290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8147200}
I20260709 12:17:17.472259 24034 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:17.459286 25837 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.474058 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.453742 25871 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.480365 24564 leader_election.cc:400] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4.
I20260709 12:17:17.480885 24564 leader_election.cc:403] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:17:17.482388 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:17.443185 25787 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:17.485754 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 56614.7us
I20260709 12:17:17.475260 25954 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.494585 25869 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.495106 25869 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.496078 25512 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:17.496636 25512 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.497224 25869 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.501837 25583 raft_consensus.cc:3055] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:17.504128 24591 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:17.504693 25665 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4.
I20260709 12:17:17.502359 25583 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.506590 25583 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.468288 25865 consensus_queue.cc:1059] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:17:17.514914 25583 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.510195 25658 raft_consensus.cc:3055] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:17.518476 25658 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.519783 25658 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.520746 25871 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.521273 25658 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.484308 25948 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.510573 23987 raft_consensus.cc:2368] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4.
I20260709 12:17:17.522472 25948 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.522914 25948 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.516801 25882 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.509205 25958 raft_consensus.cc:993] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:17:17.517743 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.516314 24566 leader_election.cc:400] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4.
I20260709 12:17:17.527899 24066 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 1.
I20260709 12:17:17.528795 24566 leader_election.cc:400] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4.
I20260709 12:17:17.534790 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.535857 24069 raft_consensus.cc:2393] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:17.465852 25832 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.539314 25832 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.542807 24062 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:17.543141 24600 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:17.543493 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.545861 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.462260 25766 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.556047 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.556703 23988 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:17.558897 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.559631 24070 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:17.560014 25674 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.560497 25674 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.523939 25882 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.563015 24065 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:17.564060 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.564502 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.565325 23991 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:17.565595 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.564710 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.567986 25766 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.568331 25674 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.569201 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.571812 24064 raft_consensus.cc:2368] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4.
I20260709 12:17:17.573326 25865 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:17.575366 25865 consensus_queue.cc:1059] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:17.564664 23994 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:17.577509 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.566468 23989 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:17.580422 23987 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:17.582366 25850 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.583245 25865 raft_consensus.cc:993] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:17:17.583707 25865 raft_consensus.cc:1081] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:17:17.586177 25958 raft_consensus.cc:1081] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:17:17.578137 23992 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
W20260709 12:17:17.588013 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 101441us
I20260709 12:17:17.588536 25787 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.590806 25579 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:17.591202 25579 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.591398 25953 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:17.587293 25591 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.592150 25579 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.593004 25591 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.593760 25579 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:17.595085 25591 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:17.596846 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.597084 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.598949 23917 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.609661 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.599753 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:17.613603 24063 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:17.615310 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.616369 23962 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.614815 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.618186 24600 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:17.621176 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.619577 23914 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:17.623471 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.614861 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.614926 25512 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.636030 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.634361 25918 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.646231 23961 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.647325 25512 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.651266 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.651865 25953 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:17.651968 23987 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:17.652369 25953 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.652753 25953 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.651571 25512 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.652957 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.653576 24067 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:17.654721 25512 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:17.655393 23960 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:17.656152 25618 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:17.638908 25871 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.659436 23962 leader_election.cc:400] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:17.659744 23962 leader_election.cc:403] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:17.660324 25955 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.661854 25959 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:17.662464 25954 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:17.664076 25618 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:17.666734 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:17.667387 24595 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:17.667073 25953 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.668735 24035 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:17.669690 23960 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:17.640918 24036 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.671268 23917 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:17.674853 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.675766 25911 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:17.676203 25911 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.678910 25850 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.650974 25918 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.639205 23912 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.682514 25911 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.683292 25579 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.685111 25918 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.687268 24600 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:17.736826 25804 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:17.737319 25928 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.737495 25804 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.737920 25928 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.706672 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:17.684023 25953 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:17.680217 23960 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.697247 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.701622 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:17.742045 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44898.5us
W20260709 12:17:17.742604 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 119239us
I20260709 12:17:17.739928 24595 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.712108 24036 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:17.711246 25787 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.744352 25787 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:17.689313 25955 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:17.682595 25665 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.745191 24036 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:17.693799 23818 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:17.692536 25902 raft_consensus.cc:3055] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:17.746615 25902 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.746886 25523 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:17.747452 25523 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:17.746958 23818 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 3 to 4, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 4 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:17:17.746369 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 66242.6us
I20260709 12:17:17.747542 25902 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.748420 25938 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:17.748786 25902 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:17.748692 23818 catalog_manager.cc:5697] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:17.692162 23819 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39296 (request call id 305) took 6985 ms. Trace:
I20260709 12:17:17.750370 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.751878 25919 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:17.752202 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 52040.4us
I20260709 12:17:17.748843 25938 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.753479 25938 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.754015 25928 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.755424 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.755697 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.756217 23918 raft_consensus.cc:2393] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:17.756548 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.750542 23819 rpcz_store.cc:276] 0709 12:17:10.706508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:10.712006 (+  5498us) service_pool.cc:224] Handling call
0709 12:17:17.691897 (+6979891us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:14.385091 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:14.385827 (+   736us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:14.385880 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:17:14.385907 (+    27us) tablet.cc:662] Decoding operations
0709 12:17:14.387001 (+  1094us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:14.387097 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:14.387137 (+    40us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:17:14.387790 (+   653us) tablet.cc:701] Row locks acquired
0709 12:17:14.387807 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:17:14.387942 (+   135us) write_op.cc:270] Start()
0709 12:17:14.388051 (+   109us) write_op.cc:276] Timestamp: P: 1783599434387897 usec, L: 0
0709 12:17:14.388070 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:17:14.388709 (+   639us) log.cc:844] Serialized 2488 byte log entry
0709 12:17:15.003526 (+614817us) op_driver.cc:464] REPLICATION: finished
0709 12:17:15.240144 (+236618us) write_op.cc:301] APPLY: starting
0709 12:17:15.248201 (+  8057us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:15.267131 (+ 18930us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:15.275549 (+  8418us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:15.276265 (+   716us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:15.276447 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:17:15.276487 (+    40us) write_op.cc:312] APPLY: finished
0709 12:17:15.276717 (+   230us) log.cc:844] Serialized 53 byte log entry
0709 12:17:15.276874 (+   157us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:15.276994 (+   120us) write_op.cc:454] Released schema lock
0709 12:17:15.277048 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:15.277353 (+   305us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:15.277384 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":218733,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":221513,"apply.run_cpu_time_us":2656,"apply.run_wall_time_us":42162,"num_ops":6,"prepare.queue_time_us":98771,"prepare.run_cpu_time_us":3911,"prepare.run_wall_time_us":3911,"replication_time_us":601902,"thread_start_us":293189,"threads_started":2}]]}
I20260709 12:17:17.747884 25953 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.759145 25953 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.759285 23987 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:17.769023 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.770985 23993 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 1.
I20260709 12:17:17.771606 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.776640 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.776486 25918 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.744693 25787 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:17.782485 25787 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.782626 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.784482 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.785079 23993 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:17.747864 25523 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.786597 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.786296 25953 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.787485 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:17.787173 23818 catalog_manager.cc:5697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 2 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:17.788125 24065 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:17.789242 23818 catalog_manager.cc:5697] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:17.755517 25804 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.708870 25882 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.763016 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.791102 25911 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.756246 23914 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:17.794497 25912 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:17.796063 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:17.799420 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.799892 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:17.800539 23914 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.787176 23992 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.758488 23919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:17:17.808797 23919 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:17.809185 23919 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.796530 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:17.805706 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:17.807868 23990 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:17.816453 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.763602 23962 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.818780 24064 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:17.819160 25938 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.821053 23917 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:17.821492 25938 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.822026 24070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:17:17.822571 24070 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:17.822993 24070 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.828518 25912 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:17.828997 25912 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.829326 25912 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.838721 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:17.839462 24061 raft_consensus.cc:2393] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:17.839282 25938 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:17.840796 24070 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.679446 25832 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.786163 24595 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:17.847167 24036 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.836951 23919 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.881228 24070 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.881445 23914 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
W20260709 12:17:17.886863 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 70505us
I20260709 12:17:17.888105 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.890329 23992 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:17.805835 25787 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:17.896888 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 133384us
I20260709 12:17:17.898205 24036 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.898386 23961 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.895737 25911 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:17.902014 25674 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.902704 25674 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:17.899422 25888 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:17.903475 23919 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:17.904114 25841 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:17.903970 25674 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.904901 25618 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:17.905303 25618 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.905638 25618 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:17.906745 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:17.910533 25800 consensus_queue.cc:1059] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.911334 25800 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.911890 25800 raft_consensus.cc:3055] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:17.912200 25800 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:17.913025 25800 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:17.916590 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 72780.9us
I20260709 12:17:17.918612 23960 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.920497 25897 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:17.920724 25912 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.921870 25897 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.636858 25948 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:17.924793 25948 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:17.822559 25918 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.926604 24068 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:17:17.900251 25512 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:17.927121 25512 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:17.927480 25512 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.896246 25579 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.931463 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.932789 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:17.932873 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.944911 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:17.946128 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 46295.4us
W20260709 12:17:17.948139 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 49840.9us
I20260709 12:17:17.943825 25519 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:17:17.943727 25827 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:17.952184 25928 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:17.952708 25928 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:17.949465 25708 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:17:17.953117 25928 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.955646 25583 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:17.956429 25583 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:17.949976 25824 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:17.957015 25583 raft_consensus.cc:697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.903867 25888 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.958436 25865 raft_consensus.cc:3055] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:17.958933 25865 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.963497 24600 raft_consensus.cc:2393] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:17.966657 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.968683 24036 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.960465 25888 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:17.973840 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.975123 23995 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:17.975487 23995 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.976521 23995 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.977718 23995 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:17.943095 25800 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.972657 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.972846 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:17.980863 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.985654 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:17.942826 25897 raft_consensus.cc:697] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:17.987535 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:17.989068 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.989626 23994 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:17.960011 25865 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:17.987771 25832 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:17.986255 25766 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:17.958106 25583 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:17.988852 25708 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.001062 23988 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:17.987564 25841 raft_consensus.cc:2764] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:17:18.006167 25766 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:18.007404 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:17.994899 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:17.999205 25519 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:18.027086 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:18.030267 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:18.033016 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:18.007968 25871 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:18.040866 25871 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.025936 25912 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.046169 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:18.046561 25919 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.047003 23989 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:18.047318 25919 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:18.046911 25512 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.047533 23989 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:18.049826 25512 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:18.051934 25618 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:17.991475 25827 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:17:18.063701 23994 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:18.067801 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:18.068431 24066 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:18.003407 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:18.060194 25708 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.061724 25519 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:18.004616 25523 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.091951 24064 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.076560 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:18.076383 25708 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.095573 25972 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:18.096189 25972 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.092535 23989 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.099606 25618 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.100188 25956 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:18.100584 25956 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:18.100813 23912 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:18.100968 25956 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.091246 25519 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.006255 25897 consensus_queue.cc:237] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.108362 23995 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:18.110018 24064 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:18.123068 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:18.123745 24065 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.110698 25972 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.111631 25674 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.116920 25787 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:18.082046 25766 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.144224 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:18.145180 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:18.145812 23915 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.166113 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:18.175407 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:18.176084 23995 raft_consensus.cc:2368] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:18.173748 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:18.182636 25968 log.cc:927] Time spent T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:17:18.186345 25865 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.186568 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:18.187235 23990 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.188093 25708 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.190661 25708 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.165514 25928 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.195127 24065 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:18.196622 25928 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.197750 24036 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:18.198745 24036 leader_election.cc:400] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:18.198997 24036 leader_election.cc:403] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:18.199756 23990 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:18.202697 25948 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:18.201731 25919 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:18.202234 25883 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:18.199832 23915 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:18.204408 25883 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:18.211572 24600 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:18.128422 25674 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:18.213034 25971 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:17:18.238700 23962 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:18.239431 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 59266.6us
I20260709 12:17:18.217993 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:18.257050 24594 raft_consensus.cc:2368] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:18.229241 25579 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:18.247460 25523 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:18.264082 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.271700 23961 leader_election.cc:400] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
W20260709 12:17:18.250788 25970 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:17:18.236498 25774 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:17:18.284938 23918 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:18.290601 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:18.291324 23917 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.311651 24036 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:18.287997 25980 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:18.312286 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:18.326234 25787 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:18.326798 25787 raft_consensus.cc:697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:18.327474 23917 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:18.327646 25787 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.332891 25774 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:18.333432 25774 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:18.336743 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:18.339557 24066 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:18.342842 23917 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:18.353858 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:18.354455 23914 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.371889 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:18.372793 23917 raft_consensus.cc:2368] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:18.346285 25972 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.374166 25972 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.379657 25956 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.380769 23988 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.370079 25883 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.290357 25519 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.384393 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:18.384701 25519 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.385164 24594 raft_consensus.cc:2368] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:18.352293 25980 raft_consensus.cc:697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:18.386520 23961 leader_election.cc:400] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:18.386809 23961 leader_election.cc:403] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:18.387079 25980 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.388548 25911 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:18.389046 25911 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.391145 25911 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:18.379561 25774 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.406193 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:18.407614 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:18.409718 23887 leader_election.cc:400] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4.
I20260709 12:17:18.410643 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:18.411324 23918 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:18.411336 23914 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:18.402746 25956 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:18.418735 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:18.424496 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:18.426836 24063 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.426863 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:18.428550 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:18.429481 24065 raft_consensus.cc:2393] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:18.431448 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:18.433981 24063 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:18.435081 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:18.435530 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:18.438305 25912 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:18.442472 23995 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:18.442987 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:18.443634 23992 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.444499 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:18.445241 24063 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:18.453361 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:18.460094 23994 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:18.418387 25774 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.416100 25519 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:18.417900 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:18.416640 25919 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:18.475826 23992 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:18.417708 25974 consensus_queue.cc:1059] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:17:18.479267 25871 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:18.467958 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:18.482584 23988 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:18.471369 25841 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:18.498647 24591 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:18.473908 25519 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:18.521379 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 47252.3us
I20260709 12:17:18.524586 24034 leader_election.cc:400] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:18.497648 25953 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3.
I20260709 12:17:18.529520 23990 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:18.528586 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:18.530977 23994 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:18.503506 25519 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.528796 23915 raft_consensus.cc:2368] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:18.515620 25523 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.531983 24594 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 2: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:18.541639 25956 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.562515 25956 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.545017 23989 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.551327 25928 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:18.554970 25674 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:18.558064 23917 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:18.527422 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:18.502592 25919 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:18.567152 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 95443.9us
I20260709 12:17:18.568758 25919 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:18.522853 25583 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
W20260709 12:17:18.573956 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 46610.8us
I20260709 12:17:18.566227 25912 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.579986 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:18.596482 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:18.577310 25992 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:18.581274 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:18.566473 25523 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.581146 25912 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.620518 25974 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:18.620637 25956 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:18.621121 25974 raft_consensus.cc:697] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:18.622048 25974 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.573838 25928 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:18.627170 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 120101us
I20260709 12:17:18.630791 24036 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:18.613245 25992 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:18.641567 25992 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:18.587913 25871 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 12:17:18.653005 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73087.6us
I20260709 12:17:18.641553 25990 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.642462 25938 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.649385 25787 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:18.649185 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:18.646720 25674 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:17:18.653883 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:18.660024 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:18.660888 25990 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.670264 23914 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.670549 25998 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:18.659552 25938 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.671196 25998 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:18.672222 24594 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:18.678489 25523 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:18.679523 25938 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:18.681680 25972 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.683714 25928 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:18.690109 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:18.691772 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:18.660727 25787 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.695320 24067 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:18.696341 23914 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:18.698391 24034 leader_election.cc:400] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:18.698743 24034 leader_election.cc:403] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:18.700191 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:18.700760 24064 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:18.705593 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:18.706334 24595 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.708742 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:18.709558 23990 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:18.709895 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:18.702575 25865 consensus_meta.cc:287] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 12:17:18.695538 25928 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:18.699450 25787 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.714534 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:18.694219 23915 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:18.717229 25990 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:18.741386 25953 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:18.743603 23961 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:18.745187 25519 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.746587 25579 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:18.747001 25579 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.747352 25579 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:18.672241 25998 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.721231 24595 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
W20260709 12:17:18.752200 25988 log.cc:927] Time spent T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:17:18.753482 23989 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:18.730808 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:18.735805 26000 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.735877 23993 raft_consensus.cc:2410] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:17:18.709501 25523 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:18.722467 25912 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.762118 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:18.766767 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:18.757802 26000 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.760782 25928 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:18.801177 24064 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:18.792708 25832 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:18.786773 25956 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:17:18.847271 26000 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:18.852321 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:18.853018 24600 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:18.856468 23886 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:18.833330 25832 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:18.863799 25832 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.867228 23994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:18.867708 23994 raft_consensus.cc:606] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:18.867992 23994 raft_consensus.cc:614] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:18.854871 25992 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.876191 25519 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.864722 25991 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:18.877058 25991 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.877445 25991 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:18.868880 25912 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.878690 25997 raft_consensus.cc:3055] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:18.878590 25912 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.879125 25997 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:18.880172 25987 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
I20260709 12:17:18.880028 25997 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.880955 25912 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.892920 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:18.903434 25468 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:18.903980 25468 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.864370 25928 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:18.908587 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:18.909179 24063 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:18.908607 24070 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:18.911409 23921 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:18.911598 23914 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:18.869110 26012 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:18.923475 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:18.923379 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:18.924829 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:18.928367 24036 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:18.929852 25948 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:18.924280 23989 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:18.928140 25871 consensus_queue.cc:1059] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:17:18.935591 23913 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:18.937754 23912 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:18.946645 24036 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:18.949188 23995 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:18.924490 26012 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:18.925840 25992 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:18.960232 23992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:18.963387 23992 raft_consensus.cc:606] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:18.952149 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:18.936502 25871 raft_consensus.cc:3055] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:18.971104 25958 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:18.971654 25958 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.972074 25958 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:18.976812 26012 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:18.961589 25523 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:17:18.922758 25982 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:17:18.943223 25618 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:18.962577 25919 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:18.993870 25919 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:18.994338 25919 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:19.012358 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 60289.9us
I20260709 12:17:19.013634 25953 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.968492 25871 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:19.076228 25871 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:19.079715 25787 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:19.078001 25871 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:19.089056 25991 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:19.090519 23919 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:19.094586 25911 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:19.082723 25992 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:19.118913 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 97206.2us
I20260709 12:17:19.102717 26011 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.098721 25888 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:19.138208 24062 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:19.163908 25919 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:19.169242 25919 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:19.170387 25959 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.164820 26011 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:19.098927 25911 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:19.178571 25902 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.114831 25579 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:19.179442 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 63501.7us
I20260709 12:17:19.118356 25992 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:19.186883 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:19.186800 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:19.187955 23917 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.165057 25787 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:19.188441 23996 raft_consensus.cc:2393] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:19.182564 25959 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:19.204429 25959 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:19.205459 25959 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:19.206673 26000 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:19.207181 26000 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:19.208024 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:19.209029 26000 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:19.209684 25955 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.210299 25955 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:19.212878 25955 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:19.162335 25888 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:19.218983 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:19.219671 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:19.219874 25912 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:19.220218 25888 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:19.216995 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:19.184859 25579 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:19.209681 25958 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:19.214464 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:19.220489 25912 raft_consensus.cc:697] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:19.223879 24600 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.219722 24591 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:19.219094 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:19.224120 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:19.210012 25991 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:19.228268 23918 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:19.231465 25468 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:19.184887 26011 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:19.233740 23886 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:19.268391 25990 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:19.189046 25902 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:19.217787 25992 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:19.205965 25959 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:19.234464 23914 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:19.235332 26025 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:19.322000 23919 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:19.323611 23917 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:19.342768 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:19.331730 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 132294us
I20260709 12:17:19.335680 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:19.338806 24600 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:19.343513 23914 raft_consensus.cc:2393] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:19.344419 23886 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:19.333775 25827 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.331131 25990 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:19.335253 25850 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.407505 25850 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:19.411168 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 67598.6us
I20260709 12:17:19.411796 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:19.412724 23989 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.350678 25956 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.368254 23920 raft_consensus.cc:2393] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:19.381112 25990 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:19.383344 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.339809 25928 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:19.434634 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:19.436493 24595 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:19.439007 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:19.439571 23917 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:19.404451 25958 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:19.427856 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:19.436450 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:19.448176 23919 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:19.350589 25468 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.406708 25902 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:19.353708 25824 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:19.344511 25992 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:19.453032 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:19.465281 24063 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:17:19.454466 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:19.466475 23993 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:19.451963 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:19.467787 24595 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:19.458892 25911 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:19.453753 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:19.413546 25956 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:19.460898 23960 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:19.461465 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:19.452205 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 114267us
I20260709 12:17:19.500819 24068 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:19.484272 23917 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:19.433828 25883 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.496944 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:19.501986 23988 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:19.352010 26021 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.117s
I20260709 12:17:19.502912 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:19.505792 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:19.508076 23993 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:19.456534 25850 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:19.486935 24595 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:19.418183 25827 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:19.452500 25981 consensus_queue.cc:1059] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:17:19.456554 25928 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:19.412348 25954 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:19.695483 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.066900 23919 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
W20260709 12:17:20.068751 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 547367us
W20260709 12:17:19.512952 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 85015.4us
W20260709 12:17:19.521240 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60414.3us
I20260709 12:17:20.065420 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35252 (request call id 15) took 1120 ms. Trace:
I20260709 12:17:20.073841 23992 rpcz_store.cc:276] 0709 12:17:18.942445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.942580 (+   135us) service_pool.cc:224] Handling call
0709 12:17:19.877378 (+934798us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b54001b5420. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0bcf520 00007f75c0c4c652 00007f75c5c1a60a 00007f75bf1a07d4 00007f75bf1a0762 00007f75bf1a0691 00007f75bf1a060c 00007f75bf19f8c2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:20.062311 (+184933us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83050880}
I20260709 12:17:19.793450 24600 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:19.860224 23988 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:20.068166 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:20.116472 26012 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:20.117200 26012 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.120014 25958 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:20.120687 25958 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.123957 25981 raft_consensus.cc:3055] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:20.124387 25981 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:20.125238 25981 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.127094 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:20.127923 24064 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:19.502285 25824 raft_consensus.cc:697] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:20.073930 26023 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 12:17:19.509372 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:19.636654 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:20.151626 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.169703 23919 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:19.743218 25897 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:20.173736 23918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.005s	sys 0.086s
W20260709 12:17:20.174147 23918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.005s	sys 0.086s
I20260709 12:17:20.173738 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:19.793313 25911 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:19.517913 25883 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:19.502420 25992 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.090888 25850 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.463902 25468 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.169571 25981 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.086922 25998 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:19.874598 25991 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:20.044538 26025 raft_consensus.cc:697] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:20.174990 23919 raft_consensus.cc:2368] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
W20260709 12:17:20.175721 23990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.020s	sys 0.035s
I20260709 12:17:19.742096 26000 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:19.503067 25912 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:20.197044 23959 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.008s	sys 0.013s
W20260709 12:17:20.250236 23959 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.008s	sys 0.013s
I20260709 12:17:20.173790 24591 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:20.185429 25897 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:20.207062 25919 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:17:20.241762 23990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.020s	sys 0.035s
I20260709 12:17:20.198897 26012 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.204936 25766 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:20.206157 25787 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:20.218255 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.251598 25956 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.187240 25911 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.287494 26000 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.283964 26031 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:20.289619 25959 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.299520 25958 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.289090 25955 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:20.290506 25998 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.313010 25827 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.328022 26029 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.328502 25827 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:20.328615 26029 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.328670 25998 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.330459 26032 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:20.331107 26032 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.331709 25998 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.333186 25911 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:20.333469 25998 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:20.302875 25919 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.190177 25850 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:20.312518 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.019s	sys 0.038s
W20260709 12:17:20.337062 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.020s	sys 0.039s
W20260709 12:17:20.337873 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 254495us
I20260709 12:17:20.313405 26035 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:20.318975 26030 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.307649 26012 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:20.320298 26000 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.320755 26031 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.320703 25897 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.329099 25827 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.313220 23912 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:20.251976 25991 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.335354 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 295) took 1084 ms. Trace:
I20260709 12:17:20.352324 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:20.336517 26024 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.320345 25468 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.334863 25959 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.333292 26032 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.326200 25956 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:20.326782 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1667) took 1317 ms. Trace:
I20260709 12:17:20.288787 25824 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.315064 25787 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.336790 25955 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.334689 25938 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:20.362843 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 290303us
I20260709 12:17:20.362537 26000 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:20.351085 23918 rpcz_store.cc:276] 0709 12:17:19.251286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.334053 (+ 82767us) service_pool.cc:224] Handling call
0709 12:17:19.334486 (+   433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:19.339292 (+  4806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.339326 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:19.426410 (+ 87084us) log.cc:844] Serialized 26 byte log entry
0709 12:17:20.174634 (+748224us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:20.174684 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.174746 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:20.335142 (+160396us) raft_consensus.cc:1685] finished
0709 12:17:20.335160 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.335297 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4435,"raft.queue_time_us":4744,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5257,"thread_start_us":679106,"threads_started":1,"wal-append.queue_time_us":849495}
I20260709 12:17:20.341935 25523 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:20.412117 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:20.308266 25766 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.361001 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1758) took 1133 ms. Trace:
I20260709 12:17:20.373466 25850 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:20.374486 25827 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.385128 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:20.390347 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:20.342067 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 401084us
I20260709 12:17:20.418782 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1757) took 1200 ms. Trace:
W20260709 12:17:20.347271 24034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.021s	sys 0.020s
I20260709 12:17:20.419888 25519 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:20.420236 25519 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.420526 25519 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.421279 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.422142 23918 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
W20260709 12:17:20.422546 24034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.021s	sys 0.020s
W20260709 12:17:20.395349 24070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.016s	sys 0.026s
I20260709 12:17:20.336441 26021 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.354982 25911 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:20.349874 26025 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.409797 26039 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:20.415084 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 242516us
I20260709 12:17:20.416709 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:20.423830 24070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.016s	sys 0.027s
I20260709 12:17:20.426918 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.419137 23916 rpcz_store.cc:276] 0709 12:17:19.218533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.384758 (+1166225us) service_pool.cc:224] Handling call
0709 12:17:20.418727 (+ 33969us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:20.433327 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.423332 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:20.434087 23961 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:20.334136 25998 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.452702 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.396390 25959 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.410236 26034 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:20.353964 26012 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.445559 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.461755 23917 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:20.428655 25883 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.446344 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.416834 25865 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:20.457623 25519 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.461123 23918 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 2: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:20.462863 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.428696 25850 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:20.411019 25956 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.347549 26030 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:20.464684 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:20.463433 24036 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:20.468866 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.413130 25523 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.470180 25519 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.368031 26024 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.417282 23912 rpcz_store.cc:276] 0709 12:17:19.227093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.217877 (+990784us) service_pool.cc:224] Handling call
0709 12:17:20.356353 (+138476us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:20.442756 25992 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.477706 26044 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:20.479190 25955 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.440910 25583 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:20.480026 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:20.446365 25928 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.418848 25938 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.529096 23993 raft_consensus.cc:2368] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:20.502115 24036 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:20.484432 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.458731 25827 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:20.504453 26043 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:20.466068 25865 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.469259 25841 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:20.515910 25919 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:20.516921 26040 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:20.517370 26046 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:17:20.518174 26042 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.518392 26024 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.479688 26037 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:20.519711 25956 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:20.521416 26030 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.521778 26031 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.522825 25997 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.523744 25998 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.479856 25850 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.530768 23920 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:20.567286 24566 leader_election.cc:400] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:20.454144 25911 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.505739 25883 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:20.465019 26011 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.002s	sys 0.018s
W20260709 12:17:20.550740 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 98212.9us
I20260709 12:17:20.511044 25958 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.508661 26029 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:20.438081 26021 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.524539 25992 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:20.525686 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.632814 23917 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:20.467242 26034 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.564698 26047 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:20.564829 26037 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.454324 26039 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.531697 26043 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:20.567669 24566 leader_election.cc:403] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:20.531289 25865 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:20.531638 26035 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:20.539189 26040 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:20.557476 25919 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:20.729209 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:20.729887 24600 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:20.731478 25519 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:20.732908 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.632395 25992 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:20.538789 25827 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.551940 25841 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.551740 25583 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.631209 25958 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.560403 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:20.748334 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:20.694821 26043 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:20.567003 26024 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:20.675299 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 110994us
I20260709 12:17:20.632634 25991 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.742835 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.628971 25883 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.743598 25519 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.532323 26044 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.701323 26011 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:20.699918 26029 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:20.734414 25787 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.760598 23917 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:20.734726 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:20.702960 26040 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:20.559832 26042 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:20.743093 25992 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:20.760080 24566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.2:43801 timed out after 1.938s (SENT) [suppressed 6 similar messages]
W20260709 12:17:20.738235 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 115371us
I20260709 12:17:20.404685 23913 rpcz_store.cc:276] 0709 12:17:18.999339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.003233 (+  3894us) service_pool.cc:224] Handling call
0709 12:17:19.005847 (+  2614us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:19.006191 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.006228 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:19.009413 (+  3185us) log.cc:844] Serialized 26 byte log entry
0709 12:17:19.339239 (+329826us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:19.340909 (+  1670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:19.344622 (+  3713us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:20.305797 (+961175us) raft_consensus.cc:1685] finished
0709 12:17:20.307391 (+  1594us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:20.317040 (+  9649us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3823,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":6169,"thread_start_us":302040,"threads_started":1,"wal-append.queue_time_us":453671}
W20260709 12:17:20.846859 26045 log.cc:927] Time spent T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
I20260709 12:17:20.847235 26041 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:20.847915 26050 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:20.742710 26030 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:20.623929 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 189920us
I20260709 12:17:20.737253 25912 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:20.744752 25766 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:20.675298 23912 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:20.674412 26047 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.727742 26035 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.742118 25998 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:20.902822 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:21.039284 24036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.007s
W20260709 12:17:21.166465 24036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.009s	sys 0.007s
W20260709 12:17:21.166863 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 636121us
I20260709 12:17:21.021380 25959 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.172735 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:20.848016 25519 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.088320 26039 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.156059 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.194247 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.195731 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.196480 23995 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:21.156666 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.156595 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:20.985126 26060 log.cc:927] Time spent T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
I20260709 12:17:20.928709 25897 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:20.852128 26021 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:20.982095 25841 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.119486 25958 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.982347 25832 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:21.164100 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:21.124719 25911 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:21.123378 25850 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:20.954752 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:21.056751 25938 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:20.940642 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 371504us
I20260709 12:17:20.983098 26059 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:21.166126 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.170918 25583 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.145836 26011 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:21.176934 26033 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.888s	user 0.005s	sys 0.015s
W20260709 12:17:20.850389 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 102114us
I20260709 12:17:20.850835 23987 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
W20260709 12:17:21.150892 23989 consensus_meta.cc:287] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 1.737s	user 0.013s	sys 0.013s
I20260709 12:17:21.183075 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:21.186030 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 425926us
I20260709 12:17:21.165019 26030 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:20.786507 26024 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:21.167683 25954 consensus_meta.cc:287] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.000s
W20260709 12:17:20.143838 25618 consensus_queue.cc:1175] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71a48f59ff764d249519c6a53ec57f02" responder_term: 4 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:21.304615 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.204535 24065 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:21.308023 23960 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:21.309684 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:21.205569 25468 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:21.169183 25912 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.324402 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:21.175684 25865 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.319921 24070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1474) took 1864 ms. Trace:
I20260709 12:17:21.326704 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:21.322220 24595 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:21.327512 24070 rpcz_store.cc:276] 0709 12:17:19.450824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.450961 (+   137us) service_pool.cc:224] Handling call
0709 12:17:19.451280 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:19.451628 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:19.451657 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:19.459915 (+  8258us) log.cc:844] Serialized 26 byte log entry
0709 12:17:20.444292 (+984377us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:20.444347 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:20.444433 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:21.314919 (+870486us) raft_consensus.cc:1685] finished
0709 12:17:21.314940 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.315058 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":135,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":10037,"thread_start_us":750854,"threads_started":1,"wal-append.queue_time_us":923568}
I20260709 12:17:21.325577 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.302069 26059 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.162464 26041 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.312492 25766 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:21.329814 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.167969 26050 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.336899 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:21.339128 23920 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:21.207007 25897 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.339947 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:21.332360 25583 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.312230 23989 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:21.320767 26037 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.363854 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:21.365131 23887 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:21.364616 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.307302 25832 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.334477 24591 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 2: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:21.369153 23991 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:21.206578 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:21.369210 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:21.330838 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.332991 25827 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:21.459991 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 94934.9us
I20260709 12:17:21.203970 25998 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.332702 26059 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:21.461508 23996 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 314) took 2547 ms (client timeout 1938 ms). Trace:
I20260709 12:17:21.334244 25841 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.365778 25955 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.510231 26028 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:21.510509 25955 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.510783 26028 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.365165 25583 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.502071 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:21.502912 23996 rpcz_store.cc:269] 0709 12:17:18.914530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:18.914769 (+   239us) service_pool.cc:224] Handling call
0709 12:17:21.410308 (+2495539us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54000690d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:21.461438 (+ 51130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589149568}
I20260709 12:17:21.509862 26053 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.511008 25998 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:21.400425 23989 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 1772) took 1989 ms (client timeout 2245 ms). Trace:
W20260709 12:17:21.505498 26066 log.cc:927] Time spent T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
W20260709 12:17:21.525611 26063 log.cc:927] Time spent T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.006s
W20260709 12:17:21.526376 26068 log.cc:927] Time spent T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 12:17:21.460440 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:21.347537 25766 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.509653 25841 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.524001 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:21.524475 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.524602 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.520092 25583 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.524724 26076 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:21.561057 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 59024.3us
I20260709 12:17:21.522028 26053 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:21.564903 24035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.036s	sys 0.060s
I20260709 12:17:21.508628 25827 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:21.526110 26070 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:21.564225 26079 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:21.565594 25998 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:21.525256 23989 rpcz_store.cc:269] 0709 12:17:19.411228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.411383 (+   155us) service_pool.cc:224] Handling call
0709 12:17:21.377040 (+1965657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:21.583630 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.593389 23996 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:21.560642 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:21.579926 24035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.036s	sys 0.060s
I20260709 12:17:21.564651 26035 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.590108 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.527179 25911 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.060s
W20260709 12:17:21.595217 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 226052us
I20260709 12:17:21.570528 26073 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.582700 26053 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:21.584661 25990 consensus_meta.cc:287] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 2.128s	user 0.007s	sys 0.008s
I20260709 12:17:21.610571 24596 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:21.610772 26071 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:21.583295 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:21.625557 23913 raft_consensus.cc:2410] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:21.611953 25841 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.613176 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.614666 26079 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.616923 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 317) took 1129 ms. Trace:
W20260709 12:17:21.632400 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 265065us
I20260709 12:17:21.634688 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:21.640739 23988 rpcz_store.cc:276] 0709 12:17:20.487883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.488069 (+   186us) service_pool.cc:224] Handling call
0709 12:17:20.513817 (+ 25748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:20.738193 (+224376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:20.738236 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:20.745261 (+  7025us) log.cc:844] Serialized 26 byte log entry
0709 12:17:21.203636 (+458375us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:21.203681 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.204176 (+   495us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:21.616696 (+412520us) raft_consensus.cc:1685] finished
0709 12:17:21.616715 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.616848 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":315027,"raft.queue_time_us":242549,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":138,"thread_start_us":444148,"threads_started":1,"wal-append.queue_time_us":576397}
I20260709 12:17:21.605254 26085 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:21.646575 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:21.650784 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.654708 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.587752 26076 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.660017 26087 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.668179 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:21.668798 23995 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.606060 25827 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.633806 24065 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:21.601483 25998 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:21.648237 26056 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:21.637619 26051 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.003s	sys 0.033s
I20260709 12:17:21.659274 25841 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:21.687646 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 53033.3us
W20260709 12:17:21.688956 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.637100 25990 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.660447 26079 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:21.680718 26051 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.003s	sys 0.033s
I20260709 12:17:21.656486 26085 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.693562 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.709874 23988 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:21.673115 26047 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.674010 26090 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:21.704043 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:21.717731 26091 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:21.706302 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:21.685349 25841 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.716611 23914 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:21.744884 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.745755 23988 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:21.688050 26056 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:21.694149 24065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 1479) took 2227 ms (client timeout 1667 ms). Trace:
I20260709 12:17:21.589865 26070 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.693018 25897 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.705431 25832 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.708575 25912 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:21.771839 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 83243.4us
I20260709 12:17:21.737084 25841 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:21.738023 25956 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:21.774755 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:21.711570 26085 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:21.715782 26051 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.778923 26051 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.758690 26056 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:21.789768 26070 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.764070 26086 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:21.758086 25992 consensus_meta.cc:287] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.001s
I20260709 12:17:21.755292 25911 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:21.715667 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:21.782828 25832 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:21.783093 26088 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.633772 26073 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.774426 26050 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.797042 24594 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:21.802822 26076 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.804571 25990 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.773092 26044 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.792027 25766 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:21.759066 24065 rpcz_store.cc:269] 0709 12:17:19.454190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.455554 (+  1364us) service_pool.cc:224] Handling call
0709 12:17:21.172521 (+1716967us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b5800133e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:21.679704 (+507183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11106688}
I20260709 12:17:21.816849 23993 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:21.718248 26091 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.772944 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.845228 23988 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:21.821453 23995 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
W20260709 12:17:21.832046 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 279987us
I20260709 12:17:21.775955 26090 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.847179 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.848167 23995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:21.848677 23995 raft_consensus.cc:606] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:21.848922 26090 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.848996 23995 raft_consensus.cc:614] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:21.783983 25956 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.849561 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:21.851074 25956 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:21.843946 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 165578us
I20260709 12:17:21.852228 23960 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:21.853197 23995 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:21.854338 23995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:21.706077 26087 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.854844 23995 raft_consensus.cc:606] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:21.855211 23995 raft_consensus.cc:614] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:21.818785 25832 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.856276 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:21.857508 25832 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.857765 23988 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:21.810109 26084 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.817953 25911 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:21.846652 25766 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:21.813015 25992 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.858040 25832 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:21.782160 26051 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.813962 26028 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.821576 26086 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:21.844605 26072 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.868324 26093 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:21.844254 24598 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:17:21.879746 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 105061us
I20260709 12:17:21.886664 24034 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:21.846788 26044 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:17:21.873992 26097 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:21.897707 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 45437.7us
I20260709 12:17:21.898720 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:21.873162 25832 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:21.886071 25774 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:21.925851 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:21.926704 24067 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:21.868367 26103 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:21.863992 26084 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:21.948124 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 82871.8us
I20260709 12:17:21.891948 26090 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:21.892478 25827 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:21.949770 24061 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:21.891136 25998 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.867483 25766 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.972012 24062 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:21.891252 25897 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 12:17:21.975412 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:21.926822 25774 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:21.979249 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 759) took 1235 ms. Trace:
I20260709 12:17:21.979168 26098 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:21.979696 26094 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:21.988737 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:21.971846 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:22.022750 26100 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:21.845162 26088 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.006778 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:21.978466 23914 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56870 (request call id 297) took 2604 ms (client timeout 1533 ms). Trace:
I20260709 12:17:22.013831 24600 rpcz_store.cc:276] 0709 12:17:20.743604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.743774 (+   170us) service_pool.cc:224] Handling call
0709 12:17:21.978567 (+1234793us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:21.978763 (+   196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:21.978935 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:21.978961 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:21.979001 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:21.979032 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:21.979089 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:21.979197 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4994944}
I20260709 12:17:21.895241 26093 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:22.026629 23914 rpcz_store.cc:269] 0709 12:17:19.373701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.427563 (+ 53862us) service_pool.cc:224] Handling call
0709 12:17:21.978263 (+2550700us) spinlock_profiling.cc:243] Waited 2.27 s on lock 0x7b54002c3154. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:21.978382 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5216870144}
I20260709 12:17:21.998924 25953 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:22.037333 26089 log.cc:927] Time spent T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:17:22.037928 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.038409 26079 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:21.979724 26096 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:22.040329 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.041689 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:21.904552 26072 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:22.007939 26083 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:22.015761 25774 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.043730 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.065657 24067 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:22.026186 23988 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:22.023663 26100 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:21.987680 26090 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:21.949273 26097 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.017516 26095 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:22.066977 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.039732 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.064879 25832 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:22.074760 25997 consensus_meta.cc:287] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.509s	user 0.021s	sys 0.017s
I20260709 12:17:22.036890 24065 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:22.003641 25911 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.089962 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.092784 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:22.095069 23988 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:22.096769 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.098222 23960 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:22.098481 24066 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:22.106969 23921 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:22.070811 26100 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:22.108072 26101 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:22.068804 26096 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:22.097457 25583 consensus_meta.cc:287] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.002s
I20260709 12:17:22.065361 25953 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.095043 26095 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:22.041420 26094 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.035784 26098 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:22.187744 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.600492 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:22.602419 23988 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:22.577271 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.210107 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:22.110061 23912 consensus_meta.cc:287] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.771s	user 0.058s	sys 0.058s
I20260709 12:17:22.612586 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.105484 25883 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.606563 24064 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
W20260709 12:17:22.608604 24598 consensus_meta.cc:287] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.732s	user 0.025s	sys 0.013s
I20260709 12:17:22.613370 23914 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:22.108728 25824 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:22.161440 26054 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 1.303s	user 0.020s	sys 0.009s
W20260709 12:17:22.516268 26053 consensus_meta.cc:287] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.875s	user 0.008s	sys 0.012s
W20260709 12:17:22.223412 26043 consensus_meta.cc:287] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 1.370s	user 0.010s	sys 0.000s
I20260709 12:17:22.240324 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:22.626873 24593 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37704 (request call id 762) took 1876 ms (client timeout 2075 ms). Trace:
I20260709 12:17:22.622084 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:22.627281 24593 rpcz_store.cc:269] 0709 12:17:20.750402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.751167 (+   765us) service_pool.cc:224] Handling call
0709 12:17:22.240001 (+1488834us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:22.626790 (+386789us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17563008}
I20260709 12:17:22.628453 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:22.629096 25766 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.629359 23988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:22.629878 23988 raft_consensus.cc:606] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:22.630167 23988 raft_consensus.cc:614] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:22.631524 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:17:22.633464 26040 consensus_meta.cc:287] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 1.491s	user 0.013s	sys 0.004s
I20260709 12:17:22.110330 25992 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.136581 25583 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.635597 23996 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:22.136307 26051 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.623425 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.624409 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.624531 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:22.636554 25583 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:22.637233 24062 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:22.606917 26044 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:22.636760 25824 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.639204 26044 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.209750 25897 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:22.641072 25897 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:22.641669 26059 consensus_meta.cc:287] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 1.130s	user 0.011s	sys 0.006s
I20260709 12:17:22.641733 26044 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.625325 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:22.262494 25841 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.607555 26090 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.110579 26096 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:22.310920 26029 consensus_meta.cc:287] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 1.176s	user 0.007s	sys 0.005s
I20260709 12:17:22.612596 26091 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:22.638695 25953 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:22.116295 26084 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.625450 26101 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:22.096748 26083 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.115895 25523 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.233799 26073 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:22.175458 26087 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:22.249003 26088 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:22.175072 26104 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:22.625851 26043 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.176102 26097 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:22.209803 24065 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:22.645358 26051 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.607334 26095 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:22.245170 26086 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:22.642210 26059 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:22.637748 23914 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:22.671270 23988 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:22.633862 26040 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.251466 26056 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.674656 26043 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:22.675040 23987 raft_consensus.cc:2368] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6.
I20260709 12:17:22.680339 23991 raft_consensus.cc:2368] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6.
I20260709 12:17:22.468441 25774 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.649166 25997 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:17:22.658214 25841 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:22.658461 24066 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:22.648448 26070 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:22.650592 26029 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
W20260709 12:17:22.661840 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 51937.3us
I20260709 12:17:22.652282 26091 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:22.807979 26091 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.808645 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:22.809240 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 143940us
I20260709 12:17:22.644104 26053 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.811975 26053 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.666169 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.813220 24062 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:22.646225 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.674192 26040 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.814787 24064 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:22.814318 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.820468 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.824723 24067 raft_consensus.cc:2368] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:22.830840 23887 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:22.820684 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1693) took 1484 ms. Trace:
I20260709 12:17:22.667569 26104 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.804606 25897 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:22.836902 26109 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
I20260709 12:17:22.837329 26087 consensus_queue.cc:1059] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:22.819020 26097 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:22.837869 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.908950 23913 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:22.909011 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:22.909309 25774 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:22.909652 24594 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:22.838567 24597 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:22.841775 23818 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43626 (request call id 194) took 6788 ms. Trace:
I20260709 12:17:22.843561 26098 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:22.805972 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.911128 24065 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:22.806901 26070 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:22.848882 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.837881 26012 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:22.867744 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:22.874915 23921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 1675) took 3438 ms (client timeout 1628 ms). Trace:
I20260709 12:17:22.875785 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:17:22.875844 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45102us
I20260709 12:17:22.910781 23818 rpcz_store.cc:276] 0709 12:17:16.052865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.057484 (+  4619us) service_pool.cc:224] Handling call
0709 12:17:18.233297 (+2175813us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b54002e41a8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c45bc161 00007f75c46463af 00007f75c4647b11 00007f75c6b47fa1 00007f75c6b487ff 00007f75c6a07a1b 00007f75c6b0f90e 00007f75c4fd02a4 00007f75c4fd0232 00007f75c4fd0161 00007f75c4fd00dc
0709 12:17:22.841687 (+4608390us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:18.461870 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:18.474726 (+ 12856us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:18.474773 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:17:18.474790 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:18.502232 (+ 27442us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:18.515135 (+ 12903us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:18.515183 (+    48us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:17:18.587810 (+ 72627us) tablet.cc:701] Row locks acquired
0709 12:17:18.609169 (+ 21359us) write_op.cc:260] PREPARE: finished
0709 12:17:18.621337 (+ 12168us) write_op.cc:270] Start()
0709 12:17:18.621516 (+   179us) write_op.cc:276] Timestamp: P: 1783599438614453 usec, L: 0
0709 12:17:18.621559 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:17:18.622350 (+   791us) log.cc:844] Serialized 2039 byte log entry
0709 12:17:18.936338 (+313988us) op_driver.cc:464] REPLICATION: finished
0709 12:17:19.069812 (+133474us) write_op.cc:301] APPLY: starting
0709 12:17:19.069934 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:19.070151 (+   217us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:19.070386 (+   235us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:19.071427 (+  1041us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:19.071609 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:17:19.071653 (+    44us) write_op.cc:312] APPLY: finished
0709 12:17:19.072212 (+   559us) log.cc:844] Serialized 47 byte log entry
0709 12:17:19.072411 (+   199us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:19.072529 (+   118us) write_op.cc:454] Released schema lock
0709 12:17:19.072573 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:19.073029 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:19.073075 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":818804,"reported_tablets":12,"spinlock_wait_cycles":5133056,"child_traces":[["op",{"apply.queue_time_us":133114,"apply.run_cpu_time_us":2982,"apply.run_wall_time_us":3203,"num_ops":5,"prepare.queue_time_us":201181,"prepare.run_cpu_time_us":24129,"prepare.run_wall_time_us":252006,"raft.queue_time_us":168667,"raft.run_cpu_time_us":39796,"raft.run_wall_time_us":80976,"replication_time_us":314609,"thread_start_us":394675,"threads_started":4,"wal-append.queue_time_us":131554,"wal-append.run_cpu_time_us":24740,"wal-append.run_wall_time_us":1319497}]]}
I20260709 12:17:22.885082 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.880685 23917 rpcz_store.cc:276] 0709 12:17:21.335955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.336245 (+   290us) service_pool.cc:224] Handling call
0709 12:17:21.336508 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:21.470690 (+134182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:21.470735 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:21.470791 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:21.470834 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.820489 (+1349655us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b54001fed54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:22.820532 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:22.820637 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":308027136}
I20260709 12:17:22.920006 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:22.920655 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.921756 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.892650 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:22.918885 23921 rpcz_store.cc:269] 0709 12:17:19.436388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:19.437587 (+  1199us) service_pool.cc:224] Handling call
0709 12:17:22.849845 (+3412258us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b54001590d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:22.874843 (+ 24998us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5992999808}
I20260709 12:17:22.923691 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.924281 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:22.924978 23921 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 2: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:22.924876 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.925778 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:22.907943 26100 consensus_meta.cc:287] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.771s	user 0.007s	sys 0.006s
I20260709 12:17:22.913398 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.910035 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.841614 26096 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.926039 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:22.937273 23914 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:22.928275 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:22.905717 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 97608.4us
I20260709 12:17:22.935812 26091 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:22.902807 26073 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:22.954455 26034 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:22.955582 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1686) took 2428 ms. Trace:
W20260709 12:17:22.942601 25919 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.193s	user 0.023s	sys 0.044s
W20260709 12:17:22.959175 25919 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.213s	user 0.023s	sys 0.044s
I20260709 12:17:22.959442 25919 raft_consensus.cc:697] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:22.947235 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:22.966087 24600 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 1.
I20260709 12:17:22.971077 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:22.973052 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:22.978580 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:22.980679 24066 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:22.981498 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:22.982343 23921 raft_consensus.cc:2393] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:22.937018 26094 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:22.955408 26056 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:22.962249 26073 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:22.960861 26087 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:22.935051 26083 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:22.966523 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:22.992168 23989 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:22.948323 26100 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:22.994655 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1671) took 1817 ms. Trace:
I20260709 12:17:22.995399 26024 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:22.957399 23912 rpcz_store.cc:276] 0709 12:17:20.526945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.531115 (+  4170us) service_pool.cc:224] Handling call
0709 12:17:20.581924 (+ 50809us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:20.633630 (+ 51706us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:22.621855 (+1988225us) log.cc:844] Serialized 14 byte log entry
0709 12:17:22.954714 (+332859us) log.cc:844] Serialized 14 byte log entry
0709 12:17:22.955176 (+   462us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:22.955238 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:22.955305 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.955374 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:22.955503 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41742,"raft.queue_time_us":66915,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":169,"spinlock_wait_cycles":2432,"thread_start_us":271076,"threads_started":2,"wal-append.queue_time_us":275895}
I20260709 12:17:22.996080 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1779) took 2523 ms. Trace:
I20260709 12:17:22.996299 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:22.984905 23913 raft_consensus.cc:2393] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 2: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:22.989864 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1705) took 1060 ms. Trace:
I20260709 12:17:22.998728 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:23.045642 24062 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:22.986095 26000 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:23.006546 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.918932 26097 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:17:23.018265 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:22.992849 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1680) took 2510 ms. Trace:
I20260709 12:17:22.980654 25841 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:17:23.023564 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:23.012465 26072 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:23.024353 23989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1675) took 1817 ms. Trace:
I20260709 12:17:23.014386 26051 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:23.035390 23992 rpcz_store.cc:276] 0709 12:17:20.472853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.476769 (+  3916us) service_pool.cc:224] Handling call
0709 12:17:20.477074 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:20.927267 (+450193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:20.927293 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:20.927326 (+    33us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:20.927355 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.995889 (+2068534us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54002562d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:22.995930 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:22.996033 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989853568}
I20260709 12:17:23.025807 23988 rpcz_store.cc:276] 0709 12:17:21.177349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.638187 (+1460838us) service_pool.cc:224] Handling call
0709 12:17:22.650244 (+ 12057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:22.671733 (+ 21489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.994399 (+322666us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b5400098654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:22.994600 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47958784}
I20260709 12:17:23.044939 23990 raft_consensus.cc:2410] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:23.012639 26087 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:23.093050 23919 rpcz_store.cc:276] 0709 12:17:20.482172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.482292 (+   120us) service_pool.cc:224] Handling call
0709 12:17:20.509168 (+ 26876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:20.851659 (+342491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:20.851691 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:20.851731 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:20.851764 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.992648 (+2140884us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54001e0354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:22.992689 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:22.992796 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787180288}
I20260709 12:17:23.045457 23914 rpcz_store.cc:276] 0709 12:17:21.929572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.969472 (+1039900us) service_pool.cc:224] Handling call
0709 12:17:22.989332 (+ 19860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:22.989518 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:22.989549 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:22.989614 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:22.989658 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:22.989713 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:22.989810 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:23.114444 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:23.092262 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:22.999496 26116 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:23.093082 24063 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:23.015995 26073 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:23.115917 23990 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 1659) took 1959 ms (client timeout 1500 ms). Trace:
I20260709 12:17:23.114800 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:23.046706 26085 consensus_meta.cc:287] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.256s	user 0.028s	sys 0.035s
I20260709 12:17:23.120105 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:23.043401 24591 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:23.094605 25997 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:23.090894 24594 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:23.154138 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:23.154835 23919 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:23.155390 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:23.150538 23921 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:23.095250 25919 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:23.090559 26000 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:23.168884 26000 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:23.120918 24064 raft_consensus.cc:2368] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
W20260709 12:17:23.119969 23990 rpcz_store.cc:269] 0709 12:17:21.155980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.156469 (+   489us) service_pool.cc:224] Handling call
0709 12:17:23.044577 (+1888108us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000bb1a0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0bc9dc0 00007f75c0c55e18 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:23.115841 (+ 71264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276872576}
I20260709 12:17:23.114833 26030 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:23.161891 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:23.119467 26116 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:23.194873 24062 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:23.161801 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:23.117031 25579 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:23.117935 26087 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:23.161247 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:23.192462 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:23.197176 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:23.197436 23990 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:23.199124 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:23.199714 24062 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:23.202950 26011 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:23.204339 24062 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:23.205035 26041 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:23.205210 25579 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:23.206534 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 324) took 1889 ms. Trace:
I20260709 12:17:23.206979 23996 rpcz_store.cc:276] 0709 12:17:21.317001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.639125 (+322124us) service_pool.cc:224] Handling call
0709 12:17:23.206293 (+1567168us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b5400066dd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:23.206461 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2253553920}
I20260709 12:17:23.207858 25579 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:23.208308 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:23.212745 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1679) took 2731 ms. Trace:
I20260709 12:17:23.213335 24064 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:23.213230 23918 rpcz_store.cc:276] 0709 12:17:20.481456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.481566 (+   110us) service_pool.cc:224] Handling call
0709 12:17:20.481802 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:20.851601 (+369799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:20.851648 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:20.851704 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:20.851751 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.212437 (+2360686us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b540017af54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:23.212513 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:23.212672 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829141248}
I20260709 12:17:23.094781 23989 rpcz_store.cc:276] 0709 12:17:21.207322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.991688 (+1784366us) service_pool.cc:224] Handling call
0709 12:17:22.992001 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:23.024082 (+ 32081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.024291 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:23.200420 26096 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:23.197852 26116 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:23.258800 26112 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:17:23.260030 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 326) took 1938 ms. Trace:
I20260709 12:17:23.150907 26085 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:23.260448 23996 rpcz_store.cc:276] 0709 12:17:21.321485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.209432 (+1887947us) service_pool.cc:224] Handling call
0709 12:17:23.259550 (+ 50118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:23.259713 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.259737 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:23.259777 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:23.259808 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:23.259856 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:23.259966 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:23.262760 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:23.986903 24035 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.000s	sys 0.039s
W20260709 12:17:23.987241 24035 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.000s	sys 0.039s
W20260709 12:17:23.987496 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 866652us
W20260709 12:17:23.686133 26112 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
W20260709 12:17:23.803936 25997 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.011s	sys 0.015s
W20260709 12:17:23.983457 26126 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:17:24.013449 23989 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:24.148572 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1678) took 2817 ms. Trace:
I20260709 12:17:24.149741 23988 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
W20260709 12:17:23.261641 26095 consensus_meta.cc:287] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.001s
I20260709 12:17:23.266911 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:23.526855 26097 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.166716 23988 pending_rounds.cc:85] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 4
I20260709 12:17:24.166352 23996 rpcz_store.cc:276] 0709 12:17:21.331204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.984547 (+2653343us) service_pool.cc:224] Handling call
0709 12:17:24.147918 (+163371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.148152 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.148189 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.148244 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:24.148293 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.148363 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.148501 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.133477 25708 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:24.169118 23988 pending_rounds.cc:107] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:17:24.190943 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 328) took 2671 ms. Trace:
I20260709 12:17:24.191545 23996 rpcz_store.cc:276] 0709 12:17:21.519599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.170617 (+2651018us) service_pool.cc:224] Handling call
0709 12:17:24.189522 (+ 18905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.190157 (+   635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.190332 (+   175us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.190477 (+   145us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:24.190558 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.190675 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.190865 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.185811 23988 raft_consensus.cc:2889] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:24.195488 23914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.004s	sys 0.036s
W20260709 12:17:24.195911 23914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.004s	sys 0.036s
I20260709 12:17:24.196312 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1679) took 2853 ms. Trace:
W20260709 12:17:24.158511 23960 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.004s	sys 0.017s
I20260709 12:17:23.522919 26070 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:23.373174 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:24.157477 25997 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.011s	sys 0.019s
I20260709 12:17:24.196874 23988 rpcz_store.cc:276] 0709 12:17:21.342956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.985046 (+2642090us) service_pool.cc:224] Handling call
0709 12:17:24.149316 (+164270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.195941 (+ 46625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.196212 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.170655 26127 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:24.191200 25708 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:24.197429 23960 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.004s	sys 0.017s
I20260709 12:17:24.191463 23989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 327) took 2863 ms. Trace:
I20260709 12:17:24.209403 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 329) took 2685 ms. Trace:
W20260709 12:17:24.209502 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 713041us
I20260709 12:17:24.209807 23996 rpcz_store.cc:276] 0709 12:17:21.524172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.194858 (+2670686us) service_pool.cc:224] Handling call
0709 12:17:24.208912 (+ 14054us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.209086 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.209112 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.209150 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:24.209188 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.209240 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.209352 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.204427 24592 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
W20260709 12:17:24.214452 24592 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37704 (request call id 761) took 3464 ms (client timeout 2401 ms). Trace:
W20260709 12:17:24.214834 24592 rpcz_store.cc:269] 0709 12:17:20.750085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.750219 (+   134us) service_pool.cc:224] Handling call
0709 12:17:23.266380 (+2516161us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:24.214365 (+947985us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17496448}
I20260709 12:17:24.218839 26059 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:24.196527 26095 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.202358 25997 raft_consensus.cc:697] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:24.234719 23994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 323) took 3700 ms. Trace:
I20260709 12:17:24.235246 23994 rpcz_store.cc:276] 0709 12:17:20.534130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:20.539705 (+  5575us) service_pool.cc:224] Handling call
0709 12:17:20.561609 (+ 21904us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:21.206075 (+644466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:21.206106 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:21.206144 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:21.206174 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.234407 (+3028233us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54002aa3d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:24.234471 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.234645 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481677056}
W20260709 12:17:24.229884 23912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.025s	sys 0.040s
W20260709 12:17:24.239289 24065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.008s	sys 0.044s
W20260709 12:17:24.239853 24065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.008s	sys 0.044s
I20260709 12:17:24.239920 24061 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:24.239585 23996 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:24.241688 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 345) took 1432 ms. Trace:
I20260709 12:17:24.206682 26127 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.242352 24065 rpcz_store.cc:276] 0709 12:17:22.808912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.911910 (+102998us) service_pool.cc:224] Handling call
0709 12:17:22.912251 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:22.912488 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:23.090980 (+178492us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.241266 (+1150286us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.241331 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:24.241394 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.241478 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.241622 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":308660,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":2476,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":14108,"thread_start_us":1327996,"threads_started":2}
I20260709 12:17:24.243476 23994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 334) took 1229 ms. Trace:
I20260709 12:17:24.265250 23994 rpcz_store.cc:276] 0709 12:17:23.013573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.236617 (+1223044us) service_pool.cc:224] Handling call
0709 12:17:24.242971 (+  6354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.243155 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.243179 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.243243 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:24.243276 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.243327 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.243427 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:24.266798 26087 consensus_meta.cc:287] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.004s	user 0.008s	sys 0.000s
I20260709 12:17:24.267222 26087 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.269255 26087 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:24.272066 25708 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:24.242462 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1793) took 2173 ms. Trace:
I20260709 12:17:24.277122 23996 rpcz_store.cc:276] 0709 12:17:22.069465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.210852 (+2141387us) service_pool.cc:224] Handling call
0709 12:17:24.239410 (+ 28558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.242157 (+  2747us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.242397 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.242705 25787 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:24.240118 23912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.026s	sys 0.040s
I20260709 12:17:24.211043 23989 rpcz_store.cc:276] 0709 12:17:21.325653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.264901 (+1939248us) service_pool.cc:224] Handling call
0709 12:17:23.535091 (+270190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.165069 (+629978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.188949 (+ 23880us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:24.299168 26073 consensus_meta.cc:287] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.146s	user 0.009s	sys 0.002s
I20260709 12:17:24.311619 26104 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.315321 26127 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:24.302380 25997 consensus_queue.cc:237] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.327776 23961 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:24.330646 26059 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:24.331095 26059 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:24.331439 26059 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.328652 26019 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:24.334664 26095 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.334916 26019 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.337064 26019 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:24.347561 26059 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:24.351898 26059 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:24.354074 26116 consensus_meta.cc:287] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.072s	user 0.007s	sys 0.000s
I20260709 12:17:24.308339 26073 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:24.329741 26085 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:24.361261 26073 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:24.357885 26116 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.384529 26116 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:24.386243 26000 consensus_meta.cc:287] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.217s	user 0.010s	sys 0.002s
I20260709 12:17:24.386790 25955 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:24.386793 26000 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.389292 26000 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:24.389462 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1735) took 2442 ms. Trace:
I20260709 12:17:24.389912 24068 rpcz_store.cc:276] 0709 12:17:21.946825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.949550 (+  2725us) service_pool.cc:224] Handling call
0709 12:17:24.388724 (+2439174us) spinlock_profiling.cc:243] Waited 22.4 ms on lock 0x7b5800133e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:24.388930 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.389119 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.389147 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.389189 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:24.389220 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.389274 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.389379 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51413888}
W20260709 12:17:24.428750 26081 log.cc:927] Time spent T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 2.855s	user 0.023s	sys 0.019s
I20260709 12:17:24.430894 25865 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:24.446681 26042 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.452234 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1776) took 1831 ms. Trace:
I20260709 12:17:24.452724 23912 rpcz_store.cc:276] 0709 12:17:22.621047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.092018 (+470971us) service_pool.cc:224] Handling call
0709 12:17:23.114103 (+ 22085us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.167850 (+ 53747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.170859 (+  3009us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.266404 (+ 95545us) log.cc:844] Serialized 26 byte log entry
0709 12:17:24.440121 (+1173717us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:24.450908 (+ 10787us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.451851 (+   943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.451948 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.451998 (+    50us) raft_consensus.cc:1685] finished
0709 12:17:24.452011 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.452170 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10702,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":2077,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":32385,"thread_start_us":606653,"threads_started":2,"wal-append.queue_time_us":910426}
I20260709 12:17:24.475482 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1790) took 2542 ms. Trace:
I20260709 12:17:24.475983 23988 rpcz_store.cc:276] 0709 12:17:21.932904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.204102 (+2271198us) service_pool.cc:224] Handling call
0709 12:17:24.228990 (+ 24888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:24.229227 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.229251 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:24.229863 (+   612us) log.cc:844] Serialized 26 byte log entry
0709 12:17:24.475077 (+245214us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:24.475124 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.475200 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.475254 (+    54us) raft_consensus.cc:1685] finished
0709 12:17:24.475267 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.475411 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":199460,"threads_started":1,"wal-append.queue_time_us":148586}
I20260709 12:17:24.496707 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1696) took 2946 ms. Trace:
I20260709 12:17:24.497170 23920 rpcz_store.cc:276] 0709 12:17:21.550192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.550415 (+   223us) service_pool.cc:224] Handling call
0709 12:17:21.550815 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:21.692090 (+141275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:21.692124 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:21.692172 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:21.692201 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.496430 (+2804229us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400179b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:24.496484 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.496632 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324489472}
W20260709 12:17:24.498409 23991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 1667) took 3322 ms (client timeout 2192 ms). Trace:
W20260709 12:17:24.498842 23991 rpcz_store.cc:269] 0709 12:17:21.175749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.573213 (+397464us) service_pool.cc:224] Handling call
0709 12:17:24.498178 (+2924965us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400310e54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:24.498336 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2464756480}
I20260709 12:17:24.515606 23816 catalog_manager.cc:5697] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 1 to 3, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 3 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:24.528374 23916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1770) took 2467 ms (client timeout 1812 ms). Trace:
W20260709 12:17:24.528873 23916 rpcz_store.cc:269] 0709 12:17:22.061323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.528117 (+2466794us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:24.528281 (+   164us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:24.542208 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1778) took 1919 ms. Trace:
I20260709 12:17:24.543004 23914 rpcz_store.cc:276] 0709 12:17:22.622341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.115012 (+492671us) service_pool.cc:224] Handling call
0709 12:17:23.152387 (+ 37375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:24.200433 (+1048046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.201612 (+  1179us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:24.202096 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:17:24.538908 (+336812us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:24.539243 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.541869 (+  2626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.541963 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.542006 (+    43us) raft_consensus.cc:1685] finished
0709 12:17:24.542018 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.542146 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1137,"raft.queue_time_us":48430,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":16492,"thread_start_us":1351340,"threads_started":2,"wal-append.queue_time_us":167446}
I20260709 12:17:24.545389 26093 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:24.551198 26100 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:24.555857 24034 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.557257 26093 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:24.557662 26093 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.557993 26093 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:24.559266 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:24.560104 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37704 (request call id 764) took 1623 ms (client timeout 1812 ms). Trace:
W20260709 12:17:24.560487 24599 rpcz_store.cc:269] 0709 12:17:22.936448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.937896 (+  1448us) service_pool.cc:224] Handling call
0709 12:17:24.559143 (+1621247us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2deee 000000000036eb39 00007f75c5ba11e0 00007f75c5c6a0c4 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:24.560044 (+   901us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11903232}
I20260709 12:17:24.566497 26093 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:24.568856 26071 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.577602 26071 consensus_queue.cc:1243] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer 0829ddf18f07439086398756b9c6d216 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:24.577725 26093 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.578137 26071 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:24.578524 26071 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:24.579226 26071 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.579612 23917 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:24.580235 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1702) took 2678 ms. Trace:
I20260709 12:17:24.580274 26071 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.580674 23917 rpcz_store.cc:276] 0709 12:17:21.902368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.579016 (+2676648us) service_pool.cc:224] Handling call
0709 12:17:24.579307 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.579999 (+   692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.580182 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:24.574551 26134 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:24.584323 26134 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.586551 26134 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.575280 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.590842 24064 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:24.575934 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.577116 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1780) took 1934 ms. Trace:
I20260709 12:17:24.591939 24068 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:24.592031 23921 rpcz_store.cc:276] 0709 12:17:22.642501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.169141 (+526640us) service_pool.cc:224] Handling call
0709 12:17:24.576427 (+1407286us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:24.576629 (+   202us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.576801 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:24.576828 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.576868 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:24.576902 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.576957 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.577063 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4215680}
W20260709 12:17:24.593541 23962 connection.cc:256] RPC call timeout handler was delayed by -1.5415526889999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2096s for a response
W20260709 12:17:24.594127 23962 connection.cc:256] RPC call timeout handler was delayed by -1.5343526889998884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
W20260709 12:17:24.595649 23962 connection.cc:256] RPC call timeout handler was delayed by -1.4495902080000178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 12:17:24.596513 23962 connection.cc:256] RPC call timeout handler was delayed by -1.2178786440001659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16510000000000002s for a response
W20260709 12:17:24.596861 23962 connection.cc:256] RPC call timeout handler was delayed by -1.2042089190001661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:17:24.597182 23962 connection.cc:256] RPC call timeout handler was delayed by -1.1048902079999152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1932s for a response
W20260709 12:17:24.597462 23962 connection.cc:256] RPC call timeout handler was delayed by -1.1016089190000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1781s for a response
W20260709 12:17:24.598244 23962 connection.cc:256] RPC call timeout handler was delayed by -1.0769902080000975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 12:17:24.599285 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.599879 24070 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:24.604027 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.604630 24062 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:24.606848 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.615528 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.615492 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.616389 24070 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:24.616662 25841 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:24.617307 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.617208 25841 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.617522 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.617934 24070 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:24.618224 23921 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:24.618801 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:24.619246 25841 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:24.616254 24062 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:24.619482 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.622833 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.622077 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.621598 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.624405 23914 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.619495 24070 raft_consensus.cc:2368] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9.
I20260709 12:17:24.621176 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.626053 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.622474 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.626629 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.626868 23919 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.627597 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.628189 24070 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:24.628845 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.629323 24070 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:24.631716 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.632537 23921 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.636344 25824 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:24.638751 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.640869 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.641665 24062 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:24.643151 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.644191 24062 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:24.644555 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.645161 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.648556 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.654021 23916 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:24.648937 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.655808 23920 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:24.645279 23912 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.659983 23914 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:24.668279 26134 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:24.669030 26134 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:24.671446 26134 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:24.671798 23920 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:24.673323 23921 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:24.668260 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.660212 23919 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:24.676844 25824 consensus_queue.cc:1059] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:24.677274 26049 consensus_queue.cc:1059] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:24.678308 26049 raft_consensus.cc:3055] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:24.678718 26049 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:24.679095 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.679610 26049 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.680994 26049 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.679777 24064 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:24.683046 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.683735 24064 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:24.684087 24069 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:24.684625 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.685222 24064 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:24.686074 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:24.686506 23912 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:24.686652 24064 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.687829 25841 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:24.688725 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 358539us
I20260709 12:17:24.689127 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.689679 23919 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:24.694639 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.695304 23914 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.698684 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.698211 23816 catalog_manager.cc:5697] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 3 to 5, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 5 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:24.700030 23816 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 2 to 4, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 4 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
W20260709 12:17:24.702303 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54480.5us
I20260709 12:17:24.705724 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.710544 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 353) took 1899 ms. Trace:
W20260709 12:17:24.710899 23962 leader_election.cc:336] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.536s (SENT)
I20260709 12:17:24.710950 24066 rpcz_store.cc:276] 0709 12:17:22.811217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.890947 (+ 79730us) service_pool.cc:224] Handling call
0709 12:17:24.710339 (+1819392us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b540010fc54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:24.710487 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103506688}
I20260709 12:17:24.711524 23962 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:24.712399 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:24.713523 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.718331 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.714599 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.721577 23914 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:24.723738 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.723909 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.724402 23916 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:24.724758 23920 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:24.728677 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.729581 23921 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:24.730647 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.732254 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.732810 23916 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:24.734020 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.735494 23916 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:24.737296 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1731) took 2841 ms. Trace:
I20260709 12:17:24.738634 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.738415 24069 rpcz_store.cc:276] 0709 12:17:21.896320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.896467 (+   147us) service_pool.cc:224] Handling call
0709 12:17:21.896742 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:24.684560 (+2787818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.736119 (+ 51559us) spinlock_profiling.cc:243] Waited 2.79 s on lock 0x7b54002d3054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:24.737231 (+  1112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6409657600}
I20260709 12:17:24.700003 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.740666 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.740984 24062 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:24.741302 23914 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:24.740381 23916 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:24.744094 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.744267 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.744843 24066 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:24.744962 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.745687 23912 raft_consensus.cc:2368] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:24.745616 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.746238 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.746928 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.747684 23912 raft_consensus.cc:2393] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:24.748813 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.749452 23912 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:24.750303 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.751129 23916 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:24.754164 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:24.754578 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:24.746234 24066 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:24.755302 23916 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:24.774032 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:24.771801 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 82435.6us
I20260709 12:17:24.774863 23912 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:24.775414 23961 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:24.754844 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:24.776961 24062 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:24.779994 24036 connection.cc:256] RPC call timeout handler was delayed by -1.9587007390000508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17400000000000002s for a response
W20260709 12:17:24.780541 24036 connection.cc:256] RPC call timeout handler was delayed by -1.9128007389999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1791s for a response
W20260709 12:17:24.780947 24036 connection.cc:256] RPC call timeout handler was delayed by -1.8030007390000264s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19130000000000003s for a response
I20260709 12:17:24.770056 24064 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
W20260709 12:17:24.781364 24036 connection.cc:256] RPC call timeout handler was delayed by -1.606800739000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21309999999999998s for a response
W20260709 12:17:24.781824 24036 connection.cc:256] RPC call timeout handler was delayed by -1.1316007390000777s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26589999999999997s for a response
W20260709 12:17:24.782207 24036 connection.cc:256] RPC call timeout handler was delayed by -1.1269363490000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
I20260709 12:17:24.783082 24036 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:24.784521 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:24.785539 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:24.787358 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:24.791832 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.791987 24064 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:24.795281 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.795889 26097 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:24.796782 26097 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:24.797220 26097 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:24.797689 26097 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.798390 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.799391 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.799532 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.800206 24069 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:24.801271 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.802243 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.804355 24034 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.805856 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.806591 25832 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:24.807034 25832 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:24.807078 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.808337 25832 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.811641 23912 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:17:24.813318 24068 raft_consensus.cc:2410] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:24.809607 25832 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.819916 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.820185 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.825834 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:24.828859 24062 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:24.828513 26071 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:24.839049 26071 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:24.839442 26071 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:24.842592 26134 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:24.843024 26134 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:24.843433 26134 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.849803 24034 leader_election.cc:400] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:24.850180 24034 leader_election.cc:403] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:24.850873 24064 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
W20260709 12:17:24.854445 24061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 1737) took 2866 ms (client timeout 2116 ms). Trace:
W20260709 12:17:24.854858 24061 rpcz_store.cc:269] 0709 12:17:21.988022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.988416 (+   394us) service_pool.cc:224] Handling call
0709 12:17:24.854183 (+2865767us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b540010ed54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:24.854382 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5105334016}
I20260709 12:17:24.855616 26149 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:24.857544 26149 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:24.857805 26152 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.858412 26152 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:24.858625 23886 leader_election.cc:336] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.508s (SENT)
I20260709 12:17:24.859337 26097 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.859827 26151 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:24.862005 26097 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.862598 26097 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:24.862948 26097 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:24.863327 26097 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:24.859848 24036 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:24.858853 26152 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.865969 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:24.849022 26071 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.868578 26071 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.869580 26071 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.864331 26151 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:24.870936 26071 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:24.871323 26151 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:24.871448 26071 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.874027 26042 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:24.874444 26042 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:24.874804 26042 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:24.858991 26149 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:24.897837 26134 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.898346 26042 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.898897 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:24.899665 23921 raft_consensus.cc:2368] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3.
I20260709 12:17:24.900137 26134 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.901110 26097 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.903402 26097 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:24.904073 26097 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.904402 26097 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:24.904788 26097 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:24.900357 26042 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:24.914127 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 64455.8us
I20260709 12:17:24.916504 26042 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:24.916870 26042 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:24.917269 26042 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:24.925638 23987 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 1674) took 3747 ms (client timeout 1967 ms). Trace:
W20260709 12:17:24.926101 23987 rpcz_store.cc:269] 0709 12:17:21.178148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.319617 (+141469us) service_pool.cc:224] Handling call
0709 12:17:24.925430 (+3605813us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002aadd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:24.925567 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2765725952}
I20260709 12:17:24.913501 26149 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:24.936151 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.937994 24034 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:24.940071 25919 consensus_queue.cc:1059] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:24.933732 26152 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:24.943225 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:24.945371 26152 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:24.933882 26134 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:24.946596 26134 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:24.947077 26134 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:24.947189 23915 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1772) took 2877 ms (client timeout 1913 ms). Trace:
W20260709 12:17:24.947669 23915 rpcz_store.cc:269] 0709 12:17:22.070131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.946966 (+2876835us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:24.947101 (+   135us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:24.952210 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.952800 24065 raft_consensus.cc:2376] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6. Re-sending same reply.
I20260709 12:17:24.953022 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.941958 25919 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.954056 25919 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:24.954048 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.954850 25919 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.955950 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.957401 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.958904 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.960202 24034 leader_election.cc:400] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3.
I20260709 12:17:24.960784 24034 leader_election.cc:403] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
W20260709 12:17:24.961077 23918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.008s	sys 0.040s
W20260709 12:17:24.961513 23918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.008s	sys 0.040s
I20260709 12:17:24.963243 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:24.963933 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.964380 24070 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:24.964591 24064 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:24.965524 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.966257 24065 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:24.966187 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 255292us
I20260709 12:17:24.966871 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.963027 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1785) took 2295 ms. Trace:
I20260709 12:17:24.967343 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.968184 24064 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:24.967396 23918 rpcz_store.cc:276] 0709 12:17:22.667780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.214794 (+547014us) service_pool.cc:224] Handling call
0709 12:17:23.215174 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:23.215397 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:23.215430 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:23.993971 (+778541us) log.cc:844] Serialized 26 byte log entry
0709 12:17:24.961939 (+967968us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:24.961997 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.962090 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:24.962165 (+    75us) raft_consensus.cc:1685] finished
0709 12:17:24.962182 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.962972 (+   790us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":792998,"threads_started":1,"wal-append.queue_time_us":248757}
I20260709 12:17:24.969444 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:24.969610 25658 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:24.969790 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:24.967283 23962 leader_election.cc:336] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.576s (SENT)
I20260709 12:17:24.970157 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:24.970935 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 252798us
W20260709 12:17:24.971572 23962 leader_election.cc:336] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.667s (SENT)
I20260709 12:17:24.972012 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:24.973016 23960 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:24.973848 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 198493us
I20260709 12:17:24.974005 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:24.974511 26147 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:24.974911 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:24.975682 23960 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:24.976119 26147 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:24.946111 26152 raft_consensus.cc:3055] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:24.977067 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:24.977131 26152 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:24.977278 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:24.977922 26101 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:24.978391 26101 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:24.979266 26101 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:24.981535 26093 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:24.976773 26147 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:24.982527 26144 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:24.982713 26147 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:24.983135 26144 raft_consensus.cc:697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:24.983246 26147 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:24.984048 26144 consensus_queue.cc:237] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.985006 25919 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.986537 26098 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:24.987008 26098 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:24.987151 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:24.987864 26098 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:24.988420 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:24.990140 25618 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:24.990658 25618 raft_consensus.cc:697] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:24.991496 25618 consensus_queue.cc:237] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.976449 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:24.995721 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:24.996517 23992 raft_consensus.cc:2410] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:24.997279 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:24.997845 23995 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
W20260709 12:17:24.973340 23962 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.781s (SENT)
I20260709 12:17:24.986852 26152 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:24.982025 26093 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:24.997987 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.120555 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.040000 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:25.124053 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 150719us
I20260709 12:17:25.092370 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.124339 23917 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.126363 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.127096 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.127488 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.030260 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:25.026180 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.006747 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.124408 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.129937 23992 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:25.026101 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.026504 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.029253 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:25.131212 23921 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:25.108250 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.132251 23912 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:25.002503 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.136703 23916 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:25.086259 24564 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:25.131114 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.139325 23991 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
W20260709 12:17:25.139899 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 273977us
I20260709 12:17:25.139708 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.140857 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:25.022419 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 46035.2us
I20260709 12:17:25.124557 23914 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.148892 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:25.149121 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.032894 25981 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:25.088742 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.156780 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:25.157955 23962 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:25.159912 23917 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
W20260709 12:17:25.155474 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.160480 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.089720 26104 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3.
I20260709 12:17:25.169510 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:25.031231 25919 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:25.089407 23913 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:17:25.034834 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:25.171885 23993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 1660) took 4015 ms (client timeout 2115 ms). Trace:
I20260709 12:17:25.155791 26046 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:25.172258 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:25.041034 24597 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 525) took 3835 ms (client timeout 1936 ms). Trace:
I20260709 12:17:25.176463 24068 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:25.179096 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.171343 23912 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
W20260709 12:17:25.177163 23993 rpcz_store.cc:269] 0709 12:17:21.156275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.156386 (+   111us) service_pool.cc:224] Handling call
0709 12:17:25.171714 (+4015328us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b5400310454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:25.171819 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489954688}
I20260709 12:17:25.180181 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:25.180703 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.181365 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:25.181692 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.172101 25981 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:25.182175 23993 raft_consensus.cc:2376] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2. Re-sending same reply.
I20260709 12:17:25.167475 25832 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:25.032388 26134 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.183175 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.022089 26097 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.174907 26101 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:25.173597 26082 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.176919 23913 pending_rounds.cc:85] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 2
I20260709 12:17:25.180150 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.214928 23993 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.177740 26149 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:25.217592 23916 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:25.182192 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:25.176673 26152 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.222874 23921 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
W20260709 12:17:25.226220 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 46150.3us
I20260709 12:17:25.227312 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:25.178216 26071 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.210651 26104 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:25.223305 23913 pending_rounds.cc:107] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:25.229750 26082 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:25.230312 23914 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:25.210247 26000 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:25.231578 24068 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:25.238041 24065 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:17:25.195119 24597 rpcz_store.cc:269] 0709 12:17:21.205982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.217030 (+ 11048us) service_pool.cc:224] Handling call
0709 12:17:25.040759 (+3823729us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b5400585554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:25.040941 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2705836288}
I20260709 12:17:25.241153 24061 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:25.242630 26071 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:25.243374 26042 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.183174 25981 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.233734 23913 raft_consensus.cc:2889] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:25.251341 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 533) took 3414 ms. Trace:
I20260709 12:17:25.255594 23993 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:25.223397 26128 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:25.268127 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 135926us
I20260709 12:17:25.270239 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:25.271024 26071 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:25.271100 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:25.271733 26071 raft_consensus.cc:697] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:25.272006 26149 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:25.272521 26149 raft_consensus.cc:697] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:25.231705 26104 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:25.274470 24065 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:25.273885 24034 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:25.275040 26149 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.287120 24065 pending_rounds.cc:85] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 2
I20260709 12:17:25.287401 24065 pending_rounds.cc:107] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:25.287650 24065 raft_consensus.cc:2889] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:25.264043 24598 rpcz_store.cc:276] 0709 12:17:21.837227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:21.837396 (+   169us) service_pool.cc:224] Handling call
0709 12:17:21.837700 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:21.837899 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:22.619525 (+781626us) log.cc:844] Serialized 14 byte log entry
0709 12:17:22.927716 (+308191us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.643704 (+1715988us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b18002a3ac0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdadfc0a 00007f75c721f219 00007f75c4b2658f 00007f75bdb65571 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd
0709 12:17:25.250994 (+607290us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:25.251048 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:25.251093 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:25.251158 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:25.251259 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2324132,"prepare.queue_time_us":77280,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":25268,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":8903,"spinlock_wait_cycles":12237568,"thread_start_us":339610,"threads_started":3,"wal-append.queue_time_us":346019,"wal-append.run_cpu_time_us":12444,"wal-append.run_wall_time_us":2193665}
W20260709 12:17:25.288208 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 147416us
I20260709 12:17:25.289016 24065 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.247380 25928 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:25.234375 26151 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.286396 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.275049 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.319628 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.323828 23993 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:25.320024 26042 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:25.290448 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:25.343616 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 53262.9us
I20260709 12:17:25.331809 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:25.324733 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.226090 26093 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:25.272734 26071 consensus_queue.cc:237] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.344285 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:25.348723 23993 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:25.349846 23993 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:25.351445 23917 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:25.308422 26104 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:25.365135 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.321282 25928 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.368650 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.322021 26095 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:25.367880 23993 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:25.377039 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.377863 23993 raft_consensus.cc:2393] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 2: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:25.363472 26157 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:25.364292 25787 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:25.402925 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.374433 25928 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.448822 23993 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:25.456293 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.458791 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.459811 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.460486 23993 raft_consensus.cc:2368] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:25.367722 26096 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:17:25.462809 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.455267 25918 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:25.469046 25918 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.469501 26151 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:25.464299 25787 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:25.471045 25787 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.507458 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.455565 26095 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:25.539939 26095 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.540558 23915 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:25.541182 23920 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:25.378041 26147 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.538993 25918 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:25.541182 23918 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:25.489635 25928 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.536761 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:25.465587 26161 log.cc:927] Time spent T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:17:25.461189 26157 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:25.553368 23988 raft_consensus.cc:2393] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:25.493000 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.555979 23918 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:25.559316 23913 raft_consensus.cc:1240] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:25.559826 24069 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:25.562067 23916 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:25.557619 25918 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:17:25.564947 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:25.572921 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 400298us
I20260709 12:17:25.555945 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.574712 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.575412 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.553782 26144 consensus_queue.cc:1059] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:17:25.564798 25954 consensus_queue.cc:1059] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:17:25.579716 26147 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:25.580978 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.582724 23991 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:17:25.583350 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:25.583562 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.584533 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.585019 23991 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.585832 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:25.586515 24036 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.587633 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.588187 23993 raft_consensus.cc:2368] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:25.588536 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:25.558645 25618 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:17:25.591636 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.593101 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.593365 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.594107 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.594625 23993 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.564059 26098 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:17:25.596165 24036 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.596921 25954 raft_consensus.cc:3055] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:25.597328 25919 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:25.597265 26144 raft_consensus.cc:3055] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:25.634737 26144 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:25.635757 26144 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.637367 26144 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:25.592730 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.643841 23989 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:25.646788 26134 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:25.597309 26168 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:25.648097 26168 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.648445 26168 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.650434 25787 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.651561 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:25.655388 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:25.655751 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.656652 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:25.657743 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.658622 24594 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:25.660265 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.598349 26151 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.664275 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.599005 26157 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.604938 26024 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:25.666666 26024 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.668977 26024 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:25.606235 26034 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:25.606954 26025 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:25.607491 25928 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:25.607584 26039 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:25.674618 26025 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.675086 23993 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:25.612993 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.619095 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:25.676666 26025 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:25.676991 24592 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.619834 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:25.677670 24600 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.676671 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.678802 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.624527 23962 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:25.591107 26096 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:25.627418 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.628971 26147 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:25.629179 26104 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.621218 25954 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:25.630046 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:25.630537 24621 debug-util.cc:398] Leaking SignalData structure 0x7b080028f5e0 after lost signal to thread 22723
I20260709 12:17:25.630884 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.633894 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.671368 23991 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:25.695508 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.680385 26096 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:25.682338 26147 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:25.609376 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.675009 26039 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.624536 24036 leader_election.cc:400] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4.
I20260709 12:17:25.679862 23993 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
W20260709 12:17:25.684034 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 59555.1us
I20260709 12:17:25.697582 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:25.698086 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73760.8us
I20260709 12:17:25.698622 23962 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:25.699272 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.661238 24594 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:25.696628 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.679009 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.689448 24600 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:25.699868 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:25.700477 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:25.680541 26034 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.700778 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.773720 23988 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:25.751048 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:25.752085 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:25.776985 23991 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:25.751561 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:25.777640 23988 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:25.780670 26152 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:25.728215 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.782366 24599 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
W20260709 12:17:25.783111 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 83315.5us
I20260709 12:17:25.702260 23993 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:25.776367 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 75660.1us
I20260709 12:17:25.738063 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:25.786718 23962 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:25.786139 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.792287 24036 leader_election.cc:400] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
W20260709 12:17:25.792390 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 54521.6us
I20260709 12:17:25.793193 24036 leader_election.cc:403] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:17:25.723958 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800259f80 after lost signal to thread 23853
W20260709 12:17:25.734244 26176 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:17:25.702018 25919 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:25.697243 26096 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.800637 24598 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:25.704223 25981 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:25.702157 26147 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.696671 24596 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:25.722671 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:25.802651 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:25.804131 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:25.793493 26152 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:25.801975 26149 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:25.730578 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.804764 24592 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:25.821228 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.804495 26034 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:25.781564 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.791615 26047 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:25.732390 24591 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:25.799304 25865 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:25.780700 26039 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:25.716966 26177 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:25.821174 23991 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:17:25.805296 24036 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:25.717592 25954 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.832108 26168 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.833094 26104 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:25.834841 26151 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:25.848786 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:25.850574 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 63974.5us
I20260709 12:17:25.861538 23962 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:25.858099 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 52865.1us
W20260709 12:17:25.843264 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08001f5fa0 after lost signal to thread 23945
I20260709 12:17:25.825107 26047 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:25.863127 23962 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:25.862881 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:25.865549 24036 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.865805 24597 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:25.861034 24593 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:25.866369 26047 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:25.837990 23989 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:25.847380 25865 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:25.875818 25865 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.875952 26047 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.878803 25954 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:25.878990 26047 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:25.878741 24600 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEARNER]: Advancing to term 6
W20260709 12:17:25.882177 23961 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.561s (SENT) [suppressed 73 similar messages]
I20260709 12:17:25.884378 25787 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:25.888101 26168 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:25.863950 26158 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.857403 25618 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.860594 26157 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:25.890426 26151 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:25.891019 26151 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:25.891593 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:25.892669 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:25.893357 26104 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:25.894023 26104 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:25.894379 26104 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.894723 26104 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.894815 24070 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:25.896198 26157 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:25.897493 23914 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:25.834991 26147 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.899389 25981 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:25.899806 25981 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.900146 26147 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:25.857409 26177 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:25.900926 26177 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:25.901352 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.901970 23913 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:25.902354 24595 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:25.902925 23995 raft_consensus.cc:2368] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
W20260709 12:17:25.903162 26179 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 12:17:25.864004 24621 debug-util.cc:398] Leaking SignalData structure 0x7b080028ece0 after lost signal to thread 23946
I20260709 12:17:25.905920 23912 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:25.906473 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3e40 after lost signal to thread 24020
I20260709 12:17:25.892776 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:25.907042 24062 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:25.907558 25618 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.908545 25618 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:25.908869 25618 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:25.909780 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:25.909623 25618 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.891911 26151 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:25.910333 23921 raft_consensus.cc:2376] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5. Re-sending same reply.
I20260709 12:17:25.910905 23961 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:25.897087 26157 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.912608 24600 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:25.913524 23996 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:25.913705 24035 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:17:25.914649 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 51657.8us
I20260709 12:17:25.891824 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:25.881067 26096 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:25.899750 26158 consensus_queue.cc:1059] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:17:25.924783 25956 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:25.946237 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:25.931818 26134 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 12:17:25.950727 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08003c20a0 after lost signal to thread 24094
I20260709 12:17:25.951129 26100 consensus_queue.cc:1059] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:25.951301 26152 consensus_queue.cc:1059] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:25.951817 26096 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:25.955714 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:25.971290 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:25.957391 25865 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:25.958954 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:25.975091 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:25.967197 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08003c21a0 after lost signal to thread 24095
W20260709 12:17:25.964296 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 50662.9us
I20260709 12:17:25.964386 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:25.921133 26147 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.962695 23990 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 2.
I20260709 12:17:25.978122 23995 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:25.978073 24035 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:25.967881 26168 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:25.967622 25618 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:25.982977 24035 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:25.985491 26128 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:25.967077 26095 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 12:17:26.003109 24063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 343) took 3194 ms (client timeout 1624 ms). Trace:
W20260709 12:17:26.003628 24063 rpcz_store.cc:269] 0709 12:17:22.808302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.808403 (+   101us) service_pool.cc:224] Handling call
0709 12:17:26.002847 (+3194444us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54000703d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:26.003025 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652372352}
I20260709 12:17:25.968721 25928 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 12:17:25.987433 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800324be0 after lost signal to thread 24566
I20260709 12:17:26.009759 23913 raft_consensus.cc:2410] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:25.971951 26091 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:17:25.977631 24594 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:25.975021 26103 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:17:25.998880 26100 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:26.016655 26157 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:26.028513 26157 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.029107 26157 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.030923 26144 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.033190 25981 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.034511 26144 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:26.037607 26103 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:26.038082 26103 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:26.039083 26103 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.040176 26157 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.040529 26103 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.028448 26100 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:17:26.047518 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 76323.8us
I20260709 12:17:25.968793 26047 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:17:26.052706 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:26.051153 26064 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.049105 26100 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:26.054756 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 3.03684e+06us
I20260709 12:17:26.054628 26064 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.055514 24566 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.057114 24566 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:26.057523 26064 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:26.059379 26185 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:26.059815 26185 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:26.060209 26185 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.064834 26177 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.065738 26025 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:26.066205 26025 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.066577 26025 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:26.067801 26149 raft_consensus.cc:3055] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:26.068296 26149 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:26.069195 26149 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:26.070092 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 983820us
I20260709 12:17:26.070363 26104 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.071219 24564 leader_election.cc:400] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:26.072067 24564 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.072477 26104 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:26.073550 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
W20260709 12:17:26.074047 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08003880a0 after lost signal to thread 24624
I20260709 12:17:26.074481 26053 raft_consensus.cc:2764] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:17:26.075841 26052 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.076545 26052 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:26.076871 26052 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:26.077196 26052 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.048545 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:26.080158 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.007580 26168 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:17:26.045548 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 113164us
I20260709 12:17:26.081626 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.093813 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.094844 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:26.097630 24036 leader_election.cc:400] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:26.098049 24036 leader_election.cc:403] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:26.099692 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.106038 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:26.110858 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:26.111617 23990 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.092823 26091 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:26.113837 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.092749 25928 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:26.093163 26195 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.119874 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.104046 26104 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:26.121078 24598 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:26.104825 26000 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:26.124269 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 159996us
I20260709 12:17:26.115011 26149 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.132617 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:26.115201 26128 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:26.139201 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.116387 26093 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:26.126363 26203 log.cc:927] Time spent T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 12:17:26.141022 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 176636us
I20260709 12:17:26.126044 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:26.133607 25928 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.166415 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.133739 26104 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:26.175753 24598 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:26.139880 25981 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:26.186627 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:26.187251 23995 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.141891 26093 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:26.139853 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.180109 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.180739 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.182257 24597 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:26.183053 26097 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:26.145159 26024 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.114012 26193 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.145408 26147 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.223759 24598 raft_consensus.cc:2368] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6.
I20260709 12:17:26.228768 23995 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
W20260709 12:17:26.231777 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 100106us
I20260709 12:17:26.203629 23990 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:26.195372 26093 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:26.239078 23991 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:26.240217 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:26.240957 23992 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 2: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:26.229792 26177 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:26.236583 26029 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:17:26.244738 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:26.244221 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:26.246080 23991 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:26.238981 26025 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.247866 23996 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:26.249421 26025 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:26.252117 24599 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:17:26.255856 26199 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:26.256032 26096 raft_consensus.cc:3055] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:26.256524 26096 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:26.257378 26096 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.258628 26096 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.259589 26104 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.262818 26157 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:26.166294 26168 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.242616 23987 raft_consensus.cc:2393] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:26.308887 26052 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:26.310518 26197 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:17:26.312772 26100 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:26.316903 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 48244.7us
W20260709 12:17:26.317971 24566 connection.cc:256] RPC call timeout handler was delayed by -2.1986975429997528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3026s for a response
W20260709 12:17:26.318528 24566 connection.cc:256] RPC call timeout handler was delayed by -1.8594127970000045s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 12:17:26.318933 24566 connection.cc:256] RPC call timeout handler was delayed by -1.8522127969999929s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 12:17:26.319859 24566 connection.cc:256] RPC call timeout handler was delayed by -1.7775127969998721s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
I20260709 12:17:26.314869 26100 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:26.321332 26185 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.323349 26185 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:26.320221 24566 connection.cc:256] RPC call timeout handler was delayed by -1.695612796999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260709 12:17:26.324056 24566 connection.cc:256] RPC call timeout handler was delayed by -1.5111127969998961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 12:17:26.324394 24566 connection.cc:256] RPC call timeout handler was delayed by -1.2474127969999245s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22130000000000002s for a response
W20260709 12:17:26.326000 24566 connection.cc:256] RPC call timeout handler was delayed by -1.2348127969999041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
W20260709 12:17:26.326421 24566 connection.cc:256] RPC call timeout handler was delayed by -1.2285127969998939s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
I20260709 12:17:26.318573 24591 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:26.328730 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:26.315862 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:26.315907 26193 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
W20260709 12:17:26.332690 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 215178us
W20260709 12:17:26.333202 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 327456us
I20260709 12:17:26.337461 24035 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:26.334458 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:26.338657 23887 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:26.332363 24566 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:26.340754 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:26.340838 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:26.341881 24566 leader_election.cc:400] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:26.342650 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.344252 26195 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:26.344666 26195 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:26.344929 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.345033 26195 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:26.345743 24597 raft_consensus.cc:2368] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4.
I20260709 12:17:26.339886 26103 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:26.346463 26206 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:26.347170 26206 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.332348 26096 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:26.350625 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.351397 24596 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:26.350709 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.351455 26052 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:26.355268 24592 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:17:26.358132 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.345155 25865 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:26.319768 26147 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:26.358382 23961 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:26.362526 23920 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:26.364682 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.367256 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.369554 24595 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:26.359335 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:26.371683 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.378629 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.379009 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:26.379211 24062 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:26.380832 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:26.381245 24596 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:26.381974 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.383288 23990 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:26.384285 26151 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:26.384531 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:26.384794 26151 raft_consensus.cc:697] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:26.385255 23989 raft_consensus.cc:2393] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:26.385617 26151 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.386452 26213 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:26.371116 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.372593 26167 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:26.397739 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.373800 26025 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:26.440522 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49081.2us
I20260709 12:17:26.374799 26100 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:26.363830 26168 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:26.376355 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.442411 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.443353 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:26.444932 24067 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:26.376410 26053 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:26.447235 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49604.7us
I20260709 12:17:26.350576 26096 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.453538 24069 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:26.438990 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.461464 23989 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:26.339834 26193 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 12:17:26.389678 26209 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:26.379773 26177 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:26.380182 26103 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:26.501240 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:26.441819 26052 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 12:17:26.506774 23886 leader_election.cc:336] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.582s (SENT)
W20260709 12:17:26.527719 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.451465 26097 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:26.529592 23916 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:26.531613 23917 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:26.520362 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.452294 26168 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:26.381019 26093 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.463265 26053 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:26.449757 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.534530 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.524573 26177 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:26.533262 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.390924 26147 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.537155 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:26.536422 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 95175.2us
I20260709 12:17:26.495258 26000 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:26.545856 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.545890 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:26.486042 26100 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.537667 26168 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.556979 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.529312 26091 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.560053 24070 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:26.526408 26149 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:17:26.540778 26209 raft_consensus.cc:697] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:26.543365 26177 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.561460 26218 consensus_queue.cc:1059] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:17:26.563862 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.555270 26201 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:26.574419 26103 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.575578 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.576327 26093 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:26.543665 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.579064 26204 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:26.581756 24597 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:26.583518 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.543860 26053 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.584244 24598 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:26.589804 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 72093.5us
I20260709 12:17:26.635005 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.635347 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.590677 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:26.595118 26215 log.cc:927] Time spent T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:17:26.572027 26098 raft_consensus.cc:3055] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:26.640367 24063 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:26.553440 26210 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 12:17:26.566496 26096 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:26.638839 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.640271 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.641130 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.641692 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.646849 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.647397 24068 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:26.648486 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.632895 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.649566 24595 raft_consensus.cc:2368] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4.
I20260709 12:17:26.642815 24062 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:26.649861 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.650858 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.651656 24062 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:26.652580 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.653352 24069 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:26.654353 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.655025 24069 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:26.655970 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.656659 24069 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:26.659000 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:26.588485 26091 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:26.662938 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 222603us
I20260709 12:17:26.668210 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.662022 24592 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:26.645483 26098 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:26.646792 26157 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:26.672425 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.633579 26195 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.686801 26209 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.639194 26204 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.694389 26034 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.690755 26098 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.694813 26034 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:26.695070 26098 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.695232 26034 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:26.696756 26214 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:26.708282 26195 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:26.687014 26225 consensus_queue.cc:1059] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:17:26.709578 26225 raft_consensus.cc:3055] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:26.709678 26204 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:26.709987 26225 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:26.710918 26225 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.712383 26225 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:26.712863 26216 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.169s	user 0.003s	sys 0.000s
W20260709 12:17:26.746289 23886 leader_election.cc:336] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.638s (SENT)
I20260709 12:17:26.747761 23886 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:26.747630 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:26.583550 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:26.755312 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:26.756739 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:26.757293 23921 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:26.746709 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 200774us
I20260709 12:17:26.760195 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:26.761190 23987 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:26.762382 23960 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:26.642716 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:26.644680 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:26.643275 24066 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:26.679010 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.771693 23919 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:26.774123 26219 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.781019 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.782006 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.852730 24591 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:26.803135 26195 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:26.798821 25865 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:26.804605 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 136411us
I20260709 12:17:26.806519 26152 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:26.771631 26047 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:26.798638 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:26.811546 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 61247.1us
I20260709 12:17:26.817348 24063 raft_consensus.cc:2376] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5. Re-sending same reply.
I20260709 12:17:26.782027 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.823318 26100 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:26.840901 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.841147 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:26.690816 25938 consensus_queue.cc:1059] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 12:17:26.843273 23915 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:26.874102 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.859306 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.859522 26053 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:26.863479 26233 log.cc:927] Time spent T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
W20260709 12:17:26.865166 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 103073us
I20260709 12:17:26.867725 26147 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:26.868247 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 53099.5us
I20260709 12:17:26.869585 23918 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:26.870057 26158 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:17:26.870393 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:26.870860 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.871837 26185 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:26.879791 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.881963 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.877871 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:26.892690 24069 raft_consensus.cc:2393] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:26.892468 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:26.772182 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.909945 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:26.910647 23886 leader_election.cc:336] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.708s (SENT)
I20260709 12:17:26.911248 24068 raft_consensus.cc:2410] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:26.898746 24592 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
I20260709 12:17:26.912444 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:26.912531 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.913691 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:26.916015 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:26.917024 24591 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:26.917809 26029 raft_consensus.cc:3055] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:26.918419 26152 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.921057 26152 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:26.922334 24600 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:26.922813 24061 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:26.923897 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:26.924470 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.924882 24061 raft_consensus.cc:2393] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:26.931427 26021 raft_consensus.cc:3055] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:26.931915 26021 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:26.932001 26185 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:26.932546 26185 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:26.933166 26091 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:26.933755 26053 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:26.934684 25865 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:26.936582 25865 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:26.937680 24095 heartbeater.cc:646] Failed to heartbeat to 127.22.48.62:36189 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.48.62:36189 timed out after 15.000s (SENT)
I20260709 12:17:26.932029 26158 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:26.938926 26158 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:26.918236 26029 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:26.942229 26029 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:26.945488 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:26.947006 26234 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.116s	user 0.000s	sys 0.002s
I20260709 12:17:26.947062 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:26.951293 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:26.948474 23917 raft_consensus.cc:2393] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:26.944370 24069 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:26.910825 23916 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.911245 23886 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:26.924800 24598 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:26.926051 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:26.954048 24598 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:26.960979 24598 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:26.962467 24069 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:26.963542 24061 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:26.965027 24061 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:17:26.966198 26239 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:17:26.965227 26198 raft_consensus.cc:1064] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:17:26.969273 26029 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.933621 26185 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.972738 24598 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:26.940462 26158 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:26.978089 26158 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:26.978758 24070 raft_consensus.cc:2393] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 3: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:26.980432 23912 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:26.981549 26196 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:26.982007 23962 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:26.983335 24063 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:26.983561 26196 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:26.984215 23989 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:26.984846 24063 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:26.985065 23920 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:26.964409 24069 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:26.991081 24070 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:26.972949 26185 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:26.999193 24068 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
W20260709 12:17:27.000257 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 103628us
W20260709 12:17:27.001084 23886 leader_election.cc:336] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.757s (SENT)
I20260709 12:17:27.002565 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:27.007138 24596 raft_consensus.cc:3055] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:27.007611 24596 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:26.933267 26021 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.005914 26219 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.018738 26195 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.019912 23886 leader_election.cc:336] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.764s (SENT)
I20260709 12:17:27.027583 23886 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:27.032925 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:27.035116 24061 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:27.039469 24598 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:27.012308 26091 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.007225 26034 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.052040 24069 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.047408 24596 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.061946 24064 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:27.051427 26219 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.028944 26195 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.075042 24065 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:27.076726 24065 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:27.078547 26231 consensus_queue.cc:1059] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
W20260709 12:17:27.079761 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54692.5us
W20260709 12:17:27.080569 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.081956 26210 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.083796 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:27.086974 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 78989.2us
I20260709 12:17:27.087893 23916 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:27.089123 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:27.090651 26202 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.092135 23996 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:27.093353 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:27.095638 26195 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:27.095927 24597 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:27.099924 26034 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:27.101238 23992 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:17:27.101567 23992 pending_rounds.cc:85] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 6
I20260709 12:17:27.101787 23992 pending_rounds.cc:107] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 12:17:27.104185 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.102133 23992 raft_consensus.cc:2917] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 12:17:27.106437 23992 raft_consensus.cc:2889] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:27.106649 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.108215 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.065549 26053 consensus_queue.cc:1059] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:17:27.037909 26198 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.114516 26231 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:27.114885 24600 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:27.114643 23921 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:27.115640 24600 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:27.117009 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.117941 23912 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:27.118111 24064 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:27.119302 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 109980us
W20260709 12:17:27.120028 23886 leader_election.cc:336] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.814s (SENT)
I20260709 12:17:27.120287 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.121084 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.120491 23886 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:27.122323 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.122181 26209 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.123027 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.123690 26210 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.124617 26209 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:27.124884 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:27.126050 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.126812 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:27.128741 23886 leader_election.cc:336] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.967s (SENT)
I20260709 12:17:27.168666 23886 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.169579 26195 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:27.169977 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.171509 26168 consensus_meta.cc:287] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.568s	user 0.010s	sys 0.005s
I20260709 12:17:27.172093 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:27.172151 26168 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:27.129420 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.173956 24067 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:27.131531 24596 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.131913 23817 catalog_manager.cc:5697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 4 to 7, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 7 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.178447 23817 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:27.138123 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:27.133888 23991 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:27.181591 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:27.182369 24591 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:27.183158 23991 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:17:27.183851 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45837.9us
I20260709 12:17:27.134604 23993 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:27.184684 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:27.184808 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.134743 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:27.185899 26202 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:27.186256 23962 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:27.186424 26202 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:27.186936 26202 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.187111 26047 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.186841 23991 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:27.190599 23987 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:27.191489 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:27.192296 24591 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:27.193612 23886 leader_election.cc:336] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 2.062s (SENT)
I20260709 12:17:27.140174 24594 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
W20260709 12:17:27.146667 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 72214.3us
I20260709 12:17:27.148988 26098 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.114979 26231 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:27.152199 26149 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:27.198911 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.197532 24594 pending_rounds.cc:85] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 4
I20260709 12:17:27.200275 24594 pending_rounds.cc:107] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:17:27.200313 23915 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:27.200626 24594 raft_consensus.cc:2889] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:27.153299 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.153738 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.201773 23917 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:27.201996 23915 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.202955 23917 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:27.202755 26231 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.154006 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.154556 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:27.204785 23913 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:27.154920 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.155424 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.156723 23994 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:27.156800 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.208294 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:27.210788 23918 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:27.212682 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:27.213191 26202 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.213766 23918 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:27.215267 23996 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:27.116693 24600 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.217079 24600 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:27.220491 26195 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:27.222239 26210 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:27.222693 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:27.222700 26210 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:27.224061 24598 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:27.224145 26210 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.226621 26168 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:27.165959 26147 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:17:27.166733 23816 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39310 (request call id 311) took 15525 ms (client timeout 15000 ms). Trace:
I20260709 12:17:27.072223 26219 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.230309 26219 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:27.201910 23912 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:27.204084 26231 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:27.227715 23816 rpcz_store.cc:269] 0709 12:17:11.641265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:11.641440 (+   175us) service_pool.cc:224] Handling call
0709 12:17:27.166414 (+15524974us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:24.831068 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:24.831636 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:24.831673 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:17:24.831690 (+    17us) tablet.cc:662] Decoding operations
0709 12:17:24.846627 (+ 14937us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:24.848961 (+  2334us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:24.850294 (+  1333us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:17:24.863362 (+ 13068us) tablet.cc:701] Row locks acquired
0709 12:17:24.863387 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:17:24.863545 (+   158us) write_op.cc:270] Start()
0709 12:17:24.863670 (+   125us) write_op.cc:276] Timestamp: P: 1783599444863494 usec, L: 0
0709 12:17:24.863695 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:17:24.865016 (+  1321us) log.cc:844] Serialized 1299 byte log entry
0709 12:17:25.089146 (+224130us) op_driver.cc:464] REPLICATION: finished
0709 12:17:25.151298 (+ 62152us) write_op.cc:301] APPLY: starting
0709 12:17:25.151358 (+    60us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:25.151455 (+    97us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:25.151560 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:25.151972 (+   412us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:25.152098 (+   126us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:17:25.152124 (+    26us) write_op.cc:312] APPLY: finished
0709 12:17:25.152265 (+   141us) log.cc:844] Serialized 35 byte log entry
0709 12:17:25.154455 (+  2190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:25.154556 (+   101us) write_op.cc:454] Released schema lock
0709 12:17:25.154595 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:25.154919 (+   324us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:25.154943 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":461635,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":61939,"apply.run_cpu_time_us":1652,"apply.run_wall_time_us":3614,"num_ops":3,"prepare.queue_time_us":127144,"prepare.run_cpu_time_us":13625,"prepare.run_wall_time_us":79808,"raft.queue_time_us":163380,"raft.run_cpu_time_us":16926,"raft.run_wall_time_us":62197,"replication_time_us":225315,"thread_start_us":256834,"threads_started":4,"wal-append.queue_time_us":50369,"wal-append.run_cpu_time_us":30572,"wal-append.run_wall_time_us":1250888}]]}
I20260709 12:17:27.139389 26021 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:27.240530 26177 consensus_meta.cc:287] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.603s	user 0.012s	sys 0.005s
I20260709 12:17:27.241228 26177 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.242759 23990 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.247685 26210 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:27.247581 23817 catalog_manager.cc:5697] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 2, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.249661 23886 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:27.250707 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 63188us
I20260709 12:17:27.259202 24596 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:27.261059 24600 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:27.271529 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:27.288683 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.290093 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:27.291541 26167 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:17:27.291481 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 99067.9us
I20260709 12:17:27.300467 26100 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.301242 26100 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:27.298039 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 104492us
I20260709 12:17:27.321768 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.333120 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:27.304520 26195 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:27.335402 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.338555 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 154062us
I20260709 12:17:27.303702 26100 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:27.269279 26147 consensus_queue.cc:1059] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:17:27.321441 26219 raft_consensus.cc:2764] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:17:27.346165 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.347225 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:27.350572 26071 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.351449 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:27.351197 26071 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.355612 23996 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.299880 26149 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:17:27.331068 26177 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:27.335402 26167 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.371496 24065 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:27.349710 26209 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:17:27.375972 23886 leader_election.cc:336] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 2.093s (SENT)
W20260709 12:17:27.379177 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 110584us
I20260709 12:17:27.380146 24066 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:27.344719 26168 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:17:27.367030 24591 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:17:27.391256 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 102282us
I20260709 12:17:27.346958 26158 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:17:27.397059 23992 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 2: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:27.378896 26100 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:27.396347 23817 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 4, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 4 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:27.377092 26231 consensus_queue.cc:1059] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:17:27.407677 23817 catalog_manager.cc:5697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 3, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 3 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:27.405637 26223 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.404743 24597 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:17:27.442340 26134 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:17:27.394026 26198 consensus_queue.cc:1059] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
W20260709 12:17:27.444386 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 76253.6us
I20260709 12:17:27.445215 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.445706 26219 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:27.403795 26071 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:27.434122 26019 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:27.434887 26226 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:17:27.392514 26177 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
W20260709 12:17:27.442965 26248 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.146s	user 0.004s	sys 0.004s
I20260709 12:17:27.453722 23992 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:27.449921 24597 pending_rounds.cc:85] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 6
I20260709 12:17:27.412784 26236 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 12:17:27.449128 26144 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:27.465708 24597 pending_rounds.cc:107] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 6.7
I20260709 12:17:27.469909 24597 raft_consensus.cc:2917] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Aborting config change with OpId 6.7: Aborted: Op aborted by new leader
I20260709 12:17:27.470178 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:27.470469 24597 raft_consensus.cc:2889] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:27.457962 26195 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.479578 26249 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:17:27.491075 26103 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.491148 26201 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:27.492683 26201 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.493079 26195 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.457967 26204 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
W20260709 12:17:27.496079 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 49082.6us
I20260709 12:17:27.495554 26201 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:27.499121 23886 leader_election.cc:336] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 2.125s (SENT)
I20260709 12:17:27.499697 23886 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:27.524531 26201 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:27.528621 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 83494.5us
W20260709 12:17:27.533627 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 135855us
I20260709 12:17:27.534396 26167 raft_consensus.cc:3055] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:27.534827 26167 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:27.535836 26167 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.536852 26209 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:27.537144 26167 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.538666 26236 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:27.539682 26134 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:27.539757 26226 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:27.540002 26236 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:27.540030 24036 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.543951 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:27.545336 26209 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.546690 26091 raft_consensus.cc:3055] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:27.547125 26091 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:27.547905 26209 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:27.548153 26091 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.551223 25865 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:27.551687 25865 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:27.552888 25865 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.551946 24067 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:27.554102 25865 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.551550 26091 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:27.609184 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 112230us
I20260709 12:17:27.597908 26177 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.623646 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 121550us
I20260709 12:17:27.614151 26261 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.623178 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 567) took 1105 ms. Trace:
I20260709 12:17:27.602231 26231 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
W20260709 12:17:27.631093 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.622130 26201 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:17:27.634868 23962 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:27.620802 26177 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.639422 26144 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:27.639940 26144 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.641259 26177 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:27.642185 26231 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:27.642843 26231 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.645124 26231 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:27.625970 26196 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.650408 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.627524 26195 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:27.661132 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.667227 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.667960 26226 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.671193 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:27.673074 26254 log.cc:927] Time spent T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:17:27.645627 26231 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:27.626188 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:27.679363 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 53394.8us
W20260709 12:17:27.706094 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.629763 24593 rpcz_store.cc:276] 0709 12:17:26.393453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.923024 (+529571us) service_pool.cc:224] Handling call
0709 12:17:27.003268 (+ 80244us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2de9c 00007f75bdb2da5b 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:27.003452 (+   184us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.003934 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.003970 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.004645 (+   675us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.270051 (+265406us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:27.347478 (+ 77427us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:27.456930 (+109452us) log.cc:844] Serialized 14 byte log entry
0709 12:17:27.457196 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.457296 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:27.488949 (+ 31653us) raft_consensus.cc:1685] finished
0709 12:17:27.488967 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.498560 (+  9593us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":315346,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":3994,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":3592,"spinlock_wait_cycles":156898688,"thread_start_us":414129,"threads_started":2,"wal-append.queue_time_us":292058}
I20260709 12:17:27.719235 26029 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:27.720059 26029 raft_consensus.cc:697] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:27.721302 26029 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.676889 26261 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.725133 26261 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:27.739562 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:27.740196 26202 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:27.748502 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:27.749346 24598 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:27.700757 26231 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:27.683809 26196 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:27.823612 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 63079.2us
I20260709 12:17:27.824069 24596 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:17:27.827126 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 178548us
W20260709 12:17:27.762041 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 127254us
I20260709 12:17:27.728108 26147 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:27.702351 26177 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
W20260709 12:17:27.855959 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.844468 26210 consensus_meta.cc:287] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.596s	user 0.013s	sys 0.000s
I20260709 12:17:27.868233 26185 raft_consensus.cc:3055] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:27.868721 26185 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:27.846148 26134 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:17:27.751129 26195 consensus_queue.cc:1059] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260709 12:17:27.822613 23989 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:27.745980 26226 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:27.886816 24597 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:27.852628 26168 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
W20260709 12:17:27.878813 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 51944.5us
I20260709 12:17:27.904713 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:27.869683 26185 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.874395 26236 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.878374 23962 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:27.878705 26100 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.911001 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:27.893342 25865 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:27.929731 24598 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:27.927704 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:27.949023 23920 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:27.932793 23961 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:27.914745 26021 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:27.958048 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 213848us
I20260709 12:17:27.962646 26021 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.927014 26198 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:27.972575 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:27.905983 26152 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
W20260709 12:17:27.973097 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 113573us
I20260709 12:17:27.947243 26185 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:27.908650 26071 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:17:27.972373 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 97481.8us
I20260709 12:17:27.908327 26231 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.973268 26262 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:27.975422 26091 raft_consensus.cc:3055] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:27.992300 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 98326.7us
I20260709 12:17:27.972434 26047 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:27.980568 26134 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:27.929353 26236 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.973692 26226 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:27.972795 26201 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:28.012060 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.024701 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:27.977859 26204 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:17:27.974351 25865 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:27.975868 26100 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:27.993196 26021 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:27.994365 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.048067 26210 consensus_queue.cc:1059] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:28.055052 26267 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:27.998061 26091 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:28.004246 26262 raft_consensus.cc:697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:27.990481 26198 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:28.062155 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 134519us
W20260709 12:17:28.084601 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60006.7us
I20260709 12:17:28.055250 26273 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:17:28.025818 26167 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:28.029685 26226 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.058063 26231 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.095615 23886 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:28.093525 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:28.086234 26149 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:28.090464 26270 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:17:28.109370 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 145341us
I20260709 12:17:28.089461 26152 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.093511 26226 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.115820 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:28.123482 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 190786us
I20260709 12:17:28.131114 24066 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:28.139761 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:28.142442 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 86371.2us
I20260709 12:17:28.129655 26226 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.151319 23960 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:28.098744 26201 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.158890 23919 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:28.154498 26275 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:17:28.159457 26198 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:28.143553 26147 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.167325 26103 raft_consensus.cc:3055] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:28.163311 26204 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:28.130362 26196 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:28.150138 26144 consensus_meta.cc:287] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.002s
I20260709 12:17:28.159816 23921 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:28.136386 26152 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:28.199954 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.199225 26144 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.170446 26201 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:28.182385 26103 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:28.225201 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 131946us
I20260709 12:17:28.172134 26276 consensus_queue.cc:1059] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:28.190758 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.200718 26198 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:28.197047 25865 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:28.198316 23915 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:28.200352 26195 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.200564 26098 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:28.185597 26147 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.332835 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:28.320461 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 246801us
I20260709 12:17:28.164075 26091 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:28.326761 26195 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:28.327690 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.327998 26100 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:28.349534 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 234845us
I20260709 12:17:28.260188 26204 raft_consensus.cc:697] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:28.312376 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:28.314849 26198 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:28.334161 26267 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:17:28.217914 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:28.352192 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 200933us
I20260709 12:17:28.362191 23886 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:28.362227 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.188223 26262 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:28.333746 26276 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.364390 23991 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:28.368407 26095 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:17:28.368963 26296 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:28.369083 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:28.369356 26274 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 12:17:28.369590 26256 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.707s	user 0.000s	sys 0.004s
W20260709 12:17:28.369913 26277 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:17:28.370394 26292 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:28.370998 26282 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:17:28.370528 26103 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:28.376001 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:28.378758 26280 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
W20260709 12:17:28.379105 26272 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.423s	user 0.004s	sys 0.000s
I20260709 12:17:28.379410 26204 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:28.380640 26283 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
I20260709 12:17:28.360656 26198 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.420413 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:28.358351 26100 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:28.365899 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:28.442534 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 615645us
I20260709 12:17:28.427645 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.428766 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:28.402307 26296 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:28.436748 26091 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:28.440152 24034 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:28.437467 23920 raft_consensus.cc:2393] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:28.403874 26276 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.457533 23991 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:28.459662 26100 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.461920 26100 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:28.444660 26134 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:17:28.445806 26071 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:17:28.477783 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.479216 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.479841 23915 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:28.480460 26144 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:28.480661 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.481323 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 804) took 1638 ms. Trace:
I20260709 12:17:28.467900 26047 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:28.469101 24564 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:28.459427 23991 raft_consensus.cc:1240] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:28.476248 26152 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:28.476332 26147 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:28.439040 23989 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:28.483727 23960 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:28.483204 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:28.480401 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.453545 26296 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:28.505425 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 122359us
I20260709 12:17:28.507576 26287 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:28.507663 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.508951 26306 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.509644 26308 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.481673 24599 rpcz_store.cc:276] 0709 12:17:26.836960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.962832 (+125872us) service_pool.cc:224] Handling call
0709 12:17:27.005791 (+ 42959us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:27.006068 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.006681 (+   613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.006709 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.007261 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.109126 (+101865us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b48000435d8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c5b7baa1 00007f75c5b72b37 00007f75c5b729ca 00007f75c5c6a26f 00007f75c5c69f37 00007f75c5c7e55c 00007f75c5c7e508 00007f75c5c7e488 00007f75c5c7e443 00007f75c5c7d6ec 00007f75c4ba7a96
0709 12:17:27.380522 (+271396us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:27.380578 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.380742 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.028609 (+647867us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:28.475196 (+446587us) raft_consensus.cc:1685] finished
0709 12:17:28.475226 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.475345 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25028,"raft.queue_time_us":1247,"raft.run_cpu_time_us":2032,"raft.run_wall_time_us":98764,"spinlock_wait_cycles":78385536,"thread_start_us":367687,"threads_started":1,"wal-append.queue_time_us":470965}
I20260709 12:17:28.485810 26288 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:28.513471 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:28.482232 23915 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:28.514796 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:28.515477 26134 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:28.517035 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:28.511180 26264 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.635s	user 0.004s	sys 0.003s
I20260709 12:17:28.513538 23916 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
W20260709 12:17:28.519768 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 166108us
I20260709 12:17:28.504731 26029 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:28.450155 26292 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.529809 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:28.538556 26299 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 12:17:28.540259 26302 log.cc:927] Time spent T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:17:28.541059 26149 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.545787 26309 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:17:28.548256 26297 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.548830 26297 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.518992 26095 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.527132 26152 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.557410 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:28.558653 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 89656.1us
I20260709 12:17:28.555670 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:28.523810 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.563439 23994 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:28.526911 26047 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:17:28.566951 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:28.556567 26152 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.567955 26298 raft_consensus.cc:3055] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:28.555507 26314 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.558585 26134 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:28.571952 24564 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:28.569952 26152 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.582095 26222 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:28.582712 26222 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:28.583338 26263 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.729s	user 0.000s	sys 0.007s
W20260709 12:17:28.583886 26303 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:17:28.584560 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 811) took 1291 ms. Trace:
I20260709 12:17:28.575412 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:28.559049 26287 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:28.518896 26306 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.569957 26304 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.584940 24600 rpcz_store.cc:276] 0709 12:17:27.293615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.299444 (+  5829us) service_pool.cc:224] Handling call
0709 12:17:27.348169 (+ 48725us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:27.348370 (+   201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.361468 (+ 13098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.361498 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.370779 (+  9281us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.532401 (+161622us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:27.532536 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.532684 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.572271 (+1039587us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:28.584340 (+ 12069us) raft_consensus.cc:1685] finished
0709 12:17:28.584361 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.584503 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":487,"raft.queue_time_us":13150,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":9703,"spinlock_wait_cycles":64476800,"thread_start_us":130240,"threads_started":1,"wal-append.queue_time_us":297451}
I20260709 12:17:28.559382 26288 consensus_queue.cc:1059] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:17:28.582588 26029 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.586481 26134 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.585084 26222 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:28.598778 26287 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.574858 26144 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:28.572628 26298 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:28.613541 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:28.599260 26286 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.410s	user 0.001s	sys 0.001s
I20260709 12:17:28.557293 26308 consensus_queue.cc:1059] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:17:28.563277 26095 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.549329 26147 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 3 to 7, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:28.617190 26134 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.643641 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1772) took 1253 ms. Trace:
I20260709 12:17:28.635048 23915 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:28.662669 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:28.667330 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 115482us
W20260709 12:17:28.667340 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 66660.1us
I20260709 12:17:28.645948 23912 rpcz_store.cc:276] 0709 12:17:27.386361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.386589 (+   228us) service_pool.cc:224] Handling call
0709 12:17:27.396854 (+ 10265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.400726 (+  3872us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.400755 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.418215 (+ 17460us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.620721 (+202506us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:27.700860 (+ 80139us) log.cc:844] Serialized 14 byte log entry
0709 12:17:27.880656 (+179796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.880728 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.510492 (+629764us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:28.636658 (+126166us) raft_consensus.cc:1685] finished
0709 12:17:28.639421 (+  2763us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.639524 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":238114,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":56381,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":67971,"spinlock_wait_cycles":29972352,"thread_start_us":417060,"threads_started":3,"wal-append.queue_time_us":300930}
I20260709 12:17:28.646248 26144 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:28.671293 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:28.647791 26288 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.598138 26314 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:28.679625 26313 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260709 12:17:28.683449 26311 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:17:28.687584 26095 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:28.688649 26292 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:28.692823 26231 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.693490 26231 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:28.694495 26298 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:28.695336 26287 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:28.695938 26298 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.696139 26231 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:28.669867 26029 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.699842 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.700700 23996 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:28.679809 26276 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:28.665535 26324 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:28.705902 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:28.707933 24036 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:28.710906 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 64874.3us
W20260709 12:17:28.705062 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.721905 26144 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.721899 26314 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:28.703423 26198 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.725381 26321 raft_consensus.cc:3055] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:28.725943 26321 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:28.727044 26321 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:28.728641 26321 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:28.730862 26308 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:28.731197 26306 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:28.731361 26308 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.731927 26308 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:28.732167 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 63753us
I20260709 12:17:28.733148 23886 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:28.734486 26219 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:28.734926 26309 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:28.740134 26261 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.740725 26261 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:28.741603 26316 log.cc:927] Time spent T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 12:17:28.742820 26210 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.038s	sys 0.036s
I20260709 12:17:28.745224 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.744216 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.751470 23886 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:28.758014 26210 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.039s	sys 0.036s
W20260709 12:17:28.765878 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.706875 26315 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.767521 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.769389 24564 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:28.771065 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.771873 23994 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:28.774802 23991 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:28.775843 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:28.758898 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 87663.1us
I20260709 12:17:28.720185 26324 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.765522 26261 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:28.777645 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:28.778577 26134 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:28.779277 26290 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.428s	user 0.002s	sys 0.000s
I20260709 12:17:28.779371 26210 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:28.781560 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.776573 23996 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:28.786571 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.754669 26209 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:28.767714 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.786723 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.789232 23914 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:28.783601 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.791657 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.792119 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.792374 23987 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:28.792752 23989 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:28.795135 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.796073 23992 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:28.796352 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.796882 26308 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.797680 26198 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:28.800434 26328 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:17:28.800607 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.768978 26258 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:28.802557 26258 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.787920 26278 consensus_queue.cc:1059] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:17:28.774528 26291 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:28.812166 23991 raft_consensus.cc:2393] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:28.814617 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 50336.1us
I20260709 12:17:28.781101 26306 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.775146 26029 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEARNER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:28.820286 23991 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:28.817842 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.821913 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.784307 26307 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:28.823139 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.823794 23912 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:28.785034 26324 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:28.806208 26315 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.833060 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:28.833959 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:28.804931 26276 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.836355 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:28.618328 24591 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:28.836874 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:28.845342 26276 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.851267 26276 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:28.851642 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.852522 26308 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:28.830680 26306 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.855018 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:28.856261 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:28.856449 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:28.856871 24070 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:28.857832 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:28.857980 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:28.858382 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:28.856472 26269 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.853s	user 0.004s	sys 0.000s
I20260709 12:17:28.861199 26291 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:28.843605 26258 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:28.876372 26152 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:28.890151 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 69705.4us
I20260709 12:17:28.915405 24067 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:28.866572 26209 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.847432 26231 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:28.823380 26198 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:28.921226 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:28.922924 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 75689.3us
I20260709 12:17:28.924604 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:28.924671 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:28.925343 26029 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:28.844678 26315 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:28.973721 23993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1864) took 1365 ms. Trace:
W20260709 12:17:28.927510 26226 consensus_meta.cc:287] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.750s	user 0.005s	sys 0.009s
I20260709 12:17:28.931150 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:28.979835 24061 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:28.921850 26222 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:28.980865 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 125910us
I20260709 12:17:28.926494 26231 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.928308 26100 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:28.987282 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 70582.9us
I20260709 12:17:28.985447 24036 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:28.930112 26098 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.987196 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:28.992933 24070 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:28.929984 26310 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.994138 24564 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:28.979302 26287 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.975821 23993 rpcz_store.cc:276] 0709 12:17:27.608225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.608485 (+   260us) service_pool.cc:224] Handling call
0709 12:17:27.616860 (+  8375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.632547 (+ 15687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.632578 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.636373 (+  3795us) log.cc:844] Serialized 26 byte log entry
0709 12:17:27.758322 (+121949us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:27.758360 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.758623 (+   263us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.856174 (+1097551us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b24002a8858. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bd9eb9c4 00007f75bd9e9acb 00007f75bdba4dc9 00007f75bdba4a55 00007f75bdba409d 00007f75c07d610e 00007f75c07ed88c 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221
0709 12:17:28.973390 (+117216us) raft_consensus.cc:1685] finished
0709 12:17:28.973411 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.973639 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12629,"raft.queue_time_us":14280,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":98662144,"thread_start_us":120168,"threads_started":1,"wal-append.queue_time_us":312619}
I20260709 12:17:28.927793 26296 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:28.989583 26222 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:28.987123 26231 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.010915 26307 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.991456 26100 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:28.975440 26029 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:28.930433 26209 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.994796 26134 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:28.974344 26198 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:28.994443 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 820) took 1122 ms. Trace:
W20260709 12:17:29.058578 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.984248 26226 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:29.063357 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 77980.3us
I20260709 12:17:29.023634 26222 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.076606 24036 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:29.061800 26100 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.058492 26307 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.059140 26201 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:29.083460 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:29.083406 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:29.085580 24036 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:29.065583 26306 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.022559 26324 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.069865 26195 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.092839 24066 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:29.013002 26098 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:29.097735 26327 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:17:29.099798 26209 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:29.063807 26287 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.100219 26103 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.103041 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:29.103504 26304 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:29.104457 26204 consensus_queue.cc:1059] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:29.105449 26338 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:29.106025 26338 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:29.106505 26338 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.103649 23913 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.105585 26324 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.103588 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:29.075337 26309 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:29.002595 26310 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.102051 26287 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:29.087818 26168 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.093470 26134 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:29.133700 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 43882.4us
I20260709 12:17:29.124930 26309 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.143905 26309 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.072520 24594 rpcz_store.cc:276] 0709 12:17:27.869069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.881367 (+ 12298us) service_pool.cc:224] Handling call
0709 12:17:27.955006 (+ 73639us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:28.001753 (+ 46747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:28.002911 (+  1158us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:28.047737 (+ 44826us) log.cc:844] Serialized 26 byte log entry
0709 12:17:28.137187 (+ 89450us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:28.145455 (+  8268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:28.152465 (+  7010us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:28.778567 (+626102us) spinlock_profiling.cc:243] Waited 1.82 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:28.931719 (+153152us) raft_consensus.cc:1685] finished
0709 12:17:28.958144 (+ 26425us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:28.991344 (+ 33200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6582,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6427,"spinlock_wait_cycles":4190080,"thread_start_us":65304,"threads_started":1,"wal-append.queue_time_us":163545}
I20260709 12:17:29.144246 26339 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:29.093897 26201 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.140794 26134 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.067984 26291 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:29.171267 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 190851us
I20260709 12:17:29.150498 26168 raft_consensus.cc:3055] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:29.162529 26047 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:29.186403 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 192376us
I20260709 12:17:29.164140 26134 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.145910 26276 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.193888 24070 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:29.195001 24062 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:29.184423 26168 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:29.207273 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:29.210963 24062 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:29.213678 26260 raft_consensus.cc:3055] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:29.214221 26339 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:29.217216 26152 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:29.224865 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:29.214102 26260 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:29.224481 26298 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.250320 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:29.254259 23919 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:29.249946 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:29.300658 24068 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:29.254031 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:29.302023 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 50403us
I20260709 12:17:29.303258 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.254956 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:29.304926 24062 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 2.
I20260709 12:17:29.305968 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:29.307135 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1856) took 1152 ms. Trace:
I20260709 12:17:29.196198 26047 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.307663 23919 rpcz_store.cc:276] 0709 12:17:28.147439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.173113 (+ 25674us) service_pool.cc:224] Handling call
0709 12:17:29.083315 (+910202us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:29.299412 (+216097us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6641536}
I20260709 12:17:29.272217 26285 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:29.275578 26293 log.cc:927] Time spent T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.916s	user 0.002s	sys 0.007s
W20260709 12:17:29.310667 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:29.256363 26335 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 12:17:29.262627 26340 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 12:17:29.246881 26226 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:29.209757 26296 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:29.322501 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.279218 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.267249 26276 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.249527 26029 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.315791 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:29.251426 26344 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:29.273276 26201 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.251870 23991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:29.325953 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.251575 26345 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.268128 26310 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.327531 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:29.301810 25865 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:29.309118 26304 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:17:29.327775 26288 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:17:29.336269 24593 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:29.254985 26307 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.271658 26098 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.344929 23991 raft_consensus.cc:606] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:29.346124 23919 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:29.260051 26231 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.315109 26285 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:29.349277 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:29.328586 26047 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.380903 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1863) took 1775 ms. Trace:
I20260709 12:17:29.318553 26258 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:17:29.325672 26351 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:29.324393 26298 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.373423 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:29.389083 23919 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:29.390029 26342 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:29.390431 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:29.390729 26342 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:29.382979 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.393184 26342 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:29.394469 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.350312 26168 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.381863 26201 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:29.395938 26201 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.386372 23988 rpcz_store.cc:276] 0709 12:17:27.605533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.605734 (+   201us) service_pool.cc:224] Handling call
0709 12:17:27.662987 (+ 57253us) spinlock_profiling.cc:243] Waited 1.68 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:27.663261 (+   274us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:27.874419 (+211158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:27.874452 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:27.903486 (+ 29034us) log.cc:844] Serialized 26 byte log entry
0709 12:17:28.110621 (+207135us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:28.110659 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:28.499122 (+388463us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400099054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:28.499177 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.274845 (+775668us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:29.380598 (+105753us) raft_consensus.cc:1685] finished
0709 12:17:29.380631 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.380822 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":364,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":28844,"spinlock_wait_cycles":542798848,"thread_start_us":139580,"threads_started":1,"wal-append.queue_time_us":273668}
I20260709 12:17:29.347746 26344 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.383389 26310 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.416306 26359 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.388911 26147 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:29.417347 26285 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.353629 25865 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.422147 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:29.400218 26201 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.424134 23920 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:29.470651 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1871) took 1010 ms. Trace:
I20260709 12:17:29.473176 26346 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:29.473794 26346 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.476086 26346 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:29.476657 26346 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.477159 26346 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.471257 23920 rpcz_store.cc:276] 0709 12:17:28.440865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.478853 (+ 37988us) service_pool.cc:224] Handling call
0709 12:17:29.422005 (+943152us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2deee 000000000036eb39 00007f75c5ba11e0 00007f75c5c6a0c4 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:29.451188 (+ 29183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9583488}
W20260709 12:17:29.482816 26289 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 1.108s	user 0.000s	sys 0.006s
I20260709 12:17:29.485317 26236 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:29.410698 26222 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:29.492161 26356 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:17:29.493791 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 167913us
W20260709 12:17:29.538949 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 342012us
I20260709 12:17:29.453845 26350 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:29.426306 26309 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.552547 26100 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.559417 24564 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.560350 23962 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.566485 26098 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.451040 26359 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.573042 26359 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:29.573997 26315 consensus_meta.cc:287] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.000s
W20260709 12:17:29.574417 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.583081 26298 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.583395 26226 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.588677 26226 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.557650 26350 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.590706 23913 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:29.585484 25865 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.585099 26134 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.586889 26338 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.587742 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:29.595383 23920 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:29.555467 26285 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.620787 24600 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:29.604174 26222 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:29.626724 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:29.612236 26359 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.628356 23991 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.592238 26350 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.632128 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.632804 24596 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
W20260709 12:17:29.639204 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 51519.2us
I20260709 12:17:29.642356 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.643507 23988 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:29.612111 26315 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.652709 23995 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:29.653038 26315 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.653791 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.654058 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.654546 23912 raft_consensus.cc:2393] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:29.655189 23987 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:17:29.656057 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:29.656471 26134 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.656586 23987 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.659441 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.648202 26222 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.663170 26222 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.665211 26222 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.665670 26222 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:29.665956 26338 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.667346 26100 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:29.669081 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:29.669682 26346 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.670449 23962 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.670735 25865 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:29.671090 25865 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.671401 25865 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:29.655054 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.625046 26363 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.678920 24598 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:29.653841 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:29.672269 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:29.674917 23995 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:29.681026 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.677878 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:29.670370 24564 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:29.644774 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 585) took 1094 ms. Trace:
I20260709 12:17:29.682709 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:29.681089 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.684361 26307 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.678972 26098 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.678568 26372 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.684708 26288 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:29.648916 26298 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.685595 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.645504 26236 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:29.688021 24034 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:29.683207 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:29.679821 26315 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:29.695448 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:29.696157 24593 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:29.704509 26202 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:29.704895 26202 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.705015 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1867) took 1265 ms. Trace:
I20260709 12:17:29.705262 26202 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.705363 23916 rpcz_store.cc:276] 0709 12:17:28.439361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.567796 (+128435us) service_pool.cc:224] Handling call
0709 12:17:28.569351 (+  1555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:28.701658 (+132307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:28.701690 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:28.702203 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:17:28.718026 (+ 15823us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:28.718077 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.704651 (+986574us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b54001f2554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:29.704696 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.704741 (+    45us) raft_consensus.cc:1685] finished
0709 12:17:29.704754 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.704959 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9157,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":4363,"spinlock_wait_cycles":303416064,"thread_start_us":15381,"threads_started":1,"wal-append.queue_time_us":15746}
I20260709 12:17:29.693722 26098 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.709998 26098 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.695971 26298 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.710417 26236 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.712369 26298 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.712493 26236 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.712705 26344 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.694459 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1875) took 1209 ms. Trace:
I20260709 12:17:29.691653 26365 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:29.697631 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1868) took 1258 ms. Trace:
I20260709 12:17:29.699260 26369 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:29.715795 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:29.717998 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:29.701193 26201 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:29.690371 26346 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:29.686650 26071 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:29.714134 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.715289 23960 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:29.719131 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.699864 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:29.713307 23914 rpcz_store.cc:276] 0709 12:17:28.485238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.482633 (+997395us) service_pool.cc:224] Handling call
0709 12:17:29.483155 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.486109 (+  2954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.486156 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.489240 (+  3084us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.559345 (+ 70105us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:29.559407 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.559500 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.694212 (+134712us) raft_consensus.cc:1685] finished
0709 12:17:29.694234 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.694400 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2128,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":101,"thread_start_us":69608,"threads_started":1,"wal-append.queue_time_us":139837}
I20260709 12:17:29.716858 23921 rpcz_store.cc:276] 0709 12:17:28.439762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.104761 (+664999us) service_pool.cc:224] Handling call
0709 12:17:29.105068 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.171311 (+ 66243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.171343 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.171391 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:29.171426 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.697424 (+525998us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b54002ecf54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:29.697467 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.697580 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151866112}
I20260709 12:17:29.690653 26100 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:17:29.677335 26222 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.740242 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:29.740912 23995 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.714604 26134 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:29.756726 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1876) took 1271 ms. Trace:
I20260709 12:17:29.757040 26134 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.757546 26134 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.757141 23920 rpcz_store.cc:276] 0709 12:17:28.485387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.482950 (+997563us) service_pool.cc:224] Handling call
0709 12:17:29.595109 (+112159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.614239 (+ 19130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.756539 (+142300us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001590d0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:29.756666 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257068416}
I20260709 12:17:29.760362 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:29.760730 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.760982 23918 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.723595 26369 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.743806 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:29.762316 23995 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:29.762596 23921 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:29.730780 26351 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:29.763276 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.763674 26351 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:29.763829 23995 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:29.746479 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.764571 26351 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:29.766475 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.726917 26342 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:29.767566 26342 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:29.767964 26342 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:29.769770 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 1794) took 1283 ms. Trace:
I20260709 12:17:29.770251 23915 rpcz_store.cc:276] 0709 12:17:28.486087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.523240 (+ 37153us) service_pool.cc:224] Handling call
0709 12:17:29.769567 (+1246327us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b540017af54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:29.769700 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140244352}
I20260709 12:17:29.772255 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1880) took 1082 ms. Trace:
I20260709 12:17:29.747370 26261 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:29.748068 26359 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.773048 26357 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:29.719972 26338 consensus_queue.cc:1059] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:17:29.749941 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.773447 26357 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:29.723351 26315 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.746665 26344 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:29.774859 26344 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:29.774331 26357 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.776041 26357 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:29.775890 26344 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.753089 26222 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.687748 24591 rpcz_store.cc:276] 0709 12:17:28.550797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.551477 (+   680us) service_pool.cc:224] Handling call
0709 12:17:28.575358 (+ 23881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.600754 (+ 25396us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:29.271558 (+670804us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.622125 (+350567us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.626184 (+  4059us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:29.628759 (+  2575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.644552 (+ 15793us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.644703 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48473,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":6322,"thread_start_us":298299,"threads_started":1}
I20260709 12:17:29.754204 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:29.750092 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1864) took 1311 ms. Trace:
W20260709 12:17:29.754984 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.720312 26365 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.764853 24594 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:29.779160 26365 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.721647 26098 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:29.778460 23914 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:29.780153 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.772673 23915 rpcz_store.cc:276] 0709 12:17:28.690193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.771304 (+1081111us) service_pool.cc:224] Handling call
0709 12:17:29.771676 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.771875 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.771910 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.771963 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:29.772004 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.772072 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.772193 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:29.755731 26366 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:29.788987 26292 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.789705 26292 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.784777 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1873) took 1300 ms. Trace:
I20260709 12:17:29.802636 26260 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:29.804070 26260 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:29.804219 23961 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:29.805166 26185 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:29.805558 26185 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.805866 24065 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:29.811851 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:29.812664 24062 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:29.764791 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.794961 23919 rpcz_store.cc:276] 0709 12:17:28.484766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.392706 (+907940us) service_pool.cc:224] Handling call
0709 12:17:29.393055 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.395970 (+  2915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.396014 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.396604 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.554595 (+157991us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:29.603464 (+ 48869us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.603694 (+   230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.603772 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.784497 (+180725us) raft_consensus.cc:1685] finished
0709 12:17:29.784537 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.784704 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38751,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":2474,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":3014,"thread_start_us":157359,"threads_started":1,"wal-append.queue_time_us":228338}
I20260709 12:17:29.805929 26185 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:29.817896 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 46860.2us
W20260709 12:17:29.820410 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 106351us
W20260709 12:17:29.821117 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.811205 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 1878) took 1041 ms. Trace:
I20260709 12:17:29.822295 23991 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:29.822084 23996 rpcz_store.cc:276] 0709 12:17:28.769291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.786360 (+ 17069us) service_pool.cc:224] Handling call
0709 12:17:29.793318 (+1006958us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b5400311354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:29.811107 (+ 17789us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383483776}
I20260709 12:17:29.818120 23914 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:29.827303 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.835353 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:29.833005 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:29.838665 23920 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:29.778685 23917 rpcz_store.cc:276] 0709 12:17:28.438614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.544119 (+105505us) service_pool.cc:224] Handling call
0709 12:17:28.544419 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:28.553798 (+  9379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:28.553829 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:28.568673 (+ 14844us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.749519 (+1180846us) spinlock_profiling.cc:243] Waited 7.86 ms on lock 0x7b54002b7da0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbc090 00007f75c0bc96b8 00007f75c0c5292b 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c
0709 12:17:29.749586 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:29.749638 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.749721 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:29.749785 (+    64us) raft_consensus.cc:1685] finished
0709 12:17:29.749798 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.750031 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8982,"raft.queue_time_us":29714,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":12955,"spinlock_wait_cycles":19316736,"thread_start_us":36047,"threads_started":1,"wal-append.queue_time_us":57258,"wal-append.run_cpu_time_us":2114,"wal-append.run_wall_time_us":1021690}
I20260709 12:17:29.824575 26287 raft_consensus.cc:1064] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:17:29.849436 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:29.857103 23996 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.821709 26359 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:29.850183 26292 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:29.856273 23917 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:29.859522 24564 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.851766 26309 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:29.851838 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:29.854485 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1795) took 1341 ms. Trace:
I20260709 12:17:29.888863 23913 rpcz_store.cc:276] 0709 12:17:28.512692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.591887 (+1079195us) service_pool.cc:224] Handling call
0709 12:17:29.592240 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.592473 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:29.694010 (+101537us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.837651 (+143641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:29.840518 (+  2867us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:29.845425 (+  4907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.854309 (+  8884us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:29.854430 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4703,"prepare.queue_time_us":23744,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":3015,"raft.queue_time_us":12891,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4947,"thread_start_us":182675,"threads_started":2}
W20260709 12:17:29.890401 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 61011.2us
I20260709 12:17:29.891260 24564 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.892339 24564 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:29.892705 23913 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:29.872179 26258 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:29.817674 26098 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:29.873734 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.873531 26359 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:29.854251 26231 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.874356 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.913906 24600 raft_consensus.cc:2393] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:29.875275 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.837200 26369 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.875618 26168 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:29.883463 23917 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:29.884138 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.927521 23990 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:29.886715 26315 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:29.888438 24594 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:29.897466 23920 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:29.898562 24598 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:29.872987 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.899801 23919 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:29.927578 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:29.947191 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:29.936045 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:29.936857 23918 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
W20260709 12:17:29.941794 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.949157 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:29.949849 23918 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.955736 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:29.912675 26285 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.948293 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:29.912312 26346 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:29.911787 26310 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:29.965073 23918 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:29.958076 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:29.918392 26345 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:29.969980 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:29.969564 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.005947 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:29.926888 26347 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:30.013325 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:30.014153 24598 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:30.015254 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:30.015856 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:30.008363 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 50366.3us
W20260709 12:17:29.979941 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.015990 24598 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.024171 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.010378 24061 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.029196 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:29.970610 26236 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:30.054729 24598 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:30.060577 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:30.009286 26091 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.027092 23915 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:29.954893 26258 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 12:17:30.077273 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1795) took 1208 ms. Trace:
I20260709 12:17:30.025380 26355 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:30.084012 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:30.063187 26236 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.082231 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1879) took 1481 ms. Trace:
I20260709 12:17:30.089608 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.018128 26285 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.037371 26347 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.061256 23987 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:30.093730 23921 rpcz_store.cc:276] 0709 12:17:28.600823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.763391 (+1162568us) service_pool.cc:224] Handling call
0709 12:17:29.763710 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.763919 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:29.764225 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 12:17:30.081098 (+316873us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:30.081171 (+    73us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:30.081237 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.081990 (+   753us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.082159 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2945,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":32,"raft.queue_time_us":7429,"thread_start_us":315455,"threads_started":1}
I20260709 12:17:30.105309 24035 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:30.028189 26310 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.081912 26355 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.077471 26345 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.101462 26369 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:30.111774 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.096647 26236 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:30.112481 24065 raft_consensus.cc:2393] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:30.112036 23917 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:30.099433 26204 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:30.072536 26091 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.101253 26350 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:30.108760 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:30.127530 24600 raft_consensus.cc:2410] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:30.105261 26333 raft_consensus.cc:2764] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:30.112340 26344 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:30.111716 26355 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.109417 26231 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.107650 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 829) took 1137 ms. Trace:
I20260709 12:17:30.157279 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:30.158572 26377 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:17:30.117937 26204 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:30.165431 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 147298us
W20260709 12:17:30.201898 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.108382 26202 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.165638 24061 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:30.155658 26098 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:30.208009 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.119328 26345 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.162667 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:30.212718 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.141513 26185 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.197774 26231 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.139564 25865 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.240764 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:30.155220 26344 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.125612 26369 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.206099 26204 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.253115 24598 raft_consensus.cc:2410] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:30.208459 26359 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.267578 23991 raft_consensus.cc:2368] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:30.269378 23988 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:30.235149 26382 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.247429 23987 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:30.263728 23996 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:30.253319 26344 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:30.223960 26339 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:17:30.264585 26098 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.283612 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.288254 26369 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.295116 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:30.296146 23996 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:30.297211 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:30.304598 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:30.305279 23996 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.307813 24594 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:30.309283 26091 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.296736 26291 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.309983 26231 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.310200 26291 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.311205 26393 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.311738 26393 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.312559 26291 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:30.313293 26202 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:30.313699 26393 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:30.296833 26098 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.278450 26382 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:30.326939 26134 consensus_meta.cc:287] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.000s
I20260709 12:17:30.327400 26134 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.328549 26382 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.329380 26285 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:30.284271 26347 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:30.300753 26345 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.209173 24592 rpcz_store.cc:276] 0709 12:17:28.969896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.974266 (+  4370us) service_pool.cc:224] Handling call
0709 12:17:28.997934 (+ 23668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.022448 (+ 24514us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:29.179494 (+157046us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.711015 (+531521us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b1800380b00. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb65522 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:17:29.780070 (+ 69055us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b1800380b00. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb62455 00007f75c0c4a060 00007f75c0c5c716 00007f75c0c6d287 00007f75c0c6d208
0709 12:17:30.088942 (+308872us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:30.093089 (+  4147us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:30.100520 (+  7431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.100619 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.105187 (+  4568us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":183440,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":111504,"spinlock_wait_cycles":63547520,"thread_start_us":405323,"threads_started":3,"wal-append.queue_time_us":159847}
I20260709 12:17:30.333494 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:30.303854 26384 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:30.334543 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.335673 26098 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.340827 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 824) took 1424 ms. Trace:
I20260709 12:17:30.334124 24592 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.341228 24597 rpcz_store.cc:276] 0709 12:17:28.915927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.925913 (+  9986us) service_pool.cc:224] Handling call
0709 12:17:29.781861 (+855948us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2deee 000000000036eb39 00007f75c5ba11e0 00007f75c5c6a0c4 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:29.782077 (+   216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.782638 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.782689 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.783309 (+   620us) log.cc:844] Serialized 26 byte log entry
0709 12:17:30.054402 (+271093us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:30.055957 (+  1555us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.070463 (+ 14506us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.340472 (+270009us) raft_consensus.cc:1685] finished
0709 12:17:30.340496 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.340762 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":7762816,"thread_start_us":234939,"threads_started":1,"wal-append.queue_time_us":418231}
I20260709 12:17:30.342729 26202 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.343327 26202 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.345744 26202 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:30.362236 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 446619us
I20260709 12:17:30.377424 24064 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:30.391307 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:30.392719 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:30.393152 26285 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:30.393951 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:30.395323 23921 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:30.395946 26346 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:30.395841 26344 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.396818 24596 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
W20260709 12:17:30.398231 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.392859 26260 consensus_meta.cc:287] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.588s	user 0.008s	sys 0.003s
I20260709 12:17:30.402860 23987 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
W20260709 12:17:30.407209 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.417883 26395 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:30.419212 23990 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:30.447508 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:30.456993 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:30.477255 23996 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:30.461826 24592 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:30.499991 23987 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:30.501142 25865 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:30.501266 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:30.457692 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.461112 26297 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.502223 24066 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:30.423573 26355 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.501621 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:30.503230 24062 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:30.503314 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:30.503471 23987 raft_consensus.cc:2393] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:30.504071 24066 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.505218 26355 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:30.499961 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 129162us
W20260709 12:17:30.499475 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 280359us
I20260709 12:17:30.499014 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:30.457335 26226 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:30.501878 23996 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:30.508304 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:30.444918 26357 consensus_meta.cc:287] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.001s
I20260709 12:17:30.511237 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:30.459486 26342 consensus_meta.cc:287] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.691s	user 0.014s	sys 0.001s
I20260709 12:17:30.513043 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:30.513239 26278 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:30.514925 24061 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:30.515792 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:30.512997 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:30.481808 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1799) took 1283 ms. Trace:
I20260709 12:17:30.523058 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:30.518299 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1798) took 1320 ms. Trace:
I20260709 12:17:30.410019 26236 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.508423 26372 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.513926 26390 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:30.509909 26310 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.517716 26278 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.511059 25865 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.531984 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:30.534222 23914 rpcz_store.cc:276] 0709 12:17:29.197569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.780884 (+583315us) service_pool.cc:224] Handling call
0709 12:17:29.781212 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.817997 (+ 36785us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:30.321799 (+503802us) log.cc:844] Serialized 14 byte log entry
0709 12:17:30.517865 (+196066us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:30.517933 (+    68us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:30.517997 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.518078 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.518213 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3593,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3071,"thread_start_us":192216,"threads_started":1,"wal-append.queue_time_us":207918}
I20260709 12:17:30.539898 24066 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:30.540812 26321 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:30.540931 26204 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.529084 24597 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:30.525293 26326 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:30.568694 26326 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:30.569792 26338 raft_consensus.cc:3055] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:30.569594 26326 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.570315 26338 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:30.571298 26338 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.572551 26338 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.572808 24065 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:30.573788 26204 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:30.574167 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.575130 24065 raft_consensus.cc:2393] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:30.575747 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.576123 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.544330 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:30.538661 26134 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:30.545908 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 1571) took 1295 ms. Trace:
I20260709 12:17:30.576071 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:30.586755 24064 rpcz_store.cc:276] 0709 12:17:29.250540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.311186 (+ 60646us) service_pool.cc:224] Handling call
0709 12:17:30.545694 (+1234508us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400071054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:30.545825 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198193408}
I20260709 12:17:30.546684 26236 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:30.589171 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.529036 26344 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:30.534408 23915 rpcz_store.cc:276] 0709 12:17:29.198598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.782034 (+583436us) service_pool.cc:224] Handling call
0709 12:17:29.957095 (+175061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.088787 (+131692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.481532 (+392745us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54002f1050. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:30.481729 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386355968}
I20260709 12:17:30.518625 26342 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.558944 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:30.557128 26390 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:30.554301 26198 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.567299 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "368f96220d5b4469885774acf06e4475"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:30.560119 25865 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.589136 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:30.590776 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:30.591300 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:30.599960 24064 raft_consensus.cc:2393] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:30.600168 24065 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:30.554917 26278 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:30.593951 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 49665.2us
I20260709 12:17:30.560778 26321 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:30.597209 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:30.602421 23919 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:30.597138 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:30.596182 24066 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:30.598366 23990 raft_consensus.cc:606] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:30.601536 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.605557 23990 raft_consensus.cc:614] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:30.608654 26396 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:17:30.609586 26342 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:30.610131 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.612112 23961 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:30.615855 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.614076 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:30.595177 26297 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.627863 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.628695 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.547232 26372 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.629338 24065 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:30.597012 26273 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:30.635741 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:30.636195 26314 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:30.636176 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.639098 26372 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.639456 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.640868 23921 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:30.641866 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:30.645087 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.646901 24064 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:30.645707 24065 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:30.649094 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.649747 24065 raft_consensus.cc:2368] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:30.653667 23919 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:30.655751 24066 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:30.627707 26342 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:30.623364 23989 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:30.656865 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:30.656764 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:30.660574 24065 raft_consensus.cc:2368] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:30.657120 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:30.654887 26365 consensus_meta.cc:287] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.869s	user 0.006s	sys 0.010s
I20260709 12:17:30.625397 26315 consensus_queue.cc:1059] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:30.661809 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:30.662269 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.665136 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.664121 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:30.666893 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:30.667639 24065 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.668540 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:30.668335 26321 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.669315 23990 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 3: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:30.669699 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.672919 23915 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:30.678637 26204 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:30.679174 26204 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:30.680040 26204 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.682596 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:30.682595 26390 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.683504 26400 raft_consensus.cc:2764] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:30.685324 24036 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:30.686038 26400 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:30.686501 26400 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:30.687350 26315 raft_consensus.cc:3055] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:30.687803 26315 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:30.687392 26400 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.688621 26315 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.689742 26315 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.690981 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:30.691938 26292 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:30.692088 25865 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:30.692463 26292 raft_consensus.cc:697] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:30.693344 26292 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.658265 26342 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:30.698846 24064 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:30.631060 26297 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.701608 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:30.698560 26342 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:30.726516 24065 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:30.728137 24600 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:30.731510 26297 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:30.728186 25865 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.665627 26365 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:30.769882 24068 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:30.802201 26047 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:30.802819 26047 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:30.803822 26047 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:30.805096 26047 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:30.821041 26378 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.663s	user 0.000s	sys 0.004s
I20260709 12:17:30.787210 25865 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.084583 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1894) took 1243 ms. Trace:
I20260709 12:17:31.024665 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1877) took 2468 ms. Trace:
W20260709 12:17:30.956688 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.078889 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 378852us
W20260709 12:17:31.085990 23912 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1882) took 2386 ms (client timeout 2359 ms). Trace:
W20260709 12:17:31.112701 23912 rpcz_store.cc:269] 0709 12:17:28.699460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.824533 (+125073us) service_pool.cc:224] Handling call
0709 12:17:31.085787 (+2261254us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54001e0354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:31.085901 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866195328}
I20260709 12:17:31.090397 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 1897) took 1195 ms. Trace:
W20260709 12:17:31.079795 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 465736us
I20260709 12:17:31.081189 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:31.023558 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.114001 23917 rpcz_store.cc:276] 0709 12:17:29.895249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.005616 (+110367us) service_pool.cc:224] Handling call
0709 12:17:31.090239 (+1084623us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b54003359d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:31.090345 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228086528}
I20260709 12:17:31.115542 23996 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:31.083878 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37708 (request call id 513) took 1016 ms. Trace:
I20260709 12:17:31.099052 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 841) took 1015 ms. Trace:
I20260709 12:17:30.079968 24069 rpcz_store.cc:276] 0709 12:17:28.856975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.916842 (+ 59867us) service_pool.cc:224] Handling call
0709 12:17:28.930468 (+ 13626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.930657 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:28.978102 (+ 47445us) log.cc:844] Serialized 14 byte log entry
0709 12:17:29.791844 (+813742us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b1800469f00. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f223a 00007f75c0c5ca2a
0709 12:17:30.064714 (+272870us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:30.064761 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:30.064801 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.064859 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:30.064963 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":559,"prepare.queue_time_us":47336,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":4539,"raft.queue_time_us":678,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":10927,"spinlock_wait_cycles":7354112,"thread_start_us":252186,"threads_started":1}
I20260709 12:17:31.116881 24600 rpcz_store.cc:276] 0709 12:17:30.083877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.700527 (+616650us) service_pool.cc:224] Handling call
0709 12:17:30.714987 (+ 14460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.762654 (+ 47667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.098972 (+336318us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:31.115545 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:31.116374 24598 rpcz_store.cc:276] 0709 12:17:30.067259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.108520 (+ 41261us) service_pool.cc:224] Handling call
0709 12:17:31.083685 (+975165us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54003ece54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:31.083822 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273326464}
I20260709 12:17:31.111188 23918 rpcz_store.cc:276] 0709 12:17:29.841694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.009558 (+167864us) service_pool.cc:224] Handling call
0709 12:17:30.009978 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.156195 (+146217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.156245 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:30.156311 (+    66us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:30.156361 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.084371 (+928010us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54001fd954. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:31.084418 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.084531 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335608192}
I20260709 12:17:31.079150 24065 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:31.122072 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.122255 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.123383 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 360) took 1089 ms. Trace:
I20260709 12:17:31.111227 23916 rpcz_store.cc:276] 0709 12:17:28.556397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.707169 (+1150772us) service_pool.cc:224] Handling call
0709 12:17:29.710704 (+  3535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:29.713460 (+  2756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:29.713499 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:29.721006 (+  7507us) log.cc:844] Serialized 26 byte log entry
0709 12:17:29.938110 (+217104us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:29.938152 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:30.806664 (+868512us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b5400223b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:30.806727 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:30.820337 (+ 13610us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:31.024371 (+204034us) raft_consensus.cc:1685] finished
0709 12:17:31.024402 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.024591 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3829,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":1382,"spinlock_wait_cycles":240729728,"thread_start_us":187157,"threads_started":1,"wal-append.queue_time_us":375459}
I20260709 12:17:31.123740 23995 rpcz_store.cc:276] 0709 12:17:30.038132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.121986 (+1083854us) service_pool.cc:224] Handling call
0709 12:17:31.123323 (+  1337us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:31.131862 24065 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:31.136397 24065 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:31.140627 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:31.143428 24036 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:31.148360 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:31.149379 23995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:31.149915 23995 raft_consensus.cc:606] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:31.150671 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:31.121428 26091 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.124393 26029 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.153258 23962 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:30.932870 26326 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.039506 26364 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:31.167320 26326 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.167506 26364 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.169544 26326 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:31.174662 26288 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:31.175207 26288 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.177238 26288 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.139129 26314 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:31.178256 26029 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.180425 26029 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:31.181147 26029 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.160205 26144 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:31.182636 26144 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:31.183001 26144 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:31.187911 26198 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:31.191102 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 358) took 1473 ms. Trace:
I20260709 12:17:31.191519 23988 rpcz_store.cc:276] 0709 12:17:29.717377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.717490 (+   113us) service_pool.cc:224] Handling call
0709 12:17:29.727293 (+  9803us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.273429 (+546136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.190883 (+917454us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540038a754. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:31.191048 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246208384}
I20260709 12:17:31.151629 23995 raft_consensus.cc:614] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:31.133092 26297 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.160568 26091 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.083519 26278 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.152305 26357 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:31.181670 26029 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.206494 23912 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:17:31.208117 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.210068 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.208142 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:31.211892 23917 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:31.215359 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:31.217895 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.219058 23962 leader_election.cc:400] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
W20260709 12:17:31.219637 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 59998.1us
I20260709 12:17:31.220302 23962 leader_election.cc:400] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:31.220508 23962 leader_election.cc:403] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:31.221371 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.223381 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:31.224694 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:31.225489 23919 raft_consensus.cc:2393] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:17:31.225489 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.226615 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:31.198211 26408 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.196353 26326 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.233304 23996 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:17:31.241957 23996 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:31.210903 26321 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.256824 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 361) took 1218 ms. Trace:
I20260709 12:17:31.229053 26315 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:31.231245 26047 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:31.245662 26411 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:17:31.246064 26326 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.223948 26314 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:31.244434 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:31.261073 25865 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:31.234861 26091 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:31.228861 26297 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:31.266175 26342 consensus_meta.cc:287] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.000s
I20260709 12:17:31.306702 26363 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.307495 26363 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.309520 26315 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:31.243480 26408 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.272364 26314 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.315012 26314 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:31.315701 26413 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:17:31.318218 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.324909 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:31.312505 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 68081.4us
I20260709 12:17:31.325742 24598 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:31.329089 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:31.267305 26321 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.339614 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 842) took 1226 ms. Trace:
I20260709 12:17:31.340180 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.347326 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.348013 24598 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:31.341187 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.343004 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.260654 23996 rpcz_store.cc:276] 0709 12:17:30.038605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.241216 (+1202611us) service_pool.cc:224] Handling call
0709 12:17:31.241622 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.256565 (+ 14943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.256767 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:31.310683 26315 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:31.339015 26420 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.346267 24599 rpcz_store.cc:276] 0709 12:17:30.113477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.814128 (+700651us) service_pool.cc:224] Handling call
0709 12:17:30.815308 (+  1180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.815562 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:31.203211 (+387649us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.339283 (+136072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.339334 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:31.339382 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.339448 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.339563 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":265026,"prepare.queue_time_us":342093,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"thread_start_us":240307,"threads_started":2}
I20260709 12:17:31.372527 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.373144 23996 raft_consensus.cc:2410] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:17:31.336661 23886 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 2.033s (SENT) [suppressed 7 similar messages]
I20260709 12:17:31.368497 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.313138 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 840) took 1360 ms. Trace:
I20260709 12:17:31.367146 23918 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:31.377647 23915 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:31.377673 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.379278 23918 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 1.
I20260709 12:17:31.310882 26342 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.380759 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.386554 23914 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:31.339418 26091 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.339588 26305 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.398999 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.382504 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.347801 26288 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.389360 26091 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.399803 24599 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:31.393496 23917 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:31.394673 26029 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.376665 24597 rpcz_store.cc:276] 0709 12:17:29.952884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.629545 (+676661us) service_pool.cc:224] Handling call
0709 12:17:30.664075 (+ 34530us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.705358 (+ 41283us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:31.080380 (+375022us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.267574 (+187194us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.270050 (+  2476us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:31.274139 (+  4089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.300776 (+ 26637us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.311679 (+ 10903us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":344113,"prepare.queue_time_us":363501,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":3424,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":3987,"thread_start_us":179350,"threads_started":1,"wal-append.queue_time_us":245425}
I20260709 12:17:31.400920 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.402773 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:31.370441 26315 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.404671 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:31.423058 24065 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:31.414664 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:31.417201 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1908) took 1478 ms. Trace:
I20260709 12:17:31.424260 23988 rpcz_store.cc:276] 0709 12:17:29.939134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.198305 (+1259171us) service_pool.cc:224] Handling call
0709 12:17:31.216737 (+ 18432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.216905 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:31.282759 (+ 65854us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.416801 (+134042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.416861 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:31.416918 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.417002 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.417137 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1121,"thread_start_us":162580,"threads_started":2}
I20260709 12:17:31.411360 26285 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:31.409578 26427 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.409677 26305 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.440747 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:31.441578 24069 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:17:31.443656 26416 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:17:31.420869 26198 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.443499 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:31.448019 23988 raft_consensus.cc:2393] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:31.380569 26420 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.414702 26288 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:31.450922 26410 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:17:31.489552 24564 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:31.455955 24062 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:31.487798 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:31.492995 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 90293.3us
I20260709 12:17:31.492005 23988 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:31.494961 23996 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:31.495631 24564 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
W20260709 12:17:31.500425 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 95431.5us
I20260709 12:17:31.504142 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:31.504568 23988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:31.505427 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:31.494231 26419 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:31.448927 26427 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:31.536497 26415 log.cc:927] Time spent T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
W20260709 12:17:31.546557 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.503378 26029 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:31.537948 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 837) took 1659 ms. Trace:
I20260709 12:17:31.556537 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1909) took 1587 ms. Trace:
I20260709 12:17:31.556908 23995 rpcz_store.cc:276] 0709 12:17:29.969624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.198429 (+1228805us) service_pool.cc:224] Handling call
0709 12:17:31.198809 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.199062 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:31.377565 (+178503us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.556219 (+178654us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.556267 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:31.556314 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.556376 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.556483 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":214838,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":336910,"threads_started":3,"wal-append.queue_time_us":170527}
I20260709 12:17:31.558776 23995 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:31.554251 24591 rpcz_store.cc:276] 0709 12:17:29.877134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.424251 (+547117us) service_pool.cc:224] Handling call
0709 12:17:31.319448 (+895197us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:31.319658 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.319876 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:31.320198 (+   322us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.489816 (+169618us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.494132 (+  4316us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:31.497537 (+  3405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.502810 (+  5273us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.536187 (+ 33377us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6643,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":167,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5144,"spinlock_wait_cycles":26606464,"thread_start_us":153155,"threads_started":1,"wal-append.queue_time_us":223648}
I20260709 12:17:31.562877 26427 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:31.563773 26427 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.564373 26427 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.542254 26342 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:31.540656 26419 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.543579 26134 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:31.604496 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.619117 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1914) took 1011 ms. Trace:
W20260709 12:17:31.617357 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 280688us
I20260709 12:17:31.619704 23995 rpcz_store.cc:276] 0709 12:17:30.607462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.586638 (+979176us) service_pool.cc:224] Handling call
0709 12:17:31.618654 (+ 32016us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.618828 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.618854 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.618891 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:31.618923 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.618975 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.619066 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:31.554659 26297 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:31.656409 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1578) took 1023 ms. Trace:
I20260709 12:17:31.656859 24062 rpcz_store.cc:276] 0709 12:17:30.633274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.695350 (+ 62076us) service_pool.cc:224] Handling call
0709 12:17:30.696196 (+   846us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:17:30.696853 (+   657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.696896 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:17:30.698497 (+  1601us) log.cc:844] Serialized 600 byte log entry
0709 12:17:31.262466 (+563969us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:31.450905 (+188439us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.451332 (+   427us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.653801 (+202469us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.655443 (+  1642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.656146 (+   703us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:31.656199 (+    53us) raft_consensus.cc:1685] finished
0709 12:17:31.656213 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.656353 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4097,"prepare.queue_time_us":547699,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":70,"raft.queue_time_us":4557,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":32568,"spinlock_wait_cycles":16348160,"thread_start_us":364240,"threads_started":2,"wal-append.queue_time_us":678189}
I20260709 12:17:31.658795 26441 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.653287 26439 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:31.659425 26441 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:31.661036 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.662839 23886 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.663383 23991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 1901) took 1841 ms. Trace:
I20260709 12:17:31.663858 23991 rpcz_store.cc:276] 0709 12:17:29.821969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.826983 (+  5014us) service_pool.cc:224] Handling call
0709 12:17:31.663144 (+1836161us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400027e54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:31.663292 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010321280}
I20260709 12:17:31.664814 23886 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.666997 26445 consensus_queue.cc:1059] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:31.669691 26288 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.619199 26419 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:31.670965 24061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 393) took 1464 ms (client timeout 1656 ms). Trace:
W20260709 12:17:31.671463 24061 rpcz_store.cc:269] 0709 12:17:30.206621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.298613 (+ 91992us) service_pool.cc:224] Handling call
0709 12:17:31.670770 (+1372157us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b5400212fd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:31.670899 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413357824}
I20260709 12:17:31.673276 26427 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:31.674330 26422 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:17:31.674530 26438 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:31.674913 26438 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:31.674957 26439 raft_consensus.cc:697] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:31.675827 26438 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.676246 26439 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:31.677951 26397 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 1.168s	user 0.001s	sys 0.001s
I20260709 12:17:31.679121 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:31.683475 23993 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:17:31.684770 23993 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:31.690831 24591 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:31.697921 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:31.698675 23913 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:31.697980 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.699532 23917 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:31.703990 24069 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:31.617641 26421 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.701820 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1915) took 1094 ms. Trace:
I20260709 12:17:31.710634 23995 rpcz_store.cc:276] 0709 12:17:30.607634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.656946 (+1049312us) service_pool.cc:224] Handling call
0709 12:17:31.701242 (+ 44296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.701428 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.701465 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.701515 (+    50us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:31.701561 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.701627 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.701754 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:31.714922 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.719504 23920 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:31.722922 24599 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:31.723723 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:31.667073 26428 log.cc:927] Time spent T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:17:31.727066 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 232742us
I20260709 12:17:31.729456 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.730583 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:31.717535 26430 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:17:31.655740 26134 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:31.618292 26144 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.733423 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.753888 23921 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:31.755541 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.756630 23919 raft_consensus.cc:2368] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5.
I20260709 12:17:31.761008 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.762399 23914 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:31.765312 23988 raft_consensus.cc:606] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.765884 23988 raft_consensus.cc:614] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:31.753257 26047 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
W20260709 12:17:31.772485 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 83432.4us
I20260709 12:17:31.757889 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:31.768740 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 273164us
I20260709 12:17:31.759675 26091 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.778287 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:31.783671 24036 leader_election.cc:400] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:31.783990 24036 leader_election.cc:403] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:31.760317 26434 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:31.728832 26408 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:31.771191 26388 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 1.547s	user 0.004s	sys 0.000s
I20260709 12:17:31.655678 26363 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:31.793633 26261 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5.
I20260709 12:17:31.794641 26134 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.667901 26420 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:31.804440 24592 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:31.661706 26441 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:31.620806 26364 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.803730 26144 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.792506 23913 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:31.716481 26421 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.810215 24598 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:31.772045 26427 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.771584 26450 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.763620 26314 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.782925 26344 consensus_queue.cc:1059] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:17:31.812942 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.830338 24597 raft_consensus.cc:2393] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:31.812458 24599 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:17:31.851035 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.657861 26305 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.826202 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:31.854044 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.855573 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:31.862043 26405 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.708s	user 0.000s	sys 0.001s
I20260709 12:17:31.862393 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.863517 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.848707 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.866137 23913 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:31.830973 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 611) took 1212 ms. Trace:
I20260709 12:17:31.867094 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.867498 24592 rpcz_store.cc:276] 0709 12:17:30.612121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.648382 (+ 36261us) service_pool.cc:224] Handling call
0709 12:17:31.678961 (+1030579us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:31.824606 (+145645us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3512192}
W20260709 12:17:31.828176 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 163393us
I20260709 12:17:31.852293 23991 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:31.854218 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:31.869278 24599 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:31.834115 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.870579 24598 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:31.870728 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 386) took 2082 ms. Trace:
I20260709 12:17:31.871068 24068 rpcz_store.cc:276] 0709 12:17:29.788291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.802686 (+ 14395us) service_pool.cc:224] Handling call
0709 12:17:30.690306 (+887620us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b5800133e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:30.769633 (+ 79327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.770434 (+   801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.870545 (+1100111us) spinlock_profiling.cc:243] Waited 79 ms on lock 0x7b540021c850. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:31.870677 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":191429248}
I20260709 12:17:31.840485 26441 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.875603 26421 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.875761 26441 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.846985 26364 consensus_queue.cc:1059] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:17:31.877236 26364 consensus_queue.cc:1243] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Peer 0829ddf18f07439086398756b9c6d216 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:31.877840 26441 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.856658 26365 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:31.853363 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:31.880246 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:31.881057 24067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 383) took 2093 ms (client timeout 1512 ms). Trace:
I20260709 12:17:31.880697 26287 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.881357 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:31.881439 24067 rpcz_store.cc:269] 0709 12:17:29.787388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.797770 (+ 10382us) service_pool.cc:224] Handling call
0709 12:17:31.880108 (+2082338us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b5800133e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:31.880956 (+   848us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12412288}
I20260709 12:17:31.859536 26344 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:31.839051 26448 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.853405 26236 raft_consensus.cc:3055] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:31.882349 23995 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:31.841892 26427 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.883965 26438 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:31.885372 23989 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60542 (request call id 357) took 2168 ms (client timeout 1882 ms). Trace:
I20260709 12:17:31.887090 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1577) took 1257 ms. Trace:
I20260709 12:17:31.904675 24064 rpcz_store.cc:276] 0709 12:17:30.629970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.670610 (+ 40640us) service_pool.cc:224] Handling call
0709 12:17:30.698613 (+ 28003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:30.699232 (+   619us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.886853 (+1187621us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b54001b80d0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:31.887019 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63590144}
I20260709 12:17:31.884536 26419 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.890898 24599 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:31.891537 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
W20260709 12:17:31.849020 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 65666.2us
I20260709 12:17:31.891961 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:31.902555 26236 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:31.902786 26420 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.920441 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:31.918457 23886 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:31.923961 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:31.923322 23886 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:31.926105 23995 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
W20260709 12:17:31.927816 23994 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 1895) took 2208 ms (client timeout 2105 ms). Trace:
W20260709 12:17:31.927548 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.930259 24070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 384) took 2136 ms (client timeout 1520 ms). Trace:
I20260709 12:17:31.928398 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.931177 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.928193 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.932869 24596 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:31.933493 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 606) took 1558 ms. Trace:
W20260709 12:17:31.925417 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 197427us
I20260709 12:17:31.936252 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.937654 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:31.930727 24070 rpcz_store.cc:269] 0709 12:17:29.787714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.810222 (+ 22508us) service_pool.cc:224] Handling call
0709 12:17:31.920291 (+2110069us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b5800133e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:31.924130 (+  3839us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11116288}
I20260709 12:17:31.933873 24596 rpcz_store.cc:276] 0709 12:17:30.375202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.422907 (+ 47705us) service_pool.cc:224] Handling call
0709 12:17:31.928059 (+1505152us) spinlock_profiling.cc:243] Waited 7.14 ms on lock 0x7b5800003c98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:31.933425 (+  5366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16410880}
I20260709 12:17:31.917737 26363 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:31.929949 23994 rpcz_store.cc:269] 0709 12:17:29.719163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.748385 (+ 29222us) service_pool.cc:224] Handling call
0709 12:17:31.923831 (+2175446us) spinlock_profiling.cc:243] Waited 74.2 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:31.927745 (+  3914us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170553728}
I20260709 12:17:31.910429 26448 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:31.947535 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.933138 23961 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:31.932332 23960 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.929546 26441 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:31.953329 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:31.944871 26285 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.924934 26460 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:31.904475 23989 rpcz_store.cc:269] 0709 12:17:29.717082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.720485 (+  3403us) service_pool.cc:224] Handling call
0709 12:17:31.885169 (+2164684us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b5400256cd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:31.885280 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955974016}
I20260709 12:17:31.952476 26236 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.928009 26452 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:31.945814 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.946069 26363 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:31.955340 23995 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:31.969233 23994 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:31.942284 26461 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:31.928707 26420 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.975224 26449 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:31.975757 26449 raft_consensus.cc:697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:31.976537 26449 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.962916 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:31.979524 26448 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.979661 23992 raft_consensus.cc:2376] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5. Re-sending same reply.
W20260709 12:17:31.980283 23992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 1900) took 2179 ms (client timeout 2176 ms). Trace:
W20260709 12:17:31.980666 23992 rpcz_store.cc:269] 0709 12:17:29.801293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.801465 (+   172us) service_pool.cc:224] Handling call
0709 12:17:31.962675 (+2161210us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:31.980211 (+ 17536us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48689920}
I20260709 12:17:31.981943 23960 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.957247 26457 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:17:31.983713 23960 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.984006 26457 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:31.985275 23960 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.985427 26457 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:31.985859 26457 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.986778 26455 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:31.987185 26455 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.987550 26455 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:31.965378 26452 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:31.987782 26364 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:31.988106 26452 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:31.989204 23961 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:31.990835 24598 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:31.963688 26447 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:31.953917 26441 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.954934 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:31.958102 26460 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.018050 26441 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:31.994534 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:31.994655 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:31.961687 26304 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:31.972956 26363 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.017035 26456 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.015189 26236 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.065853 26452 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.070596 26451 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.071149 26451 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.073386 26451 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.986212 26457 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:32.028496 26029 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:32.074687 26029 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.074424 26455 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.076629 26455 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.997570 26393 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:32.078444 26393 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:32.078845 26393 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.079196 26321 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:32.031315 26431 log.cc:927] Time spent T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.493s	user 0.003s	sys 0.000s
I20260709 12:17:32.035337 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.038621 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.019418 26419 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:32.020901 26420 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:31.958964 26285 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.085402 26285 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.042587 26427 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.044772 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:32.086264 23914 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.088478 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.046940 26326 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.047916 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:32.089700 26185 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.053491 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:32.090821 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.091197 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:32.090214 24592 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:32.091727 24598 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.091849 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:32.092362 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:32.093546 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:32.093672 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 600) took 2321 ms. Trace:
I20260709 12:17:32.057999 26460 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.094074 24593 rpcz_store.cc:276] 0709 12:17:29.772466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.772613 (+   147us) service_pool.cc:224] Handling call
0709 12:17:29.772980 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:31.197320 (+1424340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.197352 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:31.197979 (+   627us) log.cc:844] Serialized 52 byte log entry
0709 12:17:31.438842 (+240863us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:31.446029 (+  7187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.725913 (+279884us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54003ec454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:31.727950 (+  2037us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.030702 (+302752us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:32.093420 (+ 62718us) raft_consensus.cc:1685] finished
0709 12:17:32.093442 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.093594 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":960,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8401,"spinlock_wait_cycles":3268174592,"thread_start_us":192914,"threads_started":1,"wal-append.queue_time_us":285260}
I20260709 12:17:32.096211 24595 raft_consensus.cc:1217] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 12:17:32.096678 24595 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:17:32.059000 26304 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.098582 26304 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.098495 26427 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:32.103053 26314 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.103668 26314 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:32.104151 26314 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.106703 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 603) took 1881 ms. Trace:
W20260709 12:17:32.106838 26383 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 1.949s	user 0.004s	sys 0.000s
I20260709 12:17:32.107093 24600 rpcz_store.cc:276] 0709 12:17:30.225473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.125891 (+900418us) service_pool.cc:224] Handling call
0709 12:17:31.126141 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.193965 (+ 67824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.194019 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.194076 (+    57us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:31.194128 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.106463 (+912335us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b5400483354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:32.106522 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.106638 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155428096}
I20260709 12:17:32.108279 26314 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.108850 26314 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:32.109462 26314 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:31.993055 23960 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:32.111668 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 118684us
I20260709 12:17:32.112816 23960 leader_election.cc:400] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5.
I20260709 12:17:32.112458 26441 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.113113 23960 leader_election.cc:403] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:32.113749 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.060001 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.056042 26333 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.114584 26333 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.115082 26445 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.115506 26455 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5.
I20260709 12:17:32.116247 26455 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:32.116488 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1590) took 1473 ms. Trace:
I20260709 12:17:32.116550 26455 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:32.116833 26333 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.117045 26455 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.034132 26278 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.081969 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:32.118081 23917 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:32.083575 23989 raft_consensus.cc:2393] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:32.082463 26456 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:32.124434 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.124749 23918 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:32.054956 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.125682 23995 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:32.127174 26456 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.128710 26278 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:32.129042 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:32.097936 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 510) took 2141 ms. Trace:
I20260709 12:17:32.129245 26278 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.129606 24595 rpcz_store.cc:276] 0709 12:17:29.956970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.662376 (+705406us) service_pool.cc:224] Handling call
0709 12:17:32.096025 (+1433649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.096952 (+   927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.097750 (+   798us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003ec450. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:32.097882 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3211964800}
I20260709 12:17:32.130169 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:32.130767 23920 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.131325 26278 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.134028 26198 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:32.138367 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.110489 23886 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:32.110737 26321 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:32.116940 24066 rpcz_store.cc:276] 0709 12:17:30.642938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.131943 (+489005us) service_pool.cc:224] Handling call
0709 12:17:31.153336 (+ 21393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.216778 (+ 63442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.216808 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.216846 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:31.216875 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.116285 (+899410us) spinlock_profiling.cc:243] Waited 63.3 ms on lock 0x7b5400182754. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:32.116325 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.116439 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":145477376}
I20260709 12:17:32.151644 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:32.138190 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.152618 24592 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:32.153095 24065 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:32.139535 23886 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.140203 23961 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:32.141211 23995 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:32.097888 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:32.054988 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.156303 23914 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:32.148198 24598 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:32.156982 23913 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.159452 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:32.161327 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 63505.6us
I20260709 12:17:32.156466 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.162320 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.162429 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.163410 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.164587 26315 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:32.164880 26427 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:32.165505 26427 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:32.166217 26448 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:32.166671 26427 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.167769 26444 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:32.168237 26444 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:32.170040 26315 consensus_queue.cc:1059] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:32.170485 26390 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:32.171859 26091 raft_consensus.cc:3055] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:32.172346 26091 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:32.174480 23960 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:32.175179 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.175424 26456 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:32.176011 26098 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:32.176450 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.179333 23920 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:32.179862 26456 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:32.182016 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.182770 24070 raft_consensus.cc:2368] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5.
I20260709 12:17:32.182765 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.183591 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:32.183713 23991 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:32.184165 24067 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.185410 26029 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.178050 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:32.186579 26321 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.187335 26297 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:32.196867 24069 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:32.157967 26419 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:32.188966 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.181655 26456 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.161156 26278 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:32.191504 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 53223us
I20260709 12:17:32.191617 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.192095 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:32.177471 24035 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:32.196532 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.198427 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:32.192987 23915 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:32.200837 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.203361 24564 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:32.204210 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.207494 26273 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:32.213544 24061 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
W20260709 12:17:32.228206 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 50804.3us
I20260709 12:17:32.157661 26198 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:32.202652 26305 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.192211 26326 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:32.201336 26350 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:32.201385 26100 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:32.210076 26278 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:32.199801 26451 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:32.237869 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 46351.9us
I20260709 12:17:32.225407 26441 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.215121 26450 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:32.225343 26421 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:32.249675 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 46440.4us
I20260709 12:17:32.255297 23886 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.234614 26261 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:32.252038 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 836) took 2386 ms. Trace:
I20260709 12:17:32.252652 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.231876 26198 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:32.243799 26420 raft_consensus.cc:670] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:32.257642 24564 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:32.250211 26451 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.258821 26441 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:32.259047 26421 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.235100 26357 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:17:32.259449 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:32.293253 24595 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.221763 26419 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.241187 26305 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.250774 26278 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.260828 26476 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:32.252091 26450 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:32.289285 26451 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.215633 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.263392 24594 rpcz_store.cc:276] 0709 12:17:29.865828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.321461 (+455633us) service_pool.cc:224] Handling call
0709 12:17:30.700917 (+379456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:30.701182 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:30.705090 (+  3908us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.307787 (+602697us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:31.307859 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:31.307925 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.308004 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.251861 (+943857us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b540064ee50. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:32.251978 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13108,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":40659,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":823968128,"thread_start_us":602239,"threads_started":2,"wal-append.queue_time_us":531971}
I20260709 12:17:32.283377 24067 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
W20260709 12:17:32.286926 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 75972.3us
W20260709 12:17:32.335422 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 119900us
I20260709 12:17:32.245175 26098 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:17:32.263285 24591 raft_consensus.cc:3055] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:32.247480 26344 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:17:32.262826 26100 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:32.282902 26261 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.261401 26474 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:32.298007 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1908) took 1092 ms. Trace:
I20260709 12:17:32.301852 23960 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.343092 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.343951 23962 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:32.291692 26393 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.294400 26350 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:32.392099 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.295934 26420 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:32.346779 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 117065us
I20260709 12:17:32.330713 26476 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:32.394232 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 92473.1us
I20260709 12:17:32.402817 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.401122 23916 rpcz_store.cc:276] 0709 12:17:31.206056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.216077 (+ 10021us) service_pool.cc:224] Handling call
0709 12:17:31.216371 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:31.665445 (+449074us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.665476 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:31.666012 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:17:31.828451 (+162439us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:31.828491 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.297635 (+469144us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54002c3154. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:32.297685 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.297731 (+    46us) raft_consensus.cc:1685] finished
0709 12:17:32.297746 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.297946 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":217316,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":297915776,"thread_start_us":458654,"threads_started":2,"wal-append.queue_time_us":191205}
W20260709 12:17:32.400622 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 56807.3us
I20260709 12:17:32.405640 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:32.406808 23962 leader_election.cc:400] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5.
I20260709 12:17:32.377964 26481 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.418105 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 165517us
I20260709 12:17:32.340071 26326 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:32.333799 26450 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.340137 24591 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:32.379681 26029 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.401139 26261 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.403098 26476 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.429629 24566 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.374415 26287 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.398255 26147 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:32.428412 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:32.389313 26304 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.404134 26421 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.440234 26326 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.470002 26365 consensus_queue.cc:1059] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:17:32.489584 26342 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:32.474730 26468 log.cc:927] Time spent T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:17:32.440130 26481 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:32.490912 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 62577.1us
I20260709 12:17:32.491773 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:32.478731 26457 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:32.493384 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 63821.6us
I20260709 12:17:32.432289 23989 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:32.494467 26029 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:32.495307 26457 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.495647 26185 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:32.493403 26478 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.496227 26185 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:32.496443 26478 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.497129 26185 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.487890 23915 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:32.500792 26304 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.501098 26455 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.502127 23993 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:32.487218 23920 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:32.491650 26098 raft_consensus.cc:3055] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.503886 26098 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:32.504079 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.504760 26098 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.505818 26098 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.481441 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:32.506639 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.506906 24596 raft_consensus.cc:2376] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3. Re-sending same reply.
I20260709 12:17:32.505820 26484 raft_consensus.cc:2764] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:17:32.440083 26439 consensus_queue.cc:1059] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 12:17:32.509194 26439 raft_consensus.cc:3055] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:32.509552 26439 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:32.408083 26341 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:32.510668 26341 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.510389 26439 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.476820 24595 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:32.511027 26478 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.511475 26481 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:32.513091 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.514953 26305 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.489641 26326 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.515463 26484 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:32.515904 26484 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:32.516026 26419 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:32.516351 26484 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.517069 23990 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:32.482481 26149 consensus_queue.cc:1059] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:17:32.519819 26149 raft_consensus.cc:3055] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:32.520138 26149 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:32.520974 26149 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.521342 24566 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.491663 26100 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.523425 26419 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:32.441408 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 183840us
I20260709 12:17:32.553777 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:32.372838 26466 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:32.490218 26342 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:32.527686 23913 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.402141 26350 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:32.511058 26341 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.405354 26438 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:32.580260 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:32.656800 26460 consensus_meta.cc:287] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.562s	user 0.008s	sys 0.001s
I20260709 12:17:32.655315 26393 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.470085 26287 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.527247 26147 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:32.636159 26473 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260709 12:17:32.640545 26363 consensus_meta.cc:287] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.001s
I20260709 12:17:32.636143 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:32.686404 26421 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.699681 26342 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:32.679282 24566 connection.cc:256] RPC call timeout handler was delayed by -1.9137911560001157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 12:17:32.677733 26278 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.345453 26198 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.474865 24591 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.684631 26326 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.754433 26287 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.708263 26460 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.617658 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:32.665046 26445 consensus_meta.cc:287] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.550s	user 0.000s	sys 0.009s
W20260709 12:17:32.687907 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.672364 23915 raft_consensus.cc:2393] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:32.688221 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:32.685851 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 159915us
W20260709 12:17:32.693044 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 223704us
I20260709 12:17:32.764930 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.766651 24035 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.698006 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:32.767504 23996 raft_consensus.cc:2393] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:32.701520 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:32.704789 24034 connection.cc:256] RPC call timeout handler was delayed by -1.477034372999924s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 12:17:32.706737 23887 leader_election.cc:336] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.579s (SENT)
I20260709 12:17:32.768626 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.769331 24596 raft_consensus.cc:2393] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:32.765758 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:32.709795 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:32.710808 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:32.708948 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35252 (request call id 22) took 1388 ms. Trace:
W20260709 12:17:32.716394 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:32.771762 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.718786 23921 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.675009 26455 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.698055 26350 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.705202 26439 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.733144 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:32.676687 26149 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:32.699817 26438 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:32.705741 26419 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:32.698645 26466 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.739480 26278 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.712551 26261 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.793255 26261 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.684736 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:32.794046 23919 raft_consensus.cc:2368] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5.
W20260709 12:17:32.734843 24566 connection.cc:256] RPC call timeout handler was delayed by -1.4901200060000974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 12:17:32.711922 26297 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:32.794430 24566 connection.cc:256] RPC call timeout handler was delayed by -1.2674441730000581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 12:17:32.794853 26460 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.794795 26297 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:17:32.795519 26460 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:32.795962 26460 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.697641 26285 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:17:32.697470 26441 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:17:32.771492 23988 rpcz_store.cc:276] 0709 12:17:31.310478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.497389 (+186911us) service_pool.cc:224] Handling call
0709 12:17:32.699037 (+1201648us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540009a454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c4c853 00007f75c5c1a60a 00007f75bf1a07d4 00007f75bf1a0762 00007f75bf1a0691 00007f75bf1a060c 00007f75bf19f8c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:32.699152 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522041728}
I20260709 12:17:32.783843 24596 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:32.794808 24566 connection.cc:256] RPC call timeout handler was delayed by -1.0820441729999857s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:17:32.798666 24566 connection.cc:256] RPC call timeout handler was delayed by -1.074844172999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
I20260709 12:17:32.798475 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:32.799006 24566 connection.cc:256] RPC call timeout handler was delayed by -1.0577441730001738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260709 12:17:32.799263 24596 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:32.799728 24566 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:32.800827 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:32.803748 24566 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:32.804939 24566 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:32.820952 23921 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:32.724601 26363 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.770185 26445 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:32.775188 26474 raft_consensus.cc:697] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:32.827296 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:32.824388 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:32.734452 26421 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.837538 23917 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:32.781116 26481 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:32.834700 26326 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.834240 26474 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.840777 24599 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:32.762367 26029 consensus_queue.cc:1059] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:17:32.774986 26487 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:32.788889 26438 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:32.846223 26363 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:32.846850 26363 raft_consensus.cc:2764] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:17:32.830766 26454 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.836247 26476 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.844707 26489 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:32.844969 26460 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.826407 26297 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.849552 26363 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:32.823072 26441 consensus_queue.cc:1243] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer ef0dd15ac654478b8371c22b8909240e log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:32.821550 26483 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:32.779462 26287 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:17:32.853965 26491 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:32.864430 26091 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.865808 26091 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:32.866806 26486 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:17:32.785288 26484 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.821143 26419 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.775497 26450 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.874155 26450 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:32.874976 26451 consensus_meta.cc:287] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 12:17:32.875424 26451 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.876236 23915 raft_consensus.cc:2393] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:32.877539 26451 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.878110 26466 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.878434 26481 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:32.879416 26481 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:32.870965 26484 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.880792 26454 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.851883 26487 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:32.885708 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:32.900395 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:32.838856 26147 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:32.901013 24597 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
W20260709 12:17:32.893265 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.901929 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:32.902499 24597 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:32.905035 23961 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:32.907150 26047 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:32.894493 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:32.909698 24598 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:32.910133 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:32.910981 23912 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:32.909116 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:32.911990 23915 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:32.913174 23886 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:32.914405 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.915139 23960 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.916116 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:32.917971 23886 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:32.919780 23886 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:32.830134 26420 raft_consensus.cc:697] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:32.923872 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.914322 24597 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:32.977555 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:32.892243 26421 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.973914 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.974009 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.975437 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.974792 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.976007 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.985000 24064 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:32.895067 26454 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.979856 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:32.965119 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.963325 26450 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:32.894961 26476 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.981521 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.981781 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.911669 26452 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:32.987927 24598 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
W20260709 12:17:32.989393 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 221201us
I20260709 12:17:32.992259 23962 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:33.013713 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:32.983789 24070 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:32.962419 26441 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:32.921679 26364 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:33.017297 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.980686 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:32.962736 26458 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:32.962230 26491 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:33.020900 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.014267 26297 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:33.082340 23886 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:33.074568 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.079056 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.081301 26421 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:33.079946 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.084472 24065 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:33.078974 26491 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:33.085140 24067 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:33.085220 26491 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.085930 24598 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:33.081456 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 89317us
I20260709 12:17:33.086848 23962 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:33.080893 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.087477 24598 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:33.088560 26421 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.089145 24598 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:33.079066 26458 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.079281 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.090049 26458 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:33.090906 24034 connection.cc:256] RPC call timeout handler was delayed by -1.11232238100024s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 12:17:33.091235 24034 connection.cc:256] RPC call timeout handler was delayed by -1.0864343729999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
I20260709 12:17:33.092270 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:33.083036 24068 raft_consensus.cc:2393] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:32.901026 26438 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:33.093644 26292 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:33.094686 26292 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:33.095566 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:33.095777 26292 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:33.103663 26438 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:33.084406 24063 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:33.104909 26236 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.107671 24593 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:17:33.123208 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.125413 26455 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.125933 26288 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.126363 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:33.126471 26288 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.128924 24598 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:33.125931 26455 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.130648 23996 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.132002 26455 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:33.132553 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:33.133275 23996 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:33.134142 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:33.134296 26455 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:33.135807 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:33.136668 24598 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:33.148463 26444 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:33.149065 26352 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:33.150954 26444 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:33.152360 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:33.152778 26321 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:33.154089 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:33.154953 26236 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:33.155654 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37708 (request call id 526) took 1103 ms. Trace:
I20260709 12:17:33.156003 24599 rpcz_store.cc:276] 0709 12:17:32.052612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.052768 (+   156us) service_pool.cc:224] Handling call
0709 12:17:33.155451 (+1102683us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b5400585554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:33.155599 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724883328}
I20260709 12:17:33.157891 24600 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.129158 26288 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:33.183609 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:33.187434 23960 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:33.188815 26365 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:33.189294 26365 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:33.189749 26365 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:33.193801 26488 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.453s	user 0.003s	sys 0.000s
I20260709 12:17:33.196803 26314 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:33.200161 26365 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:33.202790 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 619) took 1101 ms. Trace:
I20260709 12:17:33.203181 24600 rpcz_store.cc:276] 0709 12:17:32.101733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.108149 (+  6416us) service_pool.cc:224] Handling call
0709 12:17:33.157646 (+1049497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.158364 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.202620 (+ 44256us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400585550. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:33.202736 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2412872960}
I20260709 12:17:33.204720 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:33.205322 23921 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.021282 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.156684 24034 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:33.209344 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.212082 24064 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:33.215739 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:33.218904 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.220767 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1842) took 1093 ms. Trace:
I20260709 12:17:33.221133 23918 rpcz_store.cc:276] 0709 12:17:32.127773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.160376 (+ 32603us) service_pool.cc:224] Handling call
0709 12:17:32.160596 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.160724 (+   128us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:32.237305 (+ 76581us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.080374 (+843069us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b180027ef80. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75c07fa4bc 00007f75bdb4848b 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f223a
0709 12:17:33.220435 (+140061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:33.220495 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:33.220543 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.220610 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.220716 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139814,"prepare.queue_time_us":123259,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"spinlock_wait_cycles":2683648,"thread_start_us":101951,"threads_started":2,"wal-append.queue_time_us":168460}
I20260709 12:17:33.225982 23995 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:33.227398 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 145167us
I20260709 12:17:33.228401 23886 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:33.229506 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 72877.2us
I20260709 12:17:33.230294 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:33.236421 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.237210 24063 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:33.247800 23990 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:33.249812 23994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:33.250494 23994 raft_consensus.cc:606] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:33.250931 23994 raft_consensus.cc:614] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:33.246465 26448 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:33.254578 26491 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.254686 26365 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:33.257346 26491 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:33.258301 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.220865 26458 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:33.261898 26458 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:32.895874 26487 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.255131 26297 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:33.264477 26448 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:33.269752 26297 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.207888 26364 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.274595 26364 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:33.277865 23887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.009s	sys 0.017s
W20260709 12:17:33.278230 23887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.010s	sys 0.017s
W20260709 12:17:33.278774 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 571995us
W20260709 12:17:33.278995 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.280936 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:33.281589 23918 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.283005 23916 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:33.285092 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 56796.3us
I20260709 12:17:33.207472 26450 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:33.220371 26288 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.208936 26352 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:33.287313 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:33.209233 26441 raft_consensus.cc:697] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:33.307706 24063 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:17:33.312875 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 507928us
I20260709 12:17:33.271063 26448 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.318181 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.320758 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.233680 26476 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:33.323100 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:33.330711 24600 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:33.331758 24566 leader_election.cc:336] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.512s (SENT)
I20260709 12:17:33.350878 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:33.321906 23921 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:33.334054 24564 leader_election.cc:400] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5.
I20260709 12:17:33.351804 24564 leader_election.cc:403] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:33.302408 26321 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.337224 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.229728 26185 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 12:17:33.326884 23918 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:33.349709 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.349557 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:33.354518 24564 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:33.353308 23960 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:33.366511 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:33.377765 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:33.378116 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:33.378454 23918 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:33.378549 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:33.385821 23918 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:33.429525 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:33.430228 23990 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:33.433007 26439 consensus_meta.cc:287] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.000s
I20260709 12:17:33.433668 26441 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.434577 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:33.435272 26342 consensus_meta.cc:287] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.678s	user 0.005s	sys 0.002s
I20260709 12:17:33.435851 26342 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:33.436277 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.347189 26261 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:17:33.354799 26236 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:33.437427 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:33.438359 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.438781 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.337666 26498 consensus_queue.cc:1059] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:17:33.439438 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.439795 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.440157 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.440510 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:33.440915 24070 raft_consensus.cc:2393] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:33.440855 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:33.441327 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:33.441824 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:33.441913 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 62339.7us
I20260709 12:17:33.442571 24065 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:33.255257 26497 consensus_queue.cc:1059] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:17:33.444048 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:33.444267 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:33.444796 24599 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:33.366405 26483 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:33.319146 26420 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.435325 24064 raft_consensus.cc:2393] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:33.454952 24600 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:33.447683 24061 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:33.309490 26350 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.346257 26419 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:33.446828 23990 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
W20260709 12:17:33.460186 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 128457us
I20260709 12:17:33.463351 24068 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:33.464010 26451 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:33.464957 24564 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:33.465721 26447 raft_consensus.cc:3055] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:33.472741 26198 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:33.483239 26134 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:17:33.505223 24594 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.022s	sys 0.016s
I20260709 12:17:33.359903 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:33.460503 26236 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:33.459959 26390 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.496424 26450 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.497393 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:33.502756 26447 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:33.318697 26288 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:33.486488 26341 consensus_meta.cc:287] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.749s	user 0.009s	sys 0.000s
I20260709 12:17:33.507030 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:33.440207 24593 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:33.509598 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:33.509099 24594 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.023s	sys 0.016s
W20260709 12:17:33.503178 26029 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.042s
I20260709 12:17:33.444617 26466 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:33.594857 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 53402.3us
I20260709 12:17:33.595186 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:33.596211 23990 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:33.512432 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 47552.5us
I20260709 12:17:33.597332 23918 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:33.448086 26365 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:33.339756 26476 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:33.508198 26278 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.035s	sys 0.086s
I20260709 12:17:33.515362 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:33.514461 24592 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:33.543052 24035 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:33.598623 23886 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:33.630601 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:33.505388 26134 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:33.509063 26483 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
W20260709 12:17:33.593888 26029 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.005s	sys 0.042s
W20260709 12:17:33.554447 26393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.000s	sys 0.023s
W20260709 12:17:33.675062 26393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.000s	sys 0.024s
I20260709 12:17:33.675616 26288 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:33.653334 26278 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.035s	sys 0.086s
I20260709 12:17:33.677922 26497 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:33.678354 26497 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.678711 26497 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:33.679472 26350 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:33.594499 26438 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:33.513715 26443 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.007s	sys 0.041s
I20260709 12:17:33.605387 26185 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.665863 23992 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:17:33.670814 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 72293.6us
W20260709 12:17:33.694727 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.655261 23990 raft_consensus.cc:2393] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:33.654707 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 111717us
I20260709 12:17:33.695783 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:33.697234 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:33.697877 23990 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:33.683085 26091 consensus_meta.cc:287] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.802s	user 0.009s	sys 0.002s
I20260709 12:17:33.658387 26451 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:33.659909 26455 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.545133 26341 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:33.538120 26390 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.659993 26100 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
W20260709 12:17:33.688942 26292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.012s	sys 0.052s
W20260709 12:17:33.699811 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 405731us
I20260709 12:17:33.684341 26466 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:33.680691 26505 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:33.700227 24598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.047s	sys 0.105s
W20260709 12:17:33.810588 24598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.047s	sys 0.106s
I20260709 12:17:33.759768 26400 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260709 12:17:33.813313 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 311705us
I20260709 12:17:33.698251 26365 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:33.721859 26236 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:33.715648 26455 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:33.801436 26487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.007s	sys 0.038s
I20260709 12:17:33.707437 26344 consensus_queue.cc:1059] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:17:33.753850 23991 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:33.719995 26451 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:33.680868 26494 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5.
I20260709 12:17:33.832139 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 627) took 1143 ms. Trace:
I20260709 12:17:33.832535 24592 rpcz_store.cc:276] 0709 12:17:32.688291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.711714 (+ 23423us) service_pool.cc:224] Handling call
0709 12:17:33.831902 (+1120188us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b5400682254. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:33.832062 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689879936}
I20260709 12:17:33.833796 26451 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.837899 24597 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.837946 24593 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.839435 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 854) took 1047 ms. Trace:
I20260709 12:17:33.834374 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:33.840034 24597 rpcz_store.cc:276] 0709 12:17:32.791821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.016159 (+224338us) service_pool.cc:224] Handling call
0709 12:17:33.837721 (+821562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.838469 (+   748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.839245 (+   776us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400682250. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:33.839373 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888692992}
I20260709 12:17:33.704844 26297 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.759917 23993 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:33.766170 23989 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 2. Current term is 4. Ops: []
W20260709 12:17:33.732903 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.702324 26185 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:33.707574 26438 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:33.721410 26292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.012s	sys 0.052s
I20260709 12:17:33.809582 24036 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:33.897734 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 88253.1us
I20260709 12:17:33.707796 23921 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:33.686956 26443 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.007s	sys 0.042s
I20260709 12:17:33.791107 26466 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:33.900000 26508 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:17:33.900173 26507 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:17:33.788291 26147 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:33.767927 26485 consensus_queue.cc:1059] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:17:33.955483 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1765) took 1759 ms. Trace:
I20260709 12:17:33.821408 23990 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
W20260709 12:17:33.824210 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:33.825275 24034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.012s
W20260709 12:17:33.961858 24034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.011s	sys 0.012s
I20260709 12:17:33.841097 23961 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:33.958297 23987 rpcz_store.cc:276] 0709 12:17:32.195782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.195899 (+   117us) service_pool.cc:224] Handling call
0709 12:17:33.115833 (+919934us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:33.116089 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.116373 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.116410 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.116989 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 12:17:33.546491 (+429502us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:33.546529 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.546593 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:33.901793 (+355200us) raft_consensus.cc:1685] finished
0709 12:17:33.901814 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.955400 (+ 53586us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6488448,"thread_start_us":429037,"threads_started":1,"wal-append.queue_time_us":585370}
I20260709 12:17:33.713203 26447 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:33.844604 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 401086us
W20260709 12:17:33.826457 26487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.009s	sys 0.038s
W20260709 12:17:33.843852 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 142966us
I20260709 12:17:33.866078 24592 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:33.767653 26483 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.966058 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:33.861692 26449 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:17:33.929824 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:33.718050 26134 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:33.961794 26321 consensus_meta.cc:287] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.598s	user 0.012s	sys 0.009s
I20260709 12:17:33.901571 26476 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:33.956288 26273 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.820003 26505 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.965795 26341 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:33.971946 26517 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 12:17:33.973572 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 132555us
W20260709 12:17:33.979820 26503 log.cc:927] Time spent T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:17:33.920437 26352 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:33.974138 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:33.976827 23887 leader_election.cc:336] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.941s (SENT)
I20260709 12:17:34.019930 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:34.021607 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 44801.1us
I20260709 12:17:34.021848 23917 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:17:33.977149 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 47443.4us
I20260709 12:17:33.979013 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:33.957773 23995 pending_rounds.cc:85] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 2
I20260709 12:17:34.025907 23995 pending_rounds.cc:107] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:17:33.866703 26297 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:33.979717 26509 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
W20260709 12:17:33.981093 26461 consensus_queue.cc:1175] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0829ddf18f07439086398756b9c6d216" responder_term: 6 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:33.981614 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:33.982223 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:34.035013 23988 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:33.982375 26455 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:33.979877 26441 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:34.036813 26441 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.039211 26441 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:33.966152 26454 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.999066 24061 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:33.900172 26438 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:34.055898 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.056963 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:34.007249 26185 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:34.007661 26364 consensus_meta.cc:287] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.732s	user 0.009s	sys 0.000s
I20260709 12:17:34.074585 26364 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.076004 23996 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:34.077180 26364 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:34.008464 26149 consensus_meta.cc:287] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 1.211s	user 0.010s	sys 0.000s
I20260709 12:17:33.960685 26147 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.008617 24069 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:34.078078 24063 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:34.078442 24069 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:34.079936 26147 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:33.983124 26447 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:34.084983 26514 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:17:34.086927 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 852) took 1305 ms. Trace:
I20260709 12:17:34.088141 26505 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:34.087303 24596 rpcz_store.cc:276] 0709 12:17:32.781887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.848516 (+ 66629us) service_pool.cc:224] Handling call
0709 12:17:32.848823 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.849112 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.849138 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:32.849533 (+   395us) log.cc:844] Serialized 26 byte log entry
0709 12:17:33.311981 (+462448us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:33.312034 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.312116 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.086695 (+774579us) raft_consensus.cc:1685] finished
0709 12:17:34.086721 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.086862 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9209,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":462056,"threads_started":1,"wal-append.queue_time_us":871299}
I20260709 12:17:34.088660 26505 consensus_queue.cc:1059] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:34.009944 26510 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:33.979998 26390 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:34.011138 26512 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:17:33.900802 26466 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.017462 26134 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.016835 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:33.973170 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 742879us
W20260709 12:17:34.026351 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 47436us
I20260709 12:17:34.026171 23995 raft_consensus.cc:2889] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:33.983510 26515 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:34.028887 23987 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:34.019589 26352 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.028357 26305 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:33.997771 26091 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:33.998049 26273 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.031790 26487 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:34.029438 26476 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.033138 26297 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:34.036269 26198 consensus_meta.cc:287] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.000s
I20260709 12:17:34.005052 26497 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.026391 23921 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:33.958465 26365 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.041407 26144 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:17:34.079538 24069 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:33.980168 26321 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.098958 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:34.032361 23989 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:17:34.107110 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:34.054601 26344 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:17:34.113608 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:34.114250 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:34.144245 23912 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:34.094395 26513 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:34.118572 26450 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:34.118316 26091 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.169253 26450 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:34.170692 26091 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:34.119434 26273 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:34.130076 23915 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.136327 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.171881 24068 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:34.172695 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.136749 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.141592 23990 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:34.142582 24069 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.102342 26352 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:34.143862 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.183012 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:34.184193 23912 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:17:34.184687 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.186735 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.144176 26499 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:34.144902 24600 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:17:34.058148 26441 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:34.145795 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.191924 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.185454 23960 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:34.147789 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.149417 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.149421 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:34.142529 26305 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:34.146364 26476 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:34.158948 24064 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:34.159017 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:34.159377 26149 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:17:34.160858 26444 consensus_meta.cc:287] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.009s	user 0.005s	sys 0.006s
I20260709 12:17:34.162612 23989 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:34.163239 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:34.210518 23988 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 7: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:34.163789 26497 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:34.164988 26458 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:34.165230 26513 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:34.165573 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:34.167146 26518 log.cc:927] Time spent T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.199s	user 0.005s	sys 0.006s
I20260709 12:17:34.173512 24065 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:34.173674 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:34.192942 26489 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:34.221299 24596 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:34.183640 24598 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:34.192934 24067 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
W20260709 12:17:34.195237 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.195151 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:34.169107 26342 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:34.213479 23916 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:34.206696 26451 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:34.206938 26149 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:34.207545 26147 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:17:34.238771 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 88989.4us
W20260709 12:17:34.240255 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 169803us
I20260709 12:17:34.170053 26450 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.230866 24069 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:34.214819 26458 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:34.220609 26476 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:34.203406 26499 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.263188 24598 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:34.264690 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.265599 26273 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:34.211455 26441 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.238602 26451 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:34.209777 26305 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.247978 26501 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:34.248303 26495 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.273295 26478 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:34.268724 26444 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:17:34.274199 26236 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:17:34.255350 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:34.266052 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.258773 26450 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.283253 23991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1943) took 1068 ms. Trace:
I20260709 12:17:34.257899 26147 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:34.281325 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 250721us
I20260709 12:17:34.286089 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:34.292316 23991 rpcz_store.cc:276] 0709 12:17:33.215301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.216825 (+  1524us) service_pool.cc:224] Handling call
0709 12:17:33.217166 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.826944 (+609778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.282965 (+456021us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b540019dcd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:34.283182 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1233770880}
I20260709 12:17:34.292629 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.297477 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:34.298245 24067 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:34.307360 26273 raft_consensus.cc:3055] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:34.307817 26273 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:34.308065 26305 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:34.285832 26513 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.308682 26273 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.309939 26273 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.260934 26466 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:34.312225 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:34.312747 24596 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.312790 23915 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:34.312759 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.314591 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:34.278745 26451 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.318239 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.316468 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:34.335814 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.336438 24068 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:34.339113 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.341178 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.342900 24069 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:34.342983 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.343921 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.344877 23961 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:34.347671 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.349061 24067 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:34.315845 26091 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:34.377473 24596 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:34.380348 24068 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:34.348978 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:34.374467 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 179386us
I20260709 12:17:34.334794 26297 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:34.337580 26466 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:34.342559 26305 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:34.392779 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.395102 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:34.349540 26390 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:34.421823 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.390043 24566 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:34.352298 26455 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:34.423602 26455 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.424115 26455 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.310874 26147 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.409598 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:34.349711 26444 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:34.350589 26144 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.427809 26144 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.285970 26495 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.373764 26447 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:34.288846 26149 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.452739 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:34.445525 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55522us
I20260709 12:17:34.376153 26489 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:34.447255 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 98357.8us
I20260709 12:17:34.396899 26344 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.458669 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:34.452948 26447 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.442961 26531 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.461052 26454 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.457265 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:34.467626 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.469743 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.451190 26091 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:34.455420 26474 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:34.476147 24591 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.354434 26458 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:34.477156 26528 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 12:17:34.478197 26527 log.cc:927] Time spent T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
W20260709 12:17:34.478928 26532 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:17:34.479480 26526 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:17:34.374899 26476 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:34.482788 26534 log.cc:927] Time spent T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:17:34.490511 24068 raft_consensus.cc:3055] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:34.541420 24068 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:34.466205 26447 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.467645 26489 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.472332 26448 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:34.470152 26454 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.506289 26466 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:34.507849 26444 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:34.509383 26513 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:34.512393 23990 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:34.514249 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:34.720038 23991 raft_consensus.cc:2410] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:34.516327 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:34.519307 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:34.521039 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:34.487215 26149 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:34.489313 26321 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:34.594645 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.455838 26390 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:34.467720 26344 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.542405 24068 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.670009 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:34.746220 24068 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.504529 26305 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.166s
I20260709 12:17:34.671030 26499 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:34.673116 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.675248 26530 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:34.751339 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:34.684582 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 228857us
W20260709 12:17:34.684857 26535 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
I20260709 12:17:34.733811 23989 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 2.
W20260709 12:17:34.742794 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.746297 24065 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
W20260709 12:17:34.736344 26512 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:17:34.752691 24566 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.537158 26455 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.754266 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:34.762961 24566 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:34.771014 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:34.755872 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.774504 23917 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:34.798799 24068 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:17:34.802642 23915 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:34.805502 23912 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:17:34.807825 23912 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:34.809758 23912 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:34.811484 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:34.812531 23912 raft_consensus.cc:2368] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:34.814512 23912 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:34.820472 23912 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:34.823571 23915 raft_consensus.cc:1240] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:34.825507 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:34.828476 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:34.830978 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:34.831682 24070 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.838810 23912 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:34.836406 26305 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:34.776427 26499 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:34.842939 26533 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 12:17:34.756817 26530 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:34.852510 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.936304 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1778) took 1589 ms. Trace:
W20260709 12:17:34.921041 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.953212 23995 rpcz_store.cc:276] 0709 12:17:33.346761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.887265 (+540504us) service_pool.cc:224] Handling call
0709 12:17:33.957510 (+ 70245us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:34.125180 (+167670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:34.125208 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:34.125704 (+   496us) log.cc:844] Serialized 52 byte log entry
0709 12:17:34.210601 (+ 84897us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:34.210658 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.210754 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.854104 (+643350us) raft_consensus.cc:1685] finished
0709 12:17:34.854124 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.936218 (+ 82094us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30111,"raft.queue_time_us":27372,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":18039,"thread_start_us":84535,"threads_started":1,"wal-append.queue_time_us":189150}
I20260709 12:17:34.835048 26466 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.835943 26501 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:34.845804 26499 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:34.934975 26100 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:17:34.957669 26441 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:34.935715 26547 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260709 12:17:34.904018 26444 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:34.934793 26489 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:34.843894 26494 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.968899 26489 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:34.936530 26540 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.293s
I20260709 12:17:34.854763 26390 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:34.845073 26305 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.969604 26489 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:34.966208 26466 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:35.023037 26556 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
I20260709 12:17:35.023699 26559 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:17:35.024111 26466 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:35.024446 26305 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:35.025696 26550 log.cc:927] Time spent T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.321s	user 0.001s	sys 0.000s
I20260709 12:17:35.028810 26454 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:34.966154 26499 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:34.968606 26501 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:35.056924 26549 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:17:34.971112 26444 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:35.058296 26555 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.056669 26501 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:35.058979 26555 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:35.030633 26134 consensus_meta.cc:287] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.926s	user 0.010s	sys 0.001s
W20260709 12:17:35.070891 26557 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 12:17:35.079284 26553 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 12:17:34.976722 26552 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:35.120239 26501 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.121313 26552 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.124013 26552 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:35.124749 23918 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:35.124634 26501 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:35.135787 26455 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:35.001375 26494 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.144693 26494 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:35.172678 26352 consensus_meta.cc:287] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.969s	user 0.000s	sys 0.010s
I20260709 12:17:35.173316 26352 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:35.182547 26489 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:35.183624 26451 consensus_meta.cc:287] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.832s	user 0.009s	sys 0.001s
I20260709 12:17:35.184141 26451 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.187827 26451 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:35.196044 26352 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:35.203828 26444 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:35.210068 26450 consensus_meta.cc:287] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.892s	user 0.007s	sys 0.003s
W20260709 12:17:35.211702 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.218488 26273 consensus_meta.cc:287] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.883s	user 0.008s	sys 0.004s
W20260709 12:17:35.236927 26447 consensus_meta.cc:287] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.003s
I20260709 12:17:35.237869 26447 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.281255 26447 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:35.250254 26531 consensus_meta.cc:287] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.766s	user 0.004s	sys 0.006s
I20260709 12:17:35.282167 26531 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:35.284710 24061 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
W20260709 12:17:35.252295 26091 consensus_meta.cc:287] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.004s
I20260709 12:17:35.286202 26091 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:35.260855 24070 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
W20260709 12:17:35.263087 26149 consensus_meta.cc:287] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
W20260709 12:17:35.192518 24591 consensus_meta.cc:287] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.699s	user 0.007s	sys 0.002s
I20260709 12:17:35.291389 24591 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:17:35.292284 24591 pending_rounds.cc:85] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 4
I20260709 12:17:35.292687 24591 pending_rounds.cc:107] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:17:35.293059 24591 raft_consensus.cc:2889] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:35.293787 26474 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.294391 26474 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.295749 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 622) took 3101 ms. Trace:
I20260709 12:17:35.296309 24591 rpcz_store.cc:276] 0709 12:17:32.194169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.231640 (+ 37471us) service_pool.cc:224] Handling call
0709 12:17:32.252419 (+ 20779us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.475815 (+2223396us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54005c2720. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0bc7a1d 00007f75c0bae1a4 00007f75c0c30447 00007f75c0c48fe7 00007f75c0c4a7de 00007f75c0c54b49 00007f75c0c55416 00007f75c0c51d8f 00007f75c0c5183e 00007f75c5c16419
0709 12:17:35.293633 (+817818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.295677 (+  2044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114558336}
I20260709 12:17:35.340265 26495 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:35.356134 26481 raft_consensus.cc:3055] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:35.383756 26481 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:35.384917 26481 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:35.374130 24063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 1834) took 2037 ms (client timeout 1588 ms). Trace:
W20260709 12:17:35.386783 24063 rpcz_store.cc:269] 0709 12:17:33.336820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.336975 (+   155us) service_pool.cc:224] Handling call
0709 12:17:35.373902 (+2036927us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400264b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:35.374035 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1664954240}
W20260709 12:17:35.376086 26511 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 1.574s	user 0.007s	sys 0.013s
I20260709 12:17:35.378064 26357 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:35.389328 26357 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:35.390861 26357 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:35.392110 26357 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:35.401803 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1936) took 2267 ms. Trace:
I20260709 12:17:35.402473 23996 rpcz_store.cc:276] 0709 12:17:33.134043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.140817 (+  6774us) service_pool.cc:224] Handling call
0709 12:17:33.141155 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.076434 (+935279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.401409 (+1324975us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b54000686d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:35.401698 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2149216128}
I20260709 12:17:35.440436 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 862) took 1977 ms. Trace:
I20260709 12:17:35.440876 24595 rpcz_store.cc:276] 0709 12:17:33.462699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.495197 (+ 32498us) service_pool.cc:224] Handling call
0709 12:17:33.495554 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.684817 (+189263us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.684847 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:33.684886 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:33.684914 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.440088 (+1755174us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54003a2354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:35.440159 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.440360 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434788608}
W20260709 12:17:35.655885 26506 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 1.881s	user 0.005s	sys 0.000s
W20260709 12:17:35.685707 26499 consensus_meta.cc:287] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.618s	user 0.005s	sys 0.005s
I20260709 12:17:35.686260 26499 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.697665 26499 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:35.692817 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.694262 26365 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:35.699116 26364 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:35.699636 26365 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:35.699733 26364 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.701859 26364 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:35.701875 26365 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:35.720570 26098 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.721160 26098 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:35.728120 26098 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:35.728797 26098 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.729329 26098 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.732265 26098 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:35.735383 26098 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:35.734555 26365 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.738132 26365 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:35.743872 26365 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:35.757494 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 1876) took 2265 ms. Trace:
I20260709 12:17:35.757934 23921 rpcz_store.cc:276] 0709 12:17:33.492275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.500986 (+  8711us) service_pool.cc:224] Handling call
0709 12:17:35.757308 (+2256322us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b5400321254. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:35.757426 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124687104}
W20260709 12:17:35.774014 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.774740 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.775303 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.777985 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.779150 26572 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.779675 26572 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:35.781837 26572 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:35.796100 26572 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:35.799001 26572 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.803936 26357 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:35.806809 26357 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:35.863809 26390 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.016s	sys 0.015s
W20260709 12:17:35.881510 26390 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.790s	user 0.016s	sys 0.016s
I20260709 12:17:35.826485 26536 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.842064 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 861) took 2398 ms. Trace:
I20260709 12:17:35.883612 26536 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.884040 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1878) took 2385 ms. Trace:
I20260709 12:17:35.890828 23916 rpcz_store.cc:276] 0709 12:17:33.498889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.499070 (+   181us) service_pool.cc:224] Handling call
0709 12:17:33.499390 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.246823 (+747433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.354104 (+1107281us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54000aa5d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:35.883951 (+529847us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1641531776}
I20260709 12:17:35.891904 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1889) took 1778 ms. Trace:
I20260709 12:17:35.892385 23919 rpcz_store.cc:276] 0709 12:17:34.113569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.114128 (+   559us) service_pool.cc:224] Handling call
0709 12:17:34.114469 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.289978 (+175509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:34.290008 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:34.290048 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:34.290079 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.891622 (+1601543us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54001fde54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:35.891684 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.891840 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403203456}
I20260709 12:17:35.894735 26548 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.896291 26144 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:35.895573 26548 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:35.897231 26236 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:35.898139 26236 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:35.900110 26236 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:35.899431 26548 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:35.807852 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:35.906769 26344 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:35.908823 26144 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.909374 26144 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.912676 26144 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:35.912938 26530 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:35.886301 24600 rpcz_store.cc:276] 0709 12:17:33.443684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.456965 (+ 13281us) service_pool.cc:224] Handling call
0709 12:17:33.654043 (+197078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.187626 (+533583us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.841710 (+1654084us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b54004fe054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:35.841977 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128237952}
I20260709 12:17:35.907707 26536 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:35.904372 26520 log.cc:927] Time spent T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 1.932s	user 0.008s	sys 0.011s
I20260709 12:17:35.904925 26548 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.935268 26029 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:35.935402 26548 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.935913 26029 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:35.937107 23993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1944) took 2721 ms. Trace:
I20260709 12:17:35.937476 23993 rpcz_store.cc:276] 0709 12:17:33.215647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.215757 (+   110us) service_pool.cc:224] Handling call
0709 12:17:33.225832 (+ 10075us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.867276 (+641444us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.936848 (+2069572us) spinlock_profiling.cc:243] Waited 534 ms on lock 0x7b5400311d54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:35.937040 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1227673344}
I20260709 12:17:35.938359 26029 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:35.812109 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1941) took 2597 ms. Trace:
I20260709 12:17:35.828488 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 867) took 1440 ms. Trace:
I20260709 12:17:35.939868 26548 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:35.945447 23992 rpcz_store.cc:276] 0709 12:17:33.214685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.217463 (+  2778us) service_pool.cc:224] Handling call
0709 12:17:33.223134 (+  5671us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.694218 (+471084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.811849 (+2117631us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400098b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:35.812038 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008138112}
I20260709 12:17:35.876802 26572 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:35.956221 26357 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:35.945166 24593 rpcz_store.cc:276] 0709 12:17:34.387728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.419011 (+ 31283us) service_pool.cc:224] Handling call
0709 12:17:34.468838 (+ 49827us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.540435 (+ 71597us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:34.964044 (+423609us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.968603 (+  4559us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:34.969403 (+   800us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:34.971047 (+  1644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.828217 (+857170us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54005d4654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:35.828270 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.828426 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1617,"prepare.queue_time_us":129980,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":158922,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":141,"spinlock_wait_cycles":61778816,"thread_start_us":225527,"threads_started":1}
I20260709 12:17:35.978106 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 865) took 1695 ms. Trace:
I20260709 12:17:35.978543 24598 rpcz_store.cc:276] 0709 12:17:34.282576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.282894 (+   318us) service_pool.cc:224] Handling call
0709 12:17:34.283187 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.283528 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:34.283557 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:34.288375 (+  4818us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.814366 (+1525991us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b180019b4c0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:17:35.964779 (+150413us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:35.964818 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.964883 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:35.977783 (+ 12900us) raft_consensus.cc:1685] finished
0709 12:17:35.977805 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.978041 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1849,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":13012,"spinlock_wait_cycles":12000512,"thread_start_us":150190,"threads_started":1,"wal-append.queue_time_us":1662779}
W20260709 12:17:35.983958 24594 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.520s	user 0.007s	sys 0.016s
W20260709 12:17:35.984380 24594 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.520s	user 0.007s	sys 0.016s
I20260709 12:17:35.985106 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 643) took 1781 ms. Trace:
I20260709 12:17:35.985471 24594 rpcz_store.cc:276] 0709 12:17:34.204004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.204427 (+   423us) service_pool.cc:224] Handling call
0709 12:17:34.215217 (+ 10790us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:34.215471 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:34.418048 (+202577us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.438536 (+ 20488us) log.cc:844] Serialized 14 byte log entry
0709 12:17:35.984717 (+1546181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:35.984781 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:35.984841 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.984917 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.985052 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":157502,"prepare.queue_time_us":946124,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":3650,"raft.queue_time_us":56626,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":1763,"thread_start_us":1693774,"threads_started":2}
I20260709 12:17:35.991834 26474 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:35.992208 24564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.509s	user 0.031s	sys 0.058s
W20260709 12:17:35.992487 24564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.509s	user 0.031s	sys 0.058s
I20260709 12:17:35.994105 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:35.994419 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:35.995019 24600 raft_consensus.cc:2410] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:17:35.995855 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:35.996205 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:35.996703 24599 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:35.996805 24593 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:35.993705 24594 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:35.995890 26341 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.037s	sys 0.046s
W20260709 12:17:35.998809 26341 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.037s	sys 0.047s
I20260709 12:17:36.000305 24564 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:36.001238 26474 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:36.005376 26474 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.006294 26420 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.006906 26575 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:36.008458 26474 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:36.008720 26575 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.010932 26575 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.011485 26420 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.013579 26420 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.014725 26574 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:36.015585 26574 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:36.008051 24594 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:36.016320 26574 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:36.016924 26454 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.017627 26574 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:36.018643 26580 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:36.019021 26580 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.019074 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:36.019419 24598 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:36.019920 26580 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.021140 26580 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:36.021481 26451 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.017424 26454 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.024585 26454 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.047339 23918 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:36.049383 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.038008 26555 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.050009 23987 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:36.052472 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:36.053025 23994 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.053234 26474 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.025610 23960 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.007490 26576 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:36.025658 23962 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.274s	user 0.002s	sys 0.010s
W20260709 12:17:36.067049 23962 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.315s	user 0.003s	sys 0.010s
I20260709 12:17:36.026778 26455 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.070566 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.071882 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.071172 23918 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:36.073495 24063 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:36.074437 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:36.028581 26461 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.028614 26577 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.017988 26574 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.027311 26304 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.036262 26357 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.022157 26451 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:17:36.082158 26357 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.037503 23993 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:36.082799 26574 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.084012 26574 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:36.084144 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.040050 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.085168 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.085435 23919 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:36.085757 24062 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:36.041208 23996 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:36.086555 23991 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:17:36.042966 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.087368 23915 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:36.046979 23921 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:36.074542 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.059628 23994 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:36.075924 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.076514 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.090862 24070 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:36.077378 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:36.091517 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.035547 26443 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.073838 24063 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.078605 26576 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.078922 26461 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:36.079775 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 43637.6us
I20260709 12:17:36.080312 23992 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:36.084323 26357 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:36.086912 23991 pending_rounds.cc:85] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 4
I20260709 12:17:36.074759 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.098757 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.095570 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.099696 23918 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:36.099874 23993 raft_consensus.cc:2410] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:36.098788 23991 pending_rounds.cc:107] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:17:36.100613 23991 raft_consensus.cc:2889] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:36.100925 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.096809 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.102202 24069 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:36.093158 24063 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.103196 23918 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:36.101985 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.103673 24063 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.104184 23994 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:36.072101 26364 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:36.106935 26364 raft_consensus.cc:697] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:36.107852 26364 consensus_queue.cc:237] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.109462 26461 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.111424 26474 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.072255 26447 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:17:36.115092 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.115700 23918 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:36.145800 24063 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:36.116480 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.151202 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:36.117003 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.152904 24068 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:36.090266 26577 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.117628 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.089788 26455 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.090258 26304 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.155460 26577 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:36.119766 26476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.013s	sys 0.011s
I20260709 12:17:36.156181 26304 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:36.156438 26476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.014s	sys 0.012s
I20260709 12:17:36.121058 23995 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:36.158478 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.127779 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.159178 23995 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:36.127813 26576 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:36.130465 26474 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.160082 23992 raft_consensus.cc:2393] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:36.160044 26474 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.161823 24566 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.132565 24069 raft_consensus.cc:3055] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:36.162513 24069 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.162621 26576 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:36.163062 26576 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.163466 26576 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.163297 24069 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.164263 24069 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.162184 26474 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:36.166908 23961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.462s	user 0.008s	sys 0.025s
W20260709 12:17:36.167233 23961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.462s	user 0.009s	sys 0.026s
I20260709 12:17:36.167603 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.168674 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.169672 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.170687 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.172416 26576 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.173597 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.175726 23995 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:36.178015 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.179634 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.136420 26578 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:36.187037 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:36.142635 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:36.193109 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.194571 23996 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:17:36.145758 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:36.196017 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 112954us
I20260709 12:17:36.196928 26458 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.098294 26443 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:36.203500 23962 connection.cc:256] RPC call timeout handler was delayed by -1.2167034260000946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 12:17:36.203923 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.204005 26443 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:36.204385 23962 connection.cc:256] RPC call timeout handler was delayed by -1.0136371700000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2295s for a response
I20260709 12:17:36.208612 23962 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:36.158674 26455 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:36.125910 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.211072 26505 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:36.211530 23987 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:36.211575 26505 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.212921 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:36.170791 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.147168 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.134573 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.213639 26505 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.214102 23919 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:36.171645 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:36.139804 23960 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:36.217734 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 77998.8us
I20260709 12:17:36.218668 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.219452 26455 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:36.219571 23960 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.219847 26455 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.220285 26455 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:36.220553 23887 leader_election.cc:336] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.558s (SENT)
I20260709 12:17:36.221021 26524 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:36.221624 26524 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.221982 26524 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.133867 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.222421 26297 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:36.219573 26448 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:36.184016 26576 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:36.200562 24061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 407) took 2065 ms (client timeout 1791 ms). Trace:
I20260709 12:17:36.223044 26297 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.223881 26513 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.214135 26505 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.224445 26513 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.224696 26505 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.225199 26297 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:36.225719 26297 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.223766 24061 rpcz_store.cc:269] 0709 12:17:34.134915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.137584 (+  2669us) service_pool.cc:224] Handling call
0709 12:17:36.200360 (+2062776us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b5400265554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:36.200490 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104871424}
W20260709 12:17:36.227210 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.196085 23996 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:36.227581 26560 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:36.227974 24034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.373s	user 0.056s	sys 0.157s
W20260709 12:17:36.228333 24034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.373s	user 0.057s	sys 0.157s
I20260709 12:17:36.228075 26560 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.223110 26448 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.211973 26454 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:36.227598 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.230080 26560 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.220997 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:36.247304 23887 leader_election.cc:336] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.564s (SENT)
I20260709 12:17:36.247918 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:36.249141 23887 leader_election.cc:336] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.601s (SENT)
I20260709 12:17:36.249635 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:36.235283 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.226835 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.197909 23995 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.232527 26578 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.265544 24034 leader_election.cc:400] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:36.265959 23960 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.243773 26454 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.226100 26297 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:36.335201 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 69321.1us
I20260709 12:17:36.345981 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.346074 23960 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:36.290927 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 143821us
I20260709 12:17:36.337626 24069 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:36.247020 26443 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:36.349033 26443 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.286327 26261 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:17:36.349452 26443 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.349511 26357 consensus_queue.cc:1059] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:36.345312 26333 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:36.350500 26357 raft_consensus.cc:3055] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:36.350652 26333 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.350966 26357 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.351109 26333 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.262774 26304 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:36.344563 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 81518.8us
I20260709 12:17:36.361558 23913 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:36.362161 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:36.309422 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.263290 26495 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:36.264884 26458 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:36.261790 26365 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 12:17:36.354800 23918 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:36.335175 26560 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.360211 24036 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.360678 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.266811 26525 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.346493 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:36.261775 26577 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:17:36.265173 26487 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:36.263583 26513 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.286576 26559 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:36.345254 26454 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:36.343182 26292 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:36.376819 23919 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:36.286369 26505 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.368899 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.286970 26576 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.372795 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.352774 26474 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.267194 26288 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 12:17:36.334625 26578 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:36.383687 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 134575us
I20260709 12:17:36.351868 26357 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.335355 26521 consensus_queue.cc:1059] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:17:36.342986 26561 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:17:36.396288 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.369469 26341 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:36.366472 26458 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.379383 26513 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.366456 26548 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:36.371907 26261 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:36.397828 23995 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:36.376300 26530 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:36.380160 26292 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:36.396492 24035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.442s	user 0.012s	sys 0.051s
W20260709 12:17:36.411450 24035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.457s	user 0.012s	sys 0.051s
I20260709 12:17:36.392419 26546 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:36.366721 26580 consensus_queue.cc:1059] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:17:36.372114 26536 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:17:36.372098 26487 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.392983 26505 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.382890 26100 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:17:36.374938 26525 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.404691 26458 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:36.399027 26341 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.390054 26576 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.405827 26560 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:36.412318 26400 raft_consensus.cc:3055] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:36.413829 26292 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:36.408732 26548 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.414976 26357 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.392239 26474 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.415665 26546 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.417366 26561 consensus_queue.cc:1243] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer 0829ddf18f07439086398756b9c6d216 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:36.401567 26495 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:17:36.432801 26261 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.431757 26341 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:36.412719 26513 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.450845 24035 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:36.447053 26521 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:36.436474 26560 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.442545 26580 raft_consensus.cc:3055] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:36.436199 26400 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.430052 26505 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.453262 26546 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:36.443156 26524 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.433056 26598 consensus_queue.cc:1059] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 12:17:36.488090 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 80878.6us
I20260709 12:17:36.463923 26448 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:36.474892 26595 log.cc:927] Time spent T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:36.537781 23913 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:36.538506 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.540187 23918 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:17:36.541656 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 179546us
I20260709 12:17:36.461762 26536 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:17:36.541749 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.481235 26513 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.479357 26487 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:36.543673 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.467118 26521 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:17:36.546958 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800131060 after lost signal to thread 22723
I20260709 12:17:36.544533 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:36.559245 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080021a4c0 after lost signal to thread 23853
I20260709 12:17:36.470355 26561 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:36.550175 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.550571 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.552577 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.567344 23995 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
W20260709 12:17:36.553020 23887 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.846s (SENT)
I20260709 12:17:36.554816 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.555361 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.556247 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:36.559188 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.568987 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:36.569303 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.549481 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.562561 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.571481 24063 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:36.572511 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.573793 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.562769 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.575160 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.563581 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:36.515228 26321 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:36.568140 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.577685 23913 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.484386 26599 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.098s
I20260709 12:17:36.578940 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:36.580276 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.580926 23917 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:36.581107 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1939) took 1675 ms. Trace:
I20260709 12:17:36.581444 23914 rpcz_store.cc:276] 0709 12:17:34.906034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.906184 (+   150us) service_pool.cc:224] Handling call
0709 12:17:35.856968 (+950784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:35.857206 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.857244 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:35.857300 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:35.857337 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.857411 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.580939 (+723528us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b54002ecf50. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:36.581057 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185759616}
I20260709 12:17:36.582785 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.583400 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:36.583650 23887 leader_election.cc:336] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.889s (SENT)
I20260709 12:17:36.583350 23914 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:36.584139 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:36.584671 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:36.468703 26560 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.587252 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:36.587276 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.588578 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.589586 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.591400 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.592170 24065 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:36.475500 26525 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:36.594595 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:36.594759 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:36.595793 23887 leader_election.cc:336] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.890s (SENT)
I20260709 12:17:36.545969 26297 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.596089 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:36.596603 23887 leader_election.cc:336] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.895s (SENT)
I20260709 12:17:36.596675 24065 raft_consensus.cc:2376] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7. Re-sending same reply.
I20260709 12:17:36.600688 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.579927 26521 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.603888 26521 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:36.557533 26365 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:17:36.608170 26448 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:36.580544 26400 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.610318 26400 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:36.610764 26596 log.cc:927] Time spent T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:17:36.479929 26261 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.591152 26561 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.558616 26536 consensus_queue.cc:1243] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer 71a48f59ff764d249519c6a53ec57f02 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:17:36.488139 26580 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:36.605779 26333 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.619100 26561 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.619386 26580 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.620584 26580 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.620795 26333 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.621371 26333 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:36.557950 26100 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:36.622373 26540 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:36.622639 26100 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.566933 26476 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:17:36.557804 26344 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.566795 26451 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:17:36.624725 26344 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.625473 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.586107 26321 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.566989 26487 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:36.626065 23914 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:36.595975 26288 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:36.630923 26288 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:36.631462 26288 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.632272 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.596252 26447 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:36.633019 24064 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:36.518438 26600 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:17:36.592518 26495 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.635069 26495 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.559836 26236 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.635967 26236 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.637179 26524 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.555088 26577 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:36.639847 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.641254 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.641916 23917 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:36.644163 24070 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.645184 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.634073 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.662334 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.630841 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.663429 23914 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:36.663870 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.675580 24034 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:36.666149 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.669829 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.681044 24566 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.670082 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.704592 24065 raft_consensus.cc:2368] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7.
I20260709 12:17:36.664362 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.693372 24062 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:36.695393 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.707439 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:36.707878 24566 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.752s (SENT) [suppressed 23 similar messages]
I20260709 12:17:36.706419 24063 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:36.710726 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:36.707886 23887 leader_election.cc:336] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.588s (SENT)
I20260709 12:17:36.714905 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:36.700665 24070 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
W20260709 12:17:36.703857 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.705402 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:36.708475 24064 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:36.717279 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:36.721202 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 165009us
I20260709 12:17:36.722954 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.723685 24564 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:36.724996 24065 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:36.730091 23914 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:36.732617 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 358124us
W20260709 12:17:36.733956 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 346605us
I20260709 12:17:36.673498 26451 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.734246 24564 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:36.684599 26576 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.737078 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:36.732386 23913 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:36.743110 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.744444 24064 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:36.717698 26297 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:36.745002 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:36.746083 23887 leader_election.cc:336] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.974s (SENT)
I20260709 12:17:36.747282 23914 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:36.747473 23917 pending_rounds.cc:85] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 2
I20260709 12:17:36.747799 23917 pending_rounds.cc:107] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:36.748054 23917 raft_consensus.cc:2889] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:36.748742 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.749485 26447 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:36.752424 26292 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.754344 26474 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:36.754962 26474 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:36.755345 26474 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.755738 26474 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.756907 26341 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.743207 26236 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:36.760103 26443 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.730443 26540 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.762224 26540 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.763670 26100 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:36.764700 26540 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.730651 26476 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:36.767228 26476 raft_consensus.cc:697] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:36.767729 26341 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.768227 26476 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.770483 26602 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:36.770946 26602 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.771294 26602 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:36.736917 26599 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:36.774515 26505 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:36.743373 26451 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.779170 24069 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:17:36.779667 24069 pending_rounds.cc:85] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 6
I20260709 12:17:36.779250 26546 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.779911 24069 pending_rounds.cc:107] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:17:36.780226 24069 raft_consensus.cc:2889] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:36.781430 26546 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:36.782441 24068 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
W20260709 12:17:36.782819 26455 consensus_meta.cc:287] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 12:17:36.783227 26455 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.785432 26455 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.658440 26487 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.788762 26487 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:36.789355 24066 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:36.790984 26597 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.346s	user 0.002s	sys 0.000s
I20260709 12:17:36.746922 26297 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.796522 26297 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:36.798943 23920 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:36.801342 26576 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:36.804224 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 67233.9us
I20260709 12:17:36.805059 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:36.809653 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.810863 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.811757 24066 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:36.814987 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.815603 23913 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.782054 26546 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:36.820607 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.825297 23914 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:36.824357 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 116494us
I20260709 12:17:36.841233 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.847221 23914 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
W20260709 12:17:36.848277 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 100794us
W20260709 12:17:36.849380 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 44410.2us
W20260709 12:17:36.850690 23887 leader_election.cc:336] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 2.100s (SENT)
I20260709 12:17:36.851150 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:36.851176 23887 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:36.851567 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.861306 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.861982 23988 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:36.865144 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.834528 26443 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.840790 26536 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:36.854816 23960 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:36.855983 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 113884us
I20260709 12:17:36.867161 26292 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:36.853250 23914 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:36.867139 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 132948us
I20260709 12:17:36.846741 26344 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:36.847524 26598 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:36.888231 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.886253 23913 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:36.894933 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.896072 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.897341 23991 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:36.893146 24564 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:36.897365 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.897950 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.899341 23996 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:36.900573 23913 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:36.901782 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:36.853024 26608 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:17:36.911309 23962 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:36.904793 23914 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:36.852908 26572 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.871106 24566 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.852648 26607 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:36.915023 24564 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:36.915263 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.916074 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:36.916899 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:36.921769 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 67013.6us
I20260709 12:17:36.920333 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:36.868098 26600 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.864816 26546 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:36.922676 23913 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:36.933444 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:36.934244 23913 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:36.935001 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.922677 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:36.924499 23960 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:36.914875 26454 consensus_meta.cc:287] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 12:17:36.926086 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:36.923290 26144 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:17:36.929611 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.931376 26600 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.937165 23914 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:36.909873 26603 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:36.871448 26536 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:36.937937 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.938738 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.926461 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.962141 23960 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:36.920542 26147 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:36.866676 26478 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:17:36.954838 23991 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:36.966126 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:36.926558 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:36.914572 26443 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 12:17:36.968057 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 97020.6us
I20260709 12:17:36.969748 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:36.974440 24065 raft_consensus.cc:2376] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7. Re-sending same reply.
I20260709 12:17:36.956512 26292 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.938060 26458 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.924453 26607 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:36.970618 26304 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:17:37.007354 26610 log.cc:927] Time spent T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:36.974931 26443 consensus_queue.cc:1243] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer a46beb8868d749fdbaa732dd1ef6b89b log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:37.012605 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.013204 26292 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:36.964442 26536 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:36.997933 26609 log.cc:927] Time spent T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:17:36.972388 26390 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:37.013942 26458 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:36.971791 26606 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:36.978681 26613 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:36.998103 26540 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:36.957064 26454 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.022856 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.022491 26304 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:37.025251 26574 raft_consensus.cc:3055] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:36.962042 26341 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:37.034384 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 119416us
I20260709 12:17:37.045260 26607 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.035568 26613 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:37.045523 26621 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:37.037104 26540 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.037806 26390 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:37.054841 26600 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:37.055325 26454 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:37.055712 26297 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.056370 26578 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.041697 26574 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:37.040371 26606 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:37.057487 26540 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.037899 26288 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.062659 26304 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.080448 26390 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.082885 26574 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.084354 26574 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.084952 26474 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:37.086681 26357 consensus_meta.cc:287] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.003s
I20260709 12:17:37.052470 26613 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.088349 26451 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.084491 26321 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.089511 26606 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:37.092970 26615 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.085s	user 0.000s	sys 0.003s
I20260709 12:17:37.077746 26602 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.107438 26602 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:37.108872 26613 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.111303 26613 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.111598 26540 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.113166 26540 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:37.103524 26560 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:37.104719 26594 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.622s	user 0.002s	sys 0.002s
I20260709 12:17:37.114856 26560 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:37.105340 26599 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:37.117033 26559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.019s	sys 0.030s
W20260709 12:17:37.117621 26559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.020s	sys 0.030s
I20260709 12:17:35.919440 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:36.959419 23914 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:37.155750 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 1938) took 2311 ms. Trace:
I20260709 12:17:37.159734 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:37.161101 23914 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.164646 23917 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:37.171445 23921 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:37.159591 23912 rpcz_store.cc:276] 0709 12:17:34.844387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.844578 (+   191us) service_pool.cc:224] Handling call
0709 12:17:34.856041 (+ 11463us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.856920 (+   879us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:34.856957 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.191063 (+1334106us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b2c0001b8d8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:17:36.191665 (+   602us) log.cc:844] Serialized 548 byte log entry
0709 12:17:36.410772 (+219107us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:36.410820 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.411402 (+   582us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.079437 (+668035us) spinlock_profiling.cc:243] Waited 6.15 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:37.154474 (+ 75037us) raft_consensus.cc:1685] finished
0709 12:17:37.154570 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.155252 (+   682us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28299904,"thread_start_us":218800,"threads_started":1,"wal-append.queue_time_us":256561}
I20260709 12:17:37.174557 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:37.180742 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:37.190670 23912 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:37.194772 23987 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 12:17:37.205801 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.207194 24069 raft_consensus.cc:2368] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5.
I20260709 12:17:37.207600 24064 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
W20260709 12:17:37.208304 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.209496 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:37.211652 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.212495 24065 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:37.213685 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.215358 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.215521 23988 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:37.216169 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:37.216531 24065 raft_consensus.cc:2410] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:37.217819 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.213645 24064 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.218786 26261 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.225072 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:37.225848 23917 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.226704 26288 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.229859 26578 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:37.053706 26341 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:37.252889 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:37.254555 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:37.256137 23917 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:37.249922 26261 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.259634 24065 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:37.260447 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:37.260737 24034 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:37.262401 26474 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.270766 26530 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:37.271580 26530 raft_consensus.cc:697] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:37.271734 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.273304 26333 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.273164 26530 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.274224 26478 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:37.274032 26333 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.271399 26341 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.271643 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:37.276970 26333 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:37.278334 26297 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.280107 26611 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:37.281765 26611 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:37.282205 26611 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:37.283639 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:37.284183 26611 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.284560 26536 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.285471 26611 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.246318 26613 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:37.289124 24036 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.290934 26342 consensus_queue.cc:1059] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:17:37.294426 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08000d7900 after lost signal to thread 23945
I20260709 12:17:37.296398 26261 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:37.300156 23989 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:37.302237 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 390) took 1130 ms. Trace:
I20260709 12:17:37.326475 23987 rpcz_store.cc:276] 0709 12:17:36.171933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.213123 (+ 41190us) service_pool.cc:224] Handling call
0709 12:17:36.228921 (+ 15798us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:37.195363 (+966442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.301838 (+106475us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b5400026f54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:37.302128 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2219473152}
I20260709 12:17:37.302326 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.328796 24598 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:37.303650 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.304733 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.332345 24593 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:37.306998 24600 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:37.255955 26292 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:37.316242 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:37.333820 23920 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:37.335680 23920 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:37.308457 26613 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.338536 26613 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.339664 26540 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.340552 26540 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.342805 23917 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:37.344074 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.344938 24069 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:37.345024 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:37.346982 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.346834 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:37.347491 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.348207 23921 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:17:37.352216 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.353230 24597 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:37.353686 26481 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:37.354902 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.355790 24595 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:37.357205 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:37.357385 26495 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.359194 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.360033 24594 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:37.317481 26559 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:37.361660 26559 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.362268 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:37.320065 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:37.323784 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080022ae00 after lost signal to thread 24020
I20260709 12:17:37.363449 23995 raft_consensus.cc:2393] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:37.363641 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08003477e0 after lost signal to thread 24021
I20260709 12:17:37.363960 24599 raft_consensus.cc:2393] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:37.364679 26559 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:37.366569 26476 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.367413 26476 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.333961 23989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 1954) took 1279 ms. Trace:
I20260709 12:17:37.372084 24599 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:37.346045 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.324098 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:37.365867 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.372243 24600 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:37.375392 23914 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:37.338816 26536 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:37.370232 26621 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.378120 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.378878 24592 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:37.378539 26621 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.380542 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.379472 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:37.381937 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.384131 24595 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:37.386861 26621 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.387756 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:37.370222 26476 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.390729 24064 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:37.394307 24597 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:37.394963 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.378876 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.395776 24599 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:37.395967 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.396840 24069 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:37.398113 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:37.398293 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 52984.8us
I20260709 12:17:37.399988 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.379597 26342 raft_consensus.cc:3055] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:37.401072 24069 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:37.401211 26342 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:37.402077 24593 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:37.402383 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.403477 24069 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:37.403358 26621 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:37.410533 26621 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.411144 26621 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.409976 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:37.412289 24069 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.406790 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.407218 24599 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:37.407955 24597 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:37.407883 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:37.373690 23989 rpcz_store.cc:276] 0709 12:17:36.047162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.299105 (+1251943us) service_pool.cc:224] Handling call
0709 12:17:37.299683 (+   578us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.325978 (+ 26295us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.326243 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.392899 26540 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:37.405969 24566 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:37.402772 26342 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.432864 24070 raft_consensus.cc:2410] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:17:37.434051 24591 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:37.434466 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.376634 26474 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:37.435873 23918 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.436022 24064 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:37.383201 26495 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.436710 23962 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:37.440999 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:37.441769 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 48280.5us
W20260709 12:17:37.445786 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.446094 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.438886 26100 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:37.444911 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:37.450166 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.445816 26342 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.455312 23995 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:37.453337 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:37.458364 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:37.462564 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 56740.8us
I20260709 12:17:37.463515 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.465168 26607 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:37.465719 26607 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.466080 26607 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:37.465135 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.472456 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.453027 26540 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:37.489547 26633 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:37.492708 26633 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:37.493901 26633 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.495194 26513 raft_consensus.cc:3055] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:37.495616 26513 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:37.449914 26474 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.482154 23916 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:17:37.496806 24064 raft_consensus.cc:2410] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:17:37.483572 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:37.484663 23886 connection.cc:256] RPC call timeout handler was delayed by -1.6276937279999402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 12:17:37.487357 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08003edfa0 after lost signal to thread 24094
I20260709 12:17:37.454696 26292 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:17:37.489550 24063 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:37.460039 26495 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.490212 23921 raft_consensus.cc:2393] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:17:37.497383 23886 connection.cc:256] RPC call timeout handler was delayed by -1.4750143380001646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 12:17:37.508775 23886 connection.cc:256] RPC call timeout handler was delayed by -1.0244777279999653s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21810000000000002s for a response
I20260709 12:17:37.510476 23886 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.511842 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.512665 26559 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:37.513335 26559 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:37.513671 26559 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:37.506932 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:37.514039 26559 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.515398 23886 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:37.516251 26448 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:37.516625 26297 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:37.517087 26627 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:37.517458 26599 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:37.517975 23886 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.516666 26448 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:37.519057 26448 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.523121 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:37.526772 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 61772.7us
I20260709 12:17:37.527631 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.508566 23914 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:37.531833 23914 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:37.529585 24591 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
W20260709 12:17:37.530471 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 69346.8us
I20260709 12:17:37.537955 24597 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:37.538365 26513 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.539647 26513 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:37.539800 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 169742us
I20260709 12:17:37.541671 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.542920 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.543681 24064 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:37.543843 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.455219 26476 consensus_queue.cc:1059] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 12:17:37.536417 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 247719us
I20260709 12:17:37.565174 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:37.544574 26599 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:37.588881 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.569159 26540 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:37.596128 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:37.589052 23886 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:37.601766 24070 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:37.620136 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:37.623202 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 143732us
W20260709 12:17:37.625739 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 62061.2us
I20260709 12:17:37.629419 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:37.632062 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:37.634094 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 81849.2us
I20260709 12:17:37.724380 24597 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.727392 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:37.729249 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08003b84e0 after lost signal to thread 24624
W20260709 12:17:37.730928 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:37.732355 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080033b4c0 after lost signal to thread 24625
I20260709 12:17:37.727044 23886 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
W20260709 12:17:37.734774 23919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 1916) took 1242 ms (client timeout 1579 ms). Trace:
I20260709 12:17:37.734862 23988 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:37.735239 23919 rpcz_store.cc:269] 0709 12:17:36.353310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.355264 (+  1954us) service_pool.cc:224] Handling call
0709 12:17:37.580015 (+1224751us) spinlock_profiling.cc:243] Waited 9.15 ms on lock 0x7b54001581d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:37.595781 (+ 15766us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21035776}
W20260709 12:17:37.738464 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 153742us
I20260709 12:17:37.739432 24036 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.742528 26292 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:37.743062 26292 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.743129 26598 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:37.743518 26292 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.743577 26598 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:37.744163 26598 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:37.745103 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 110070us
I20260709 12:17:37.745488 26611 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:37.746117 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:37.747020 26288 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:37.747548 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:37.747538 26288 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.748857 26288 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:37.751507 26572 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.752267 26623 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:37.752115 26572 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.752861 26623 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:37.753129 26600 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.151s
I20260709 12:17:37.753824 26495 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:37.754663 24067 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:37.754063 26623 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.732172 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.742619 26451 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.772007 23918 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:37.741854 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.772768 23917 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:37.773983 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 147614us
I20260709 12:17:37.630913 26540 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:37.632452 26530 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.785485 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:37.788164 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08001c6740 after lost signal to thread 26185
W20260709 12:17:37.791358 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.792137 23886 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.771477 23914 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.796093 24069 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:37.796224 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:37.797281 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:37.631652 26448 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.802395 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.782397 26611 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.809471 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.810170 24591 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:37.810438 24594 raft_consensus.cc:2393] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:37.795675 26100 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:37.788704 26613 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.799801 26600 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:37.821535 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:37.818665 23988 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:17:37.824076 26495 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:37.816558 26261 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.843223 23914 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:37.841248 26495 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:37.851742 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.843202 24596 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:37.819974 26600 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:37.858664 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 66628.1us
W20260709 12:17:37.862339 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 120643us
I20260709 12:17:37.852166 26603 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:37.857159 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:37.864251 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 416971us
W20260709 12:17:37.867266 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08001310e0 after lost signal to thread 26468
I20260709 12:17:37.819233 26621 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.879639 24069 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:17:37.879673 24591 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:37.881306 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080037ee60 after lost signal to thread 26486
W20260709 12:17:37.882776 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080028ed00 after lost signal to thread 26488
W20260709 12:17:37.883219 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 355686us
W20260709 12:17:37.883526 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800342580 after lost signal to thread 26516
W20260709 12:17:37.884054 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800323900 after lost signal to thread 26517
W20260709 12:17:37.884368 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080037b160 after lost signal to thread 26518
I20260709 12:17:37.884617 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:37.884649 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080014f6a0 after lost signal to thread 26522
W20260709 12:17:37.892339 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800100040 after lost signal to thread 26541
W20260709 12:17:37.893503 23850 debug-util.cc:398] Leaking SignalData structure 0x7b080023f060 after lost signal to thread 26545
W20260709 12:17:37.893980 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08003e56c0 after lost signal to thread 26554
I20260709 12:17:37.864862 26495 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.871569 26600 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.815894 26530 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.895464 24036 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:37.901430 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 142289us
I20260709 12:17:37.906899 26521 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:37.908224 26540 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.912539 26613 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:37.916016 26654 raft_consensus.cc:3055] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:37.916203 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.917236 24591 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:37.918372 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:37.918614 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.919999 26288 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.916589 26654 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:37.866588 26611 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:37.925010 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 46447.5us
I20260709 12:17:37.927372 23914 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:17:37.928440 24597 raft_consensus.cc:2410] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:37.926178 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.926604 23960 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:37.926613 23886 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.898343 26474 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:37.927671 23914 pending_rounds.cc:85] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 5
I20260709 12:17:37.931407 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:37.872104 26292 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.931897 24599 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:37.934062 26344 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:37.877723 26261 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.934849 24070 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
W20260709 12:17:37.938479 26643 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 12:17:37.939111 26548 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.940621 26548 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:37.943676 26611 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:37.948359 26530 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:37.948859 26100 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.949641 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.938179 24064 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:37.950438 24064 pending_rounds.cc:85] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 3
I20260709 12:17:37.950723 24064 pending_rounds.cc:107] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:37.950974 24064 raft_consensus.cc:2889] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:37.951339 26341 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:37.935195 26613 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:37.951830 26341 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:37.952144 26613 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:37.952370 26341 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.952642 26613 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:37.955277 26646 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:17:37.954998 26654 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:37.956194 26654 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:37.957073 26594 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:17:37.936950 24036 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.949426 26100 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:37.923085 26288 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:37.930946 23914 pending_rounds.cc:107] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:17:37.974112 23914 raft_consensus.cc:2889] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:37.974779 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 70312.1us
I20260709 12:17:37.959892 26333 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:17:37.983875 26560 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:37.984455 26649 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:17:37.985354 26297 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:37.985831 26297 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:37.985803 23886 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:37.986311 26297 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:37.985957 26560 consensus_queue.cc:1059] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:17:38.001008 23920 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:38.001159 26611 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:38.004506 26618 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:17:38.004634 23961 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:38.001051 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 67371us
I20260709 12:17:38.008021 26611 consensus_queue.cc:1059] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:38.009090 26611 raft_consensus.cc:3055] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:38.019075 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:38.020198 24597 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:37.986927 26448 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.022181 26448 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:38.022541 26448 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:38.022919 26448 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.023583 26365 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.036459 24593 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:37.985786 26637 log.cc:927] Time spent T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.337s	user 0.000s	sys 0.002s
I20260709 12:17:38.047359 23994 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:38.048686 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.049556 23988 raft_consensus.cc:2393] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:38.009438 26611 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:17:38.079412 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 130830us
W20260709 12:17:38.046067 26627 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
W20260709 12:17:38.086395 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.094488 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 144939us
W20260709 12:17:38.096298 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.096417 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 92063.6us
I20260709 12:17:38.098018 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.100515 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 1882) took 1099 ms. Trace:
I20260709 12:17:38.100973 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:38.100898 24065 rpcz_store.cc:276] 0709 12:17:37.001293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.217430 (+216137us) service_pool.cc:224] Handling call
0709 12:17:38.100344 (+882914us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b5400265f54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:38.100451 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91003648}
I20260709 12:17:38.101790 24600 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:38.102519 24065 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:38.106005 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1871) took 1177 ms. Trace:
I20260709 12:17:38.106398 24065 rpcz_store.cc:276] 0709 12:17:36.925628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.101904 (+1176276us) service_pool.cc:224] Handling call
0709 12:17:38.102246 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.102988 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.103195 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.108397 24593 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:38.117007 23961 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:38.119969 26288 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:38.120823 26288 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:38.122826 23916 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:38.122973 23914 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:38.123967 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.127345 26443 raft_consensus.cc:3055] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:38.127797 26443 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:38.128814 26443 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.131255 23920 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:38.132557 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:38.132705 26621 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:38.133136 23913 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.134301 26598 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.135742 26495 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.136829 23918 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:38.137739 26495 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.147754 23913 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
W20260709 12:17:38.149297 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 163571us
I20260709 12:17:38.112998 26292 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:38.154353 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.154855 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:38.154996 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:38.169888 24599 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
W20260709 12:17:38.155503 24062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 424) took 1587 ms (client timeout 1698 ms). Trace:
I20260709 12:17:38.155854 23995 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:38.156458 24597 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:17:38.156585 26448 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.157110 26478 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.157838 24600 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:38.155530 26261 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:38.158293 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1865) took 1231 ms. Trace:
I20260709 12:17:38.158461 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:38.180226 24593 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:38.158910 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.159162 26443 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:38.160772 26559 consensus_meta.cc:287] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.646s	user 0.005s	sys 0.009s
I20260709 12:17:38.161521 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.162494 26572 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.162776 26560 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.164973 26365 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:38.166628 26607 consensus_meta.cc:287] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.007s
W20260709 12:17:38.167066 26342 consensus_meta.cc:287] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.662s	user 0.004s	sys 0.015s
I20260709 12:17:38.166855 26625 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:38.168391 24070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 1660) took 1243 ms. Trace:
W20260709 12:17:38.170506 24062 rpcz_store.cc:269] 0709 12:17:36.562709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.563267 (+   558us) service_pool.cc:224] Handling call
0709 12:17:38.142522 (+1579255us) spinlock_profiling.cc:243] Waited 52.6 ms on lock 0x7b54001b7bd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:38.150265 (+  7743us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120873344}
W20260709 12:17:38.153620 26513 consensus_meta.cc:287] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.614s	user 0.007s	sys 0.011s
I20260709 12:17:38.207435 23886 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
W20260709 12:17:38.221879 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 287842us
I20260709 12:17:38.219818 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:38.234786 24595 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:38.224191 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 339690us
I20260709 12:17:38.224670 23919 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:38.225800 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:38.235657 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.236543 24566 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:38.236994 23989 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:38.232967 24070 rpcz_store.cc:276] 0709 12:17:36.925106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.726105 (+800999us) service_pool.cc:224] Handling call
0709 12:17:38.168225 (+442120us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400265554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:38.168336 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342034176}
I20260709 12:17:38.206099 23994 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:38.233191 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:38.248215 26657 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:17:38.249233 26540 consensus_queue.cc:1059] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:38.250288 26540 raft_consensus.cc:3055] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:38.250670 26540 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:38.251560 26540 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.252605 26598 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.252691 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:38.253367 24035 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:38.254027 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:38.254427 26448 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.254868 24062 raft_consensus.cc:2410] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:38.235020 26607 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.256132 24062 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:17:38.256448 24062 pending_rounds.cc:85] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 3
I20260709 12:17:38.256672 24062 pending_rounds.cc:107] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:17:38.256894 24062 raft_consensus.cc:2889] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:38.257481 24066 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.257581 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1876) took 1304 ms. Trace:
I20260709 12:17:38.230530 26100 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:38.259001 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:38.178670 24068 rpcz_store.cc:276] 0709 12:17:36.920914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.921023 (+   109us) service_pool.cc:224] Handling call
0709 12:17:36.921310 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.937631 (+ 16321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.937661 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.964127 (+ 26466us) log.cc:844] Serialized 26 byte log entry
0709 12:17:37.326001 (+361874us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:37.326591 (+   590us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.326869 (+   278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.138952 (+812083us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54002139d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:38.138997 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.139054 (+    57us) raft_consensus.cc:1685] finished
0709 12:17:38.146926 (+  7872us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.152497 (+  5571us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1706,"prepare.queue_time_us":1435,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":3488,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":6210,"spinlock_wait_cycles":35411712,"thread_start_us":317342,"threads_started":1,"wal-append.queue_time_us":429838}
I20260709 12:17:38.259865 24070 raft_consensus.cc:2393] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:38.251891 23818 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 2 to 6, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:38.248279 26661 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:38.262166 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.262571 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 55235.8us
I20260709 12:17:38.257923 24062 rpcz_store.cc:276] 0709 12:17:36.952725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.255530 (+1302805us) service_pool.cc:224] Handling call
0709 12:17:38.255829 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.257350 (+  1521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.257536 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.275362 24070 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:38.224457 26559 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.256891 26607 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:38.276268 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:38.275679 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:38.279489 24070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1662) took 1300 ms. Trace:
I20260709 12:17:38.281036 24070 rpcz_store.cc:276] 0709 12:17:36.975799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.267584 (+1291785us) service_pool.cc:224] Handling call
0709 12:17:38.275148 (+  7564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.275762 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.275956 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.268373 26513 raft_consensus.cc:2764] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:17:38.282176 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:38.282318 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 162292us
I20260709 12:17:38.284153 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.271498 26451 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:38.291091 23912 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:38.292809 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 147643us
I20260709 12:17:38.295699 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.296394 23988 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:38.296149 26341 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.248077 26478 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.299753 26478 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.300351 23993 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:38.302650 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:38.303867 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1870) took 1378 ms. Trace:
I20260709 12:17:38.304265 24069 rpcz_store.cc:276] 0709 12:17:36.925365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.882354 (+956989us) service_pool.cc:224] Handling call
0709 12:17:37.882802 (+   448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:37.914553 (+ 31751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:37.914585 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:37.915336 (+   751us) log.cc:844] Serialized 52 byte log entry
0709 12:17:38.216144 (+300808us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:38.216201 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.216295 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.303668 (+ 87373us) raft_consensus.cc:1685] finished
0709 12:17:38.303686 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.303813 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28528,"raft.queue_time_us":19187,"raft.run_cpu_time_us":430,"raft.run_wall_time_us":4814,"thread_start_us":262533,"threads_started":1,"wal-append.queue_time_us":385089}
W20260709 12:17:38.305560 26599 consensus_meta.cc:287] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.710s	user 0.016s	sys 0.007s
I20260709 12:17:38.305975 26599 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.278173 26292 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:38.306386 26653 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:17:38.295854 26559 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:38.318969 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 65139.4us
I20260709 12:17:38.328210 24036 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.329838 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1668) took 1125 ms. Trace:
I20260709 12:17:38.261673 26297 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.343041 23917 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:38.330291 24069 rpcz_store.cc:276] 0709 12:17:37.198643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.305850 (+1107207us) service_pool.cc:224] Handling call
0709 12:17:38.306152 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.322730 (+ 16578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:38.322767 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:38.322819 (+    52us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:38.322854 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.322914 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.323020 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.344305 24069 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:38.344960 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1669) took 1145 ms. Trace:
I20260709 12:17:38.345331 24069 rpcz_store.cc:276] 0709 12:17:37.199318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.343774 (+1144456us) service_pool.cc:224] Handling call
0709 12:17:38.344090 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.344713 (+   623us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.344902 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.347332 24066 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
W20260709 12:17:38.331322 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 233584us
I20260709 12:17:38.331609 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:38.318920 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:38.332580 26365 consensus_queue.cc:1059] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:17:38.338464 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 85188.1us
W20260709 12:17:38.353210 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 80223.1us
I20260709 12:17:38.322639 26292 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:38.356344 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1657) took 1432 ms. Trace:
I20260709 12:17:38.356725 24064 rpcz_store.cc:276] 0709 12:17:36.924320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.810041 (+885721us) service_pool.cc:224] Handling call
0709 12:17:37.857659 (+ 47618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.951523 (+ 93864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.356119 (+404596us) spinlock_profiling.cc:243] Waited 79.2 ms on lock 0x7b540004c754. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:38.356286 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":182249216}
I20260709 12:17:38.358419 23989 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.359668 26297 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:38.364063 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.366374 26292 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.367415 24598 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
W20260709 12:17:38.371101 24067 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 1646) took 2296 ms (client timeout 1728 ms). Trace:
W20260709 12:17:38.371490 24067 rpcz_store.cc:269] 0709 12:17:36.074442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.074547 (+   105us) service_pool.cc:224] Handling call
0709 12:17:38.370870 (+2296323us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54002125d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:38.371009 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3807039872}
I20260709 12:17:38.319717 26341 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:38.373363 24064 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:38.358506 24069 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:17:38.374482 24069 pending_rounds.cc:85] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 6
I20260709 12:17:38.374805 24069 pending_rounds.cc:107] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:17:38.375094 24069 raft_consensus.cc:2889] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:38.381590 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 53464.7us
I20260709 12:17:38.384232 24596 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:38.388944 24067 pending_rounds.cc:85] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 2
I20260709 12:17:38.389266 24067 pending_rounds.cc:107] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:17:38.389496 24067 raft_consensus.cc:2889] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:38.383955 26261 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.399449 26603 raft_consensus.cc:3055] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:38.400514 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1671) took 1188 ms. Trace:
I20260709 12:17:38.401103 24069 rpcz_store.cc:276] 0709 12:17:37.204090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.346234 (+1142144us) service_pool.cc:224] Handling call
0709 12:17:38.353382 (+  7148us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.391999 (+ 38617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.392236 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.402770 24064 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:38.420776 23961 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:38.409943 24036 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:38.421883 24069 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:38.422014 23989 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:38.423127 24064 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:38.422984 26600 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.426542 24566 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.427040 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.427543 24064 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:38.427820 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:38.428035 24566 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:38.417068 23962 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:38.428611 24598 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.384743 26540 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.428736 24069 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:17:38.429210 24069 pending_rounds.cc:85] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 4
I20260709 12:17:38.429428 24069 pending_rounds.cc:107] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:17:38.429335 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.429718 24069 raft_consensus.cc:2889] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:38.390712 26521 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:17:38.432025 24061 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:38.427767 26530 consensus_queue.cc:1059] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:38.433120 26530 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:38.433475 26530 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:38.434445 26530 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.435667 26530 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.372687 26653 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:38.441569 23920 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:38.443002 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:38.443853 23914 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.444455 24598 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:38.446832 26357 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.447759 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:38.447703 26357 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:38.448865 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 53112.1us
I20260709 12:17:38.449115 26599 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:38.447111 26548 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.455205 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:38.454761 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.449754 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.449563 26599 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:38.464202 26599 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.464706 26661 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.464979 26548 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.465463 26548 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.465623 26658 raft_consensus.cc:2764] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:38.468783 26576 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:38.469458 26576 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:38.471005 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.470695 26576 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.474155 26297 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:38.474676 26297 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:38.475129 26297 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.399910 26603 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:38.476852 26603 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.394193 26654 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:38.479082 26572 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:38.480432 26572 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:38.481045 26572 raft_consensus.cc:697] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:38.482494 26602 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:38.482863 26602 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:38.484061 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:38.483762 26602 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.485167 26602 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.486613 26559 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.487002 26559 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:38.487406 26559 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.488718 23886 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:38.492740 23914 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:38.498545 24035 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.329247 26623 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:17:38.500694 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.425843 26613 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.478188 26603 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.514637 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:38.517042 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 121501us
I20260709 12:17:38.426537 26600 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.488153 26478 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:38.526813 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.511971 26560 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:38.513993 26653 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:38.512168 26667 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:38.537066 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 107788us
I20260709 12:17:38.538044 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:38.524869 26495 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:38.525081 26478 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:38.541074 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 120430us
I20260709 12:17:38.541745 23961 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:38.511590 26627 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:17:38.511799 26513 consensus_queue.cc:1059] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:17:38.540721 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:38.554834 26667 raft_consensus.cc:697] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:38.555837 26667 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.556520 26292 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.502899 26572 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.560036 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:38.542613 26478 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:38.570708 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.572501 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.551767 26661 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.582911 23995 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:38.583006 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.583710 23989 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:38.572242 26451 raft_consensus.cc:2764] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:38.585772 26669 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:38.587522 24564 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:38.588436 26540 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:38.588950 26540 raft_consensus.cc:697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:38.589067 26611 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.589900 26540 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:38.591753 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.597894 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.599390 26357 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.600008 26357 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:38.565433 26657 raft_consensus.cc:2764] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:17:38.602289 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 69687us
I20260709 12:17:38.603231 24035 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.605530 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1663) took 1599 ms. Trace:
I20260709 12:17:38.605916 24062 rpcz_store.cc:276] 0709 12:17:37.006181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.271150 (+1264969us) service_pool.cc:224] Handling call
0709 12:17:38.286730 (+ 15580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:38.292312 (+  5582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:38.292342 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:38.306496 (+ 14154us) log.cc:844] Serialized 26 byte log entry
0709 12:17:38.498506 (+192010us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:38.498547 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.498617 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.603808 (+105191us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:38.605268 (+  1460us) raft_consensus.cc:1685] finished
0709 12:17:38.605289 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.605475 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24707,"raft.queue_time_us":5669,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":25829,"spinlock_wait_cycles":26000640,"thread_start_us":191647,"threads_started":1,"wal-append.queue_time_us":225369}
W20260709 12:17:38.608700 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.609917 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.611806 26653 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.612442 26261 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.613013 23916 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:38.600464 26357 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.615062 26357 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:38.615532 26654 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:38.616004 26654 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.617342 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.617187 26548 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:38.630052 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.646780 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:38.664297 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 44517us
W20260709 12:17:38.664476 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 47222.7us
I20260709 12:17:38.665481 24070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1665) took 1630 ms. Trace:
I20260709 12:17:38.580579 26513 consensus_queue.cc:1243] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer 71a48f59ff764d249519c6a53ec57f02 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:38.665897 24070 rpcz_store.cc:276] 0709 12:17:37.035041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.287431 (+1252390us) service_pool.cc:224] Handling call
0709 12:17:38.287846 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:38.302796 (+ 14950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:38.302828 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:38.303273 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:17:38.492096 (+188823us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:38.632062 (+139966us) log.cc:844] Serialized 14 byte log entry
0709 12:17:38.665152 (+ 33090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.665225 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.665260 (+    35us) raft_consensus.cc:1685] finished
0709 12:17:38.665270 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.665414 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81145,"prepare.queue_time_us":46271,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":4607,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":8562,"thread_start_us":293716,"threads_started":2,"wal-append.queue_time_us":261715}
I20260709 12:17:38.629674 26627 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:38.685595 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 111110us
I20260709 12:17:38.700904 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:38.702523 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.690846 23993 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:38.703851 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.669571 26658 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.698810 26530 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:38.663442 26297 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.710587 24566 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.714999 23961 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:38.686679 26292 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.687523 26627 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:38.724650 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:38.725214 23989 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:38.721225 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1661) took 1758 ms. Trace:
I20260709 12:17:38.726167 24068 rpcz_store.cc:276] 0709 12:17:36.962988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.260167 (+1297179us) service_pool.cc:224] Handling call
0709 12:17:38.291428 (+ 31261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:38.354374 (+ 62946us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:38.354416 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:38.378167 (+ 23751us) log.cc:844] Serialized 26 byte log entry
0709 12:17:38.687743 (+309576us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:38.687797 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.688969 (+  1172us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.720982 (+ 32013us) raft_consensus.cc:1685] finished
0709 12:17:38.721006 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.721154 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26579,"raft.queue_time_us":41141,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":199048,"threads_started":1,"wal-append.queue_time_us":317797}
I20260709 12:17:38.702732 26261 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:38.702910 26365 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:38.734478 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 171987us
I20260709 12:17:38.686358 26600 consensus_queue.cc:1059] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:17:38.711750 26288 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:38.798456 26288 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.799021 26288 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.800345 26611 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.736536 23962 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:38.804821 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 68403.2us
I20260709 12:17:38.805825 23962 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:38.785552 23912 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:38.780715 26292 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.814679 26292 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.816998 26292 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:38.818033 26672 log.cc:927] Time spent T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260709 12:17:38.820566 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 418) took 2260 ms. Trace:
I20260709 12:17:38.821090 24061 rpcz_store.cc:276] 0709 12:17:36.560535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.560643 (+   108us) service_pool.cc:224] Handling call
0709 12:17:36.560883 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.432390 (+1871507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.820018 (+387628us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540010e854. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:38.820445 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4301930368}
I20260709 12:17:38.778370 26261 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.821424 26657 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.821627 26341 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:38.826753 26261 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:38.787138 26564 consensus_queue.cc:1059] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:17:38.780239 26654 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.827944 26564 raft_consensus.cc:3055] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:38.828313 26564 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:38.828971 26654 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:38.829108 26564 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.780694 26686 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.787987 26670 consensus_queue.cc:1059] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.127s
W20260709 12:17:38.789420 26690 log.cc:927] Time spent T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:17:38.789739 26680 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:17:38.831431 26564 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:38.790525 26676 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.236s	user 0.004s	sys 0.000s
I20260709 12:17:38.733517 26540 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.790668 26606 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:38.833213 26548 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:38.790836 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 107768us
I20260709 12:17:38.834566 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:38.838414 24596 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:38.839686 26530 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:38.840178 26530 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.842548 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:38.843114 24594 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:38.843855 26297 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:38.844586 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 134077us
I20260709 12:17:38.794286 26633 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:38.786481 26487 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.839816 24597 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:38.808498 26495 raft_consensus.cc:3055] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:17:38.783651 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.862887 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:38.846172 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 52713.2us
I20260709 12:17:38.726053 26613 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:38.737671 26513 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:38.874480 23917 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:38.875608 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 151902us
I20260709 12:17:38.732888 26627 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:38.871310 23916 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:17:38.871651 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:38.868875 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:38.707477 26599 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.883247 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:38.883430 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:38.873272 23960 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:38.870918 26667 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:38.877087 23916 pending_rounds.cc:85] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 5
I20260709 12:17:38.881600 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:38.891992 23916 pending_rounds.cc:107] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:17:38.885464 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:38.892307 23916 raft_consensus.cc:2889] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:38.888893 24035 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.886250 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:38.891050 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:38.884712 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 57371.9us
I20260709 12:17:38.867245 26686 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:38.892343 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 227294us
I20260709 12:17:38.899791 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:38.900597 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:38.899295 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:38.905689 23920 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:38.907920 26666 consensus_queue.cc:1059] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:17:38.908612 26663 consensus_queue.cc:1059] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:17:38.909821 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:38.724189 26658 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:38.910823 26667 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.876446 26548 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.868468 26495 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:38.917892 24594 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:38.888948 26654 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:38.893347 26342 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:38.934084 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:38.936383 23914 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:38.876340 26540 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
W20260709 12:17:38.941226 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 64989.6us
I20260709 12:17:38.884265 26443 consensus_queue.cc:1059] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:17:38.938476 26560 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:38.888815 26661 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:17:38.874286 26633 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.934561 26654 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.931890 26292 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:38.959671 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 61934us
I20260709 12:17:38.947105 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:38.970716 23919 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:38.971736 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.913048 26333 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
W20260709 12:17:38.978703 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 78851.2us
I20260709 12:17:38.944550 26487 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:38.995467 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 98319.3us
I20260709 12:17:38.931161 26548 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:38.948167 26625 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:17:38.960141 26653 raft_consensus.cc:3055] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:38.963951 26657 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:38.998880 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1666) took 1963 ms. Trace:
I20260709 12:17:38.964162 26342 raft_consensus.cc:697] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:39.001441 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:38.981196 26654 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:39.004616 26623 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:39.012418 26304 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:17:39.012607 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:39.012920 26623 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:39.013327 23920 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:39.013733 26478 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.016057 26478 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:39.018386 26667 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:38.997385 26670 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:17:39.020750 26288 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.022387 26561 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:39.022228 26100 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:39.022948 26495 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.024936 23920 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:39.025476 23989 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:39.026532 26100 consensus_queue.cc:1059] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:39.026690 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.027522 26100 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:39.028131 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.028892 26478 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:39.028369 26100 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:39.030225 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.032374 26344 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:39.037071 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.037310 26599 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:39.030351 26478 consensus_queue.cc:1059] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:17:39.037735 24061 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:39.025774 26288 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:39.042203 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.042579 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:39.045284 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:39.005079 26653 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:39.050835 23917 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:39.052404 23916 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:39.052702 26524 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:39.055238 26606 consensus_queue.cc:1059] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:39.056855 26443 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:39.065001 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:39.058914 26692 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:17:39.060349 26633 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:39.060920 26559 consensus_meta.cc:287] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 12:17:39.058723 26704 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:39.068388 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:39.058017 26561 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:39.071931 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.098443 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.034797 26667 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:39.093551 26627 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:39.094440 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 65873.8us
I20260709 12:17:39.005275 24063 rpcz_store.cc:276] 0709 12:17:37.035311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.293632 (+1258321us) service_pool.cc:224] Handling call
0709 12:17:38.332694 (+ 39062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.332906 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:38.390042 (+ 57136us) log.cc:844] Serialized 14 byte log entry
0709 12:17:38.996068 (+606026us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:38.996117 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:38.996168 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.996242 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.998815 (+  2573us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":930,"prepare.queue_time_us":174217,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":3915,"raft.queue_time_us":1033,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2717,"spinlock_wait_cycles":1601280,"thread_start_us":533158,"threads_started":2}
I20260709 12:17:39.065335 26443 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:39.094921 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 88378.1us
I20260709 12:17:39.104143 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.109236 24564 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.097668 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.119801 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:39.098510 26613 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:39.064781 26530 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.127195 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.126904 24066 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:39.104398 26561 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:39.129866 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.138029 24061 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:39.138455 24063 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:39.011592 26657 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.089989 26686 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:39.013770 26623 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:39.135783 26658 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:39.094913 26607 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:17:39.120790 26540 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:39.158423 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.098502 26559 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.160807 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.161679 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:39.130753 26661 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:39.131304 26613 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.058916 26342 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:39.163910 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 45132.3us
I20260709 12:17:39.161993 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.168217 23887 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.170014 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.170717 23993 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:39.129258 26667 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:39.172531 24594 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:39.174002 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:39.174983 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:39.175508 24596 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:39.175962 26560 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:39.176836 23994 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:17:39.178898 26693 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:17:39.179857 26698 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:17:39.180229 26443 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.182579 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:39.169306 26633 consensus_queue.cc:1059] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:17:39.166201 26297 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:39.213842 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.184614 24593 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:17:39.192804 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:39.120867 26704 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:39.221297 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:39.218597 26292 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:39.223057 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:39.211867 26697 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:39.173290 26701 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:39.228842 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:39.221925 23887 leader_election.cc:336] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.737s (SENT)
I20260709 12:17:39.169427 26613 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:39.173082 26623 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.257019 26661 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:39.172780 26658 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:39.270732 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 96172.2us
I20260709 12:17:39.267591 23919 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
W20260709 12:17:39.281574 26603 consensus_meta.cc:287] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.001s
I20260709 12:17:39.293560 24066 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:39.212141 26530 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:39.265522 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.292089 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.256093 26559 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:39.283070 23916 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:39.294849 24067 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:39.271844 26548 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:39.284691 23915 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:39.286006 26675 raft_consensus.cc:3055] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:39.259563 26261 raft_consensus.cc:3055] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:39.309607 26261 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:39.308197 26686 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.310603 26261 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:39.311724 26261 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:39.313827 26675 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:39.289642 23913 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:39.274964 26443 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:39.296028 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.281852 26297 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:39.302455 26707 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:39.303093 26633 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:39.303846 26712 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:39.172535 26653 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.317271 24068 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:39.320479 26708 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:17:39.329114 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:39.317385 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:39.296653 26658 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.332417 26658 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:39.335263 26667 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:39.335826 26706 consensus_queue.cc:1059] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:17:39.336752 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1872) took 2410 ms. Trace:
I20260709 12:17:39.322419 26297 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.337723 26657 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:39.337381 24065 rpcz_store.cc:276] 0709 12:17:36.925841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.113538 (+1187697us) service_pool.cc:224] Handling call
0709 12:17:38.113913 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:38.149697 (+ 35784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:38.149738 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:38.162270 (+ 12532us) log.cc:844] Serialized 26 byte log entry
0709 12:17:38.239740 (+ 77470us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:38.239786 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.239845 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:39.335664 (+1095819us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b24001ef638. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bd9eb9c4 00007f75bd9e9acb 00007f75bdba4dc9 00007f75bdba4a55 00007f75bdba3fb0 00007f75c081a488 00007f75c081abe8 00007f75c07f2398 00007f75c07ed76a 00007f75c07ecbb6
0709 12:17:39.336394 (+   730us) raft_consensus.cc:1685] finished
0709 12:17:39.336421 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:39.336687 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36585,"raft.queue_time_us":35821,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":3417,"spinlock_wait_cycles":63184768,"thread_start_us":77097,"threads_started":1,"wal-append.queue_time_us":257028}
I20260709 12:17:39.339345 26297 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:39.336845 26443 raft_consensus.cc:3055] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:39.340363 26443 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:39.341229 26443 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:39.309154 26606 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:17:39.343132 26443 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.346738 26653 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:39.346297 26675 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.347913 26675 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:39.322772 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 112573us
W20260709 12:17:39.354948 23887 leader_election.cc:336] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.760s (SENT)
I20260709 12:17:39.355422 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:39.360908 24063 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:39.364624 24061 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:39.325623 26560 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:39.380252 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:39.395853 24061 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:39.385579 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:39.327925 26704 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:39.390750 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:39.389262 23887 leader_election.cc:336] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.960s (SENT)
W20260709 12:17:39.400833 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.397647 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.403419 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:39.406973 23993 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:39.378719 26667 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:39.296190 26661 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.405836 26478 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:39.405988 26658 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.433729 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:39.428687 24061 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:39.429601 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:39.412791 26627 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:39.442119 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 52915.9us
I20260709 12:17:39.444293 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.436498 24065 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:39.448199 24593 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:39.443946 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.429697 26448 raft_consensus.cc:3055] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:39.454056 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.456290 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:39.454455 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:39.456911 23887 leader_election.cc:336] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.982s (SENT)
I20260709 12:17:39.456979 24592 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:39.457556 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:39.458432 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.446080 26666 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:39.464147 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:39.531869 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 74982.3us
I20260709 12:17:39.464748 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.532670 24062 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:39.465682 24068 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:39.444994 26607 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:39.447253 26540 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:39.456768 26448 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:39.466902 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:39.466986 26100 raft_consensus.cc:3055] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:39.472461 24065 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:39.527915 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:39.562701 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 108322us
W20260709 12:17:39.571771 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:39.585501 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.446801 26658 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:39.593637 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 61090us
I20260709 12:17:39.596241 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:39.598459 24564 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:39.598994 24599 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:39.599704 26621 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:39.600008 26720 consensus_queue.cc:1059] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:39.613266 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.600574 26297 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:39.601269 26560 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:39.610098 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:39.654035 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.589078 26666 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.619320 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 1975) took 1008 ms. Trace:
I20260709 12:17:39.659022 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:39.648432 23992 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:17:39.452419 26654 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.654287 24597 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:39.527587 26713 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:39.660131 23989 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 2.
I20260709 12:17:39.659013 23915 rpcz_store.cc:276] 0709 12:17:38.611411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.615436 (+  4025us) service_pool.cc:224] Handling call
0709 12:17:38.615679 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.297920 (+682241us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.611079 (+313159us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b5400200654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:39.619253 (+  8174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310385536}
I20260709 12:17:39.671645 24598 raft_consensus.cc:1240] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:39.649791 26451 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:17:39.676020 26666 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:39.677404 24595 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:39.677929 26658 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:39.678364 26654 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:39.678716 26658 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:39.679220 26658 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.679541 26658 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.612389 26607 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.684422 26607 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:39.685225 26717 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:17:39.687333 26559 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:39.687825 26559 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:39.688859 26559 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.611047 26100 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:39.633932 26621 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:39.691608 26100 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.692468 26621 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.693311 26100 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.693810 26621 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:39.621169 26540 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.695654 26661 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:39.696305 26540 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:39.562143 26627 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:39.702795 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:39.527168 26613 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.712702 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:39.715497 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:39.705950 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.706825 26559 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:39.722716 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:39.724836 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 112462us
I20260709 12:17:39.737381 24592 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:39.710482 26627 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:39.741426 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:39.743040 24591 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:39.744058 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:39.744692 23993 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:17:39.747881 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.726450 26713 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:17:39.741690 26513 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:39.780594 26513 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:39.781484 26513 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:39.741614 26666 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:17:39.752503 26447 consensus_queue.cc:1059] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:17:39.758641 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.786988 23994 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:39.759275 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.765317 26292 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.751603 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:39.775000 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.793354 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:39.777328 24596 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:17:39.787712 23995 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:39.794320 24591 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
W20260709 12:17:39.793566 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.792835 24593 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:39.796264 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.799183 23993 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:39.799266 24591 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:39.803542 24566 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:39.804766 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:39.808063 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.797428 26513 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:39.822872 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:39.823892 23987 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:39.798449 26100 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:39.815008 26540 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:39.815868 26611 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:39.850101 26100 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:39.854799 26709 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.761s	user 0.005s	sys 0.006s
I20260709 12:17:39.817704 26713 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:39.858385 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:39.918666 26713 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:39.919026 24062 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:39.920344 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.921167 24062 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:39.859735 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.922818 24068 raft_consensus.cc:2368] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5.
I20260709 12:17:39.858376 24066 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:17:39.925200 26718 log.cc:927] Time spent T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:39.795680 26292 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:39.862974 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:39.851347 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:39.879987 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.850348 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:39.883261 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.884580 26707 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:39.885239 26613 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:39.886055 26100 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:39.940213 26705 raft_consensus.cc:3055] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:39.894724 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:39.933681 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.860591 26540 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:39.946642 26540 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:39.949295 23991 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:39.897617 26627 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:39.950301 26705 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:39.950582 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.951475 23993 raft_consensus.cc:2410] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:17:39.951323 26705 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:39.861615 26561 consensus_meta.cc:287] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.709s	user 0.004s	sys 0.006s
W20260709 12:17:39.953071 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 68129.2us
W20260709 12:17:39.922050 26667 consensus_meta.cc:287] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.002s
I20260709 12:17:39.954521 26667 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:39.954232 26540 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.926235 24597 raft_consensus.cc:2410] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:17:39.879664 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:39.955914 23994 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:39.956805 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:39.935688 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 337283us
I20260709 12:17:39.937124 24592 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:39.919878 26713 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.936622 26559 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:39.941461 23887 leader_election.cc:336] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 2.276s (SENT)
I20260709 12:17:39.961438 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:39.928980 26611 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:39.940990 24064 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:39.952893 26561 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.904856 26658 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.937969 24065 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:39.927911 26292 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:39.991001 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:39.994602 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 53175.2us
I20260709 12:17:39.994819 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:39.995671 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:39.998028 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:39.960152 26261 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.996894 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:40.004781 23915 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:39.998814 23920 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:40.006074 23921 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
I20260709 12:17:40.003646 26261 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.008561 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:39.994635 26292 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.012327 26292 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.012926 26611 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:40.010993 26559 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:40.014516 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:40.016182 26495 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:40.016637 23918 raft_consensus.cc:2393] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:39.994081 26667 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:40.020092 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.022954 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.024158 26658 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:40.024042 26722 consensus_queue.cc:1059] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:40.024703 26623 consensus_queue.cc:1059] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:40.024962 26627 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:40.025673 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:40.026211 23993 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.026531 26561 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:40.027357 26722 raft_consensus.cc:3055] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:40.027724 26722 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:40.028048 26297 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.028528 26297 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:39.992900 26576 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:17:40.025470 26627 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:40.031355 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:39.960258 26702 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:40.032424 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:40.032961 24061 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:40.034829 24063 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:40.025691 26623 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:40.050105 23921 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:40.051327 23913 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:40.054060 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:39.992713 26621 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:17:40.059362 26448 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.060750 26448 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.063546 24596 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 12:17:40.063784 26716 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:40.064249 26716 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:40.065346 26716 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:40.068109 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:40.069494 23962 leader_election.cc:400] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5.
I20260709 12:17:40.069754 23962 leader_election.cc:403] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:40.070266 26707 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:40.070912 26707 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5.
W20260709 12:17:40.082126 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.085494 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:40.086194 23919 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:40.088058 23987 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:40.087992 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:40.102173 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.109210 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.016222 26559 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:40.053282 26653 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:40.052701 26623 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:40.127310 23961 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:40.091125 26716 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.064280 23993 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:40.138903 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:40.140934 23919 raft_consensus.cc:2393] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:40.092864 26261 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:40.038177 26702 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:40.126914 26576 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:40.177989 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.182881 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:40.184816 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:40.185812 24065 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:40.187237 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:40.188923 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:40.190645 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:40.191526 24065 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:40.198242 24063 pending_rounds.cc:85] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 5
I20260709 12:17:40.198637 24063 pending_rounds.cc:107] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:17:40.198938 24063 raft_consensus.cc:2889] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:40.138144 26707 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:40.093416 26704 consensus_queue.cc:1059] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.075s
I20260709 12:17:40.130390 26292 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:40.142823 26288 raft_consensus.cc:3055] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:40.138767 26297 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:40.221149 26288 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:40.227381 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:40.228097 24595 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:40.229477 23886 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:40.230392 26297 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:40.230775 26297 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.231113 26297 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.130319 26560 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:17:40.263978 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:40.264768 24061 raft_consensus.cc:2393] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:40.264706 23919 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:40.137583 26653 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:40.138645 26447 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:17:40.199702 26261 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.275404 26390 raft_consensus.cc:3055] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:40.275494 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:40.265308 26292 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.278120 24061 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:40.207571 26627 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:40.216661 26707 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:40.300423 23919 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:40.302363 24061 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:40.293963 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:40.316087 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.201660 26576 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.307889 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:40.296226 26707 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.283777 26390 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:40.337766 23919 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
W20260709 12:17:40.343448 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 49559.2us
I20260709 12:17:40.283317 26261 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.326747 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:40.320011 26627 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:40.333185 23992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.038s	sys 0.055s
W20260709 12:17:40.312306 26730 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.016s	sys 0.056s
W20260709 12:17:40.354653 23992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.039s	sys 0.055s
W20260709 12:17:40.358690 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.360410 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.366659 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:40.368214 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:40.370219 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:40.372356 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:40.373116 24600 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:40.374639 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:40.381433 24597 raft_consensus.cc:2393] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:40.380393 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:40.385108 24034 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.002s	sys 0.021s
W20260709 12:17:40.386227 24034 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.002s	sys 0.021s
W20260709 12:17:40.388154 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.388900 26365 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.389465 26365 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:40.293469 26292 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.393352 23919 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:17:40.397593 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.345297 26540 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:40.358989 26730 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.016s	sys 0.057s
I20260709 12:17:40.386730 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:40.358072 26627 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:40.415861 24035 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:40.414450 23962 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:40.483036 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 68697.8us
I20260709 12:17:40.443216 26666 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.402702 24599 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:40.417788 23919 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:40.420011 23918 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:40.421283 24061 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.410687 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:40.422103 26365 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:40.424345 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:40.510304 23987 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:40.433066 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:40.401749 24595 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 5 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:40.438632 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:40.402510 26611 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:40.420382 26627 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:40.470112 26623 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.534989 26623 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:40.475164 26705 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.536296 23818 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:17:40.416072 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 71351.2us
I20260709 12:17:40.538831 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:40.538363 23818 catalog_manager.cc:5697] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 2 to 4, term changed from 2 to 4, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:40.539918 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:40.541410 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:40.540840 23818 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:40.543057 26576 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:40.542694 23818 catalog_manager.cc:5697] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 2 to 3, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:40.544934 26288 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.545044 23818 catalog_manager.cc:5697] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 2, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:40.446941 26390 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:40.521478 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:40.570858 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49490.6us
I20260709 12:17:40.574615 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:40.575346 23989 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:40.493680 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 77889.1us
I20260709 12:17:40.496667 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:40.447667 26561 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:40.514473 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:40.528482 23996 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:40.530757 23960 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:40.532174 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.613059 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.612957 23913 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
W20260709 12:17:40.577353 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.021s	sys 0.015s
W20260709 12:17:40.614878 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.021s	sys 0.018s
I20260709 12:17:40.615617 24035 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:40.558724 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:40.617050 23916 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:40.618845 23818 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 4, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 4 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:40.621074 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:40.621531 23994 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.020s	sys 0.040s
W20260709 12:17:40.621973 23994 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.020s	sys 0.040s
I20260709 12:17:40.609515 24061 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
W20260709 12:17:40.564395 26513 consensus_meta.cc:287] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.001s
I20260709 12:17:40.510058 26447 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:40.633693 23818 catalog_manager.cc:5697] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 6, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:40.554947 26702 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:40.577025 26540 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.566431 26341 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.549655 26667 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:40.549393 26559 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:40.645421 24566 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.009s	sys 0.033s
W20260709 12:17:40.610256 26606 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.028s	sys 0.060s
W20260709 12:17:40.647895 24062 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.005s	sys 0.059s
W20260709 12:17:40.647707 23917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.032s	sys 0.032s
I20260709 12:17:40.610455 26611 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:40.546209 26288 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.549966 26292 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:40.566073 26261 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:40.690812 23917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.041s	sys 0.032s
I20260709 12:17:40.549865 26560 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:40.519143 26700 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 12:17:40.653716 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:40.707504 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.547098 26653 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:40.647506 26713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.020s	sys 0.049s
W20260709 12:17:40.670352 24566 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.009s	sys 0.033s
I20260709 12:17:40.671811 26390 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:40.730674 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 595003us
I20260709 12:17:40.660732 26702 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:40.733668 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.670852 23818 catalog_manager.cc:5697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 5, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 5 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
W20260709 12:17:40.647650 26654 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.015s	sys 0.051s
I20260709 12:17:40.533193 26722 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:40.690508 24062 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.006s	sys 0.067s
I20260709 12:17:40.520115 26666 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.735776 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:40.736416 23989 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
W20260709 12:17:40.690544 26606 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.032s	sys 0.066s
I20260709 12:17:40.694245 26611 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.668339 26341 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:40.697806 26627 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.698310 26365 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:40.730420 26713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.021s	sys 0.049s
W20260709 12:17:40.702268 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 86862.5us
I20260709 12:17:40.767670 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:40.645211 26447 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:17:40.693639 24064 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.024s	sys 0.017s
W20260709 12:17:40.769308 24064 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.024s	sys 0.018s
I20260709 12:17:40.767755 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:40.746860 26448 consensus_meta.cc:287] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.686s	user 0.015s	sys 0.008s
I20260709 12:17:40.667184 26513 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:40.717622 24593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.004s	sys 0.016s
I20260709 12:17:40.667682 26561 raft_consensus.cc:697] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:40.714293 26559 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:40.738451 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 108675us
I20260709 12:17:40.740289 24061 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 3.
W20260709 12:17:40.747802 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.659960 26540 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.734983 23818 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:40.747285 26731 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:40.745918 26654 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.015s	sys 0.052s
I20260709 12:17:40.710582 26297 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.707407 26741 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:40.780874 24035 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:40.738366 24566 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:40.750638 26611 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.713999 26560 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:40.851334 26560 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.854158 26713 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:40.801456 24593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.004s	sys 0.016s
W20260709 12:17:40.711333 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.857916 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:40.858702 24600 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:40.860718 23961 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:40.862709 23988 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
W20260709 12:17:40.803336 24065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.013s	sys 0.022s
W20260709 12:17:40.863718 24065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.013s	sys 0.022s
I20260709 12:17:40.865890 23996 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
W20260709 12:17:40.867340 24068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.004s	sys 0.011s
I20260709 12:17:40.778870 26447 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:40.807713 23818 catalog_manager.cc:5697] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:40.811755 24035 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:40.878298 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 66604.1us
I20260709 12:17:40.880136 24035 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:40.812572 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 74277.1us
I20260709 12:17:40.814227 26292 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:40.815028 26739 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:17:40.815771 26716 consensus_meta.cc:287] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.649s	user 0.005s	sys 0.004s
I20260709 12:17:40.806284 26261 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
W20260709 12:17:40.781443 26495 consensus_meta.cc:287] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.763s	user 0.011s	sys 0.001s
I20260709 12:17:40.799306 26513 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.832137 26722 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:40.834288 26732 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:40.835703 26666 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:40.837344 26627 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:40.838204 26561 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.840835 26341 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:40.847914 26540 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:40.870890 24069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.027s	sys 0.025s
I20260709 12:17:40.881548 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:40.939253 24069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.028s	sys 0.025s
I20260709 12:17:40.893301 26744 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:40.939751 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 58318.4us
I20260709 12:17:40.940649 24566 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:40.805053 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:40.942629 24061 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:40.899006 26733 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:40.898996 23914 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:17:40.949681 23914 pending_rounds.cc:85] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 5
W20260709 12:17:40.899716 24067 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.018s	sys 0.039s
I20260709 12:17:40.949952 23914 pending_rounds.cc:107] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 4.6
W20260709 12:17:40.950167 24067 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.018s	sys 0.039s
I20260709 12:17:40.950224 23914 raft_consensus.cc:2889] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:40.885322 26598 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.570s	user 0.012s	sys 0.040s
I20260709 12:17:40.870783 26675 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:40.778450 26365 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:40.909060 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 459962us
W20260709 12:17:40.915829 24063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.020s	sys 0.038s
W20260709 12:17:40.955884 24063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.020s	sys 0.038s
W20260709 12:17:40.916765 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 358064us
I20260709 12:17:40.808271 26731 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:40.897565 26478 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:40.884608 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:40.952852 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 422154us
W20260709 12:17:40.983989 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 99492.8us
I20260709 12:17:40.985298 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:40.971426 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.952997 24566 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:40.954444 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:40.987455 24061 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:40.988230 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:40.985925 23962 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:40.953509 26598 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.644s	user 0.013s	sys 0.041s
I20260709 12:17:40.993353 23960 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:40.953321 26730 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:40.999313 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:41.002027 24061 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:41.002969 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:41.003021 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:40.993381 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1703) took 1100 ms. Trace:
I20260709 12:17:40.893560 26741 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:17:41.004189 24064 rpcz_store.cc:276] 0709 12:17:39.893002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.028403 (+135401us) service_pool.cc:224] Handling call
0709 12:17:40.028690 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.028871 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:40.769901 (+741030us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.993030 (+223129us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.993084 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:40.993135 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.993204 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.993322 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23050,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":848,"thread_start_us":962740,"threads_started":2}
I20260709 12:17:41.005645 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 412) took 1275 ms. Trace:
I20260709 12:17:40.955106 26675 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.904477 26737 consensus_queue.cc:1059] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 12:17:40.982204 26736 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:40.994376 26292 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:40.996155 26621 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:41.006563 23992 rpcz_store.cc:276] 0709 12:17:39.730686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.730812 (+   126us) service_pool.cc:224] Handling call
0709 12:17:39.732073 (+  1261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.737082 (+  5009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.737110 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.738779 (+  1669us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.355168 (+616389us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:40.355222 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.355312 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.005433 (+650121us) raft_consensus.cc:1685] finished
0709 12:17:41.005456 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.005574 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5234,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":2025,"thread_start_us":584541,"threads_started":1,"wal-append.queue_time_us":962652}
I20260709 12:17:40.997855 26576 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:41.001657 26341 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:41.001128 26716 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:40.983175 26540 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:41.042528 26365 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.020494 26627 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.048588 26716 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.021889 26675 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.048103 26576 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.055370 26576 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:41.048825 23817 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39282 (request call id 308) took 24580 ms (client timeout 15000 ms). Trace:
I20260709 12:17:41.020773 26770 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.089532 26770 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.092036 26770 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.092526 26770 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.093029 26770 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.049499 26777 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:41.098875 26777 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.099298 26777 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:41.103240 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.059988 24070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1693) took 1201 ms. Trace:
I20260709 12:17:41.106513 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.105754 24070 rpcz_store.cc:276] 0709 12:17:39.858204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.858942 (+   738us) service_pool.cc:224] Handling call
0709 12:17:39.859374 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:39.859732 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:39.859755 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:39.881405 (+ 21650us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.352515 (+471110us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:40.420758 (+ 68243us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.420989 (+   231us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.421095 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.059785 (+638690us) raft_consensus.cc:1685] finished
0709 12:17:41.059804 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.059929 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":64007,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":144840,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":17597,"thread_start_us":417817,"threads_started":1,"wal-append.queue_time_us":767179}
I20260709 12:17:41.107095 23916 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:41.111618 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.112267 23917 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:41.113163 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.113761 23919 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:41.053450 24061 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:41.062978 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.064191 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 370) took 2109 ms. Trace:
I20260709 12:17:41.129312 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.064769 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 680) took 1023 ms. Trace:
I20260709 12:17:41.129957 24061 raft_consensus.cc:2376] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6. Re-sending same reply.
W20260709 12:17:41.058601 23817 rpcz_store.cc:269] 0709 12:17:16.204671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:16.209014 (+  4343us) service_pool.cc:224] Handling call
0709 12:17:40.779894 (+24570880us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:27.725851 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:27.883447 (+157596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:27.890353 (+  6906us) write_op.cc:435] Acquired schema lock
0709 12:17:27.890379 (+    26us) tablet.cc:662] Decoding operations
0709 12:17:27.891293 (+   914us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:27.891386 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:27.891419 (+    33us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:17:27.892140 (+   721us) tablet.cc:701] Row locks acquired
0709 12:17:27.892182 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:17:27.892373 (+   191us) write_op.cc:270] Start()
0709 12:17:27.892530 (+   157us) write_op.cc:276] Timestamp: P: 1783599447892307 usec, L: 0
0709 12:17:27.892550 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:17:27.955461 (+ 62911us) log.cc:844] Serialized 2059 byte log entry
0709 12:17:29.224536 (+1269075us) spinlock_profiling.cc:243] Waited 7.68 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:29.574149 (+349613us) op_driver.cc:464] REPLICATION: finished
0709 12:17:29.837672 (+263523us) write_op.cc:301] APPLY: starting
0709 12:17:29.856055 (+ 18383us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:29.871345 (+ 15290us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:29.871386 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:29.872188 (+   802us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:29.872499 (+   311us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:17:29.872541 (+    42us) write_op.cc:312] APPLY: finished
0709 12:17:29.872865 (+   324us) log.cc:844] Serialized 47 byte log entry
0709 12:17:29.873042 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:29.873150 (+   108us) write_op.cc:454] Released schema lock
0709 12:17:29.873307 (+   157us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:29.873715 (+   408us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:29.873747 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":733714,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":147185,"apply.run_cpu_time_us":2835,"apply.run_wall_time_us":51526,"num_ops":5,"prepare.queue_time_us":251756,"prepare.run_cpu_time_us":27182,"prepare.run_wall_time_us":384323,"raft.queue_time_us":89669,"raft.run_cpu_time_us":36879,"raft.run_wall_time_us":76170,"replication_time_us":1681407,"spinlock_wait_cycles":17653504,"thread_start_us":396638,"threads_started":4,"wal-append.queue_time_us":361440,"wal-append.run_cpu_time_us":14601,"wal-append.run_wall_time_us":2699763}]]}
I20260709 12:17:41.070427 26738 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.031360 26621 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.074359 26365 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:41.080410 26765 log.cc:927] Time spent T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:41.082368 26731 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.001482 26666 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
W20260709 12:17:41.088994 26707 consensus_meta.cc:287] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.731s	user 0.006s	sys 0.003s
I20260709 12:17:41.132606 26602 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.049278 26292 raft_consensus.cc:697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:41.133613 26606 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.045424 26702 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:17:41.154893 26621 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.029183 26700 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:17:41.158017 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.158561 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:41.050369 26341 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:41.159606 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:41.162184 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 121743us
I20260709 12:17:41.211972 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.163385 26675 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.166692 26667 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:41.166900 26495 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:41.154534 26738 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.150309 26653 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.169569 26769 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.170364 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:41.060411 26716 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:41.130163 24593 rpcz_store.cc:276] 0709 12:17:40.041062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.041179 (+   117us) service_pool.cc:224] Handling call
0709 12:17:40.062626 (+ 21447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.092578 (+ 29952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.092623 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.131602 (+ 38979us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.855333 (+723731us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:40.855390 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.855478 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.064572 (+209094us) raft_consensus.cc:1685] finished
0709 12:17:41.064591 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.064713 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29468,"raft.queue_time_us":30224,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":33773,"thread_start_us":673980,"threads_started":1,"wal-append.queue_time_us":841807}
W20260709 12:17:41.175951 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.176996 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 185693us
I20260709 12:17:41.150427 26448 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.129403 23914 rpcz_store.cc:276] 0709 12:17:38.954769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.955010 (+   241us) service_pool.cc:224] Handling call
0709 12:17:38.989481 (+ 34471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.960750 (+1971269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.063943 (+103193us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b5400224054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:41.064134 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4390350080}
I20260709 12:17:41.151870 26627 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:41.222703 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 87574.8us
I20260709 12:17:41.214965 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:41.217379 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.224630 24595 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:41.224640 23960 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:41.150586 26741 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.221444 24566 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:41.202951 26297 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.215022 26341 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:41.197474 26737 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.235226 23960 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:41.235603 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.239920 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.172173 26365 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:41.235941 24566 leader_election.cc:336] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.698s (SENT)
I20260709 12:17:41.243505 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.170827 26576 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.242007 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:41.218851 26559 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:41.197045 26707 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.240455 24070 raft_consensus.cc:2376] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8. Re-sending same reply.
I20260709 12:17:41.196977 26602 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.222328 26100 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:41.231248 26627 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.226527 26704 raft_consensus.cc:3055] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:41.229749 26448 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.251614 26738 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.252247 26292 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.229398 26653 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.253628 26559 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:41.225780 26667 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.258209 24595 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:41.226869 26513 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.264810 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.206574 26606 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.270224 26598 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:41.277467 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.242841 26731 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:41.257999 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.262555 26288 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:41.320096 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.230926 26495 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.320852 24065 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:41.318572 24070 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:41.320040 23886 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:41.323457 26731 raft_consensus.cc:697] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
W20260709 12:17:41.324333 26774 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:41.324927 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 447) took 1130 ms. Trace:
I20260709 12:17:41.324625 26731 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.325289 24063 rpcz_store.cc:276] 0709 12:17:40.194916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.197647 (+  2731us) service_pool.cc:224] Handling call
0709 12:17:40.198021 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.266312 (+ 68291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.266353 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.266895 (+   542us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.956455 (+689560us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:40.956509 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.956630 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.324733 (+368103us) raft_consensus.cc:1685] finished
0709 12:17:41.324757 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.324876 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":644579,"threads_started":1,"wal-append.queue_time_us":982352}
I20260709 12:17:41.326745 26559 raft_consensus.cc:697] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:41.327772 26559 consensus_queue.cc:237] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.329160 24064 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:41.329255 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1695) took 1438 ms. Trace:
I20260709 12:17:41.329780 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1708) took 1026 ms. Trace:
W20260709 12:17:41.330791 26764 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:17:41.331640 26530 raft_consensus.cc:3055] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:41.332052 26530 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:41.332921 26530 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.334765 26733 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:41.335146 26733 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:41.335835 26733 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.336339 26667 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.337009 26733 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.338001 26365 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.373728 26716 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.375111 26606 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.229061 26769 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.261998 26737 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.376395 26716 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.379062 24061 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:41.339689 26707 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.340034 23992 raft_consensus.cc:2393] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:41.340265 26730 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:41.245645 26741 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.342805 26495 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.342845 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 570) took 1316 ms. Trace:
I20260709 12:17:41.343964 26602 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.320564 26288 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.346534 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1702) took 1453 ms. Trace:
I20260709 12:17:41.347076 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1698) took 1455 ms. Trace:
W20260709 12:17:41.436877 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 546201us
I20260709 12:17:41.274478 26704 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:41.353309 24065 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:41.439013 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 451) took 1145 ms. Trace:
I20260709 12:17:41.439400 24065 rpcz_store.cc:276] 0709 12:17:40.293606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.352726 (+1059120us) service_pool.cc:224] Handling call
0709 12:17:41.353002 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.438762 (+ 85760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.438958 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.330127 24064 rpcz_store.cc:276] 0709 12:17:40.305963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.328557 (+1022594us) service_pool.cc:224] Handling call
0709 12:17:41.328831 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.329549 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.329732 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.385177 24592 rpcz_store.cc:276] 0709 12:17:40.026924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.030938 (+  4014us) service_pool.cc:224] Handling call
0709 12:17:40.031274 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.031597 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.031624 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.037730 (+  6106us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.543590 (+505860us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b18003abe80. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:17:40.989707 (+446117us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:40.989761 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.989848 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.342565 (+352717us) raft_consensus.cc:1685] finished
0709 12:17:41.342585 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.342772 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9096,"raft.queue_time_us":10659,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1318,"spinlock_wait_cycles":5172992,"thread_start_us":445835,"threads_started":1,"wal-append.queue_time_us":1259179}
I20260709 12:17:41.359092 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.441315 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.441874 23916 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:41.360018 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:41.441915 24064 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:41.443480 23920 raft_consensus.cc:2393] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 3: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:41.443730 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.437849 24035 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.444322 23960 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:41.444912 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 208923us
I20260709 12:17:41.437081 24068 rpcz_store.cc:276] 0709 12:17:39.891583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.923538 (+ 31955us) service_pool.cc:224] Handling call
0709 12:17:39.923935 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.321447 (+397512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.321492 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.322078 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.877912 (+555834us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:40.922266 (+ 44354us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.935188 (+ 12922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.935260 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.346887 (+411627us) raft_consensus.cc:1685] finished
0709 12:17:41.346905 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.347014 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20207,"prepare.queue_time_us":149950,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":119918,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":40190,"thread_start_us":916231,"threads_started":2,"wal-append.queue_time_us":1000999}
I20260709 12:17:41.329628 24069 rpcz_store.cc:276] 0709 12:17:39.890527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.890713 (+   186us) service_pool.cc:224] Handling call
0709 12:17:39.891128 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.214239 (+323111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.214269 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.293819 (+ 79550us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.939685 (+645866us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:41.212360 (+272675us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.213231 (+   871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.213328 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.329068 (+115740us) raft_consensus.cc:1685] finished
0709 12:17:41.329085 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.329204 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143199,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":34,"raft.queue_time_us":124306,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":8613,"thread_start_us":1124893,"threads_started":3,"wal-append.queue_time_us":991715}
I20260709 12:17:41.262149 26297 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
W20260709 12:17:41.370919 26611 consensus_meta.cc:287] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.000s
I20260709 12:17:41.317476 26770 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:41.334775 26775 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:17:41.372056 26448 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.373551 26627 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.380641 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.464901 23913 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
W20260709 12:17:41.382261 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 97960.2us
I20260709 12:17:41.383487 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1700) took 1491 ms. Trace:
I20260709 12:17:41.383584 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:41.278046 26390 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:41.457993 24070 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:41.450335 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:41.458402 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:41.370924 26653 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.470142 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:41.381951 26736 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:41.523654 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:41.523824 24595 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 12:17:41.523358 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 65877.2us
W20260709 12:17:41.462514 24566 leader_election.cc:336] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.845s (SENT)
I20260709 12:17:41.391203 26767 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:17:41.525017 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54975.6us
I20260709 12:17:41.467015 24066 rpcz_store.cc:276] 0709 12:17:39.892156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.925338 (+ 33182us) service_pool.cc:224] Handling call
0709 12:17:39.925726 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.615379 (+689653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.615426 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.633016 (+ 17590us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.936323 (+303307us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:40.936370 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.945524 (+  9154us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b540021cd54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:40.945567 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.378499 (+432932us) raft_consensus.cc:1685] finished
0709 12:17:41.378520 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.383429 (+  4909us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78734,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"spinlock_wait_cycles":21613312,"thread_start_us":924487,"threads_started":2,"wal-append.queue_time_us":580989}
W20260709 12:17:41.533918 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 71431.1us
I20260709 12:17:41.534440 23962 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:41.535539 23962 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:41.468953 23918 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:41.436951 24067 rpcz_store.cc:276] 0709 12:17:39.892724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.928044 (+ 35320us) service_pool.cc:224] Handling call
0709 12:17:39.928370 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.297617 (+369247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.297663 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.310115 (+ 12452us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.950586 (+640471us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:41.218498 (+267912us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.218905 (+   407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.218977 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.346341 (+127364us) raft_consensus.cc:1685] finished
0709 12:17:41.346360 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.346475 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40012,"prepare.queue_time_us":132527,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":53,"raft.queue_time_us":89239,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":6589,"thread_start_us":1134708,"threads_started":3,"wal-append.queue_time_us":997584}
I20260709 12:17:41.537081 24065 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:41.525250 24599 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:41.534663 24566 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:41.446659 26288 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.567373 24070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 454) took 1230 ms. Trace:
I20260709 12:17:41.446511 26667 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.382865 26598 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.568958 24070 rpcz_store.cc:276] 0709 12:17:40.294434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.352658 (+1058224us) service_pool.cc:224] Handling call
0709 12:17:41.391778 (+ 39120us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.524417 (+132639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.524616 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.580905 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.576181 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:41.458387 26602 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:41.461757 26365 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:41.585441 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.523783 26390 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.533004 26540 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.588804 24068 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:41.566143 26606 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:41.600087 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:41.600520 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:41.590087 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 372770us
I20260709 12:17:41.591169 24035 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.601397 24067 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:41.573518 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:41.594141 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 59552.6us
I20260709 12:17:41.595484 24066 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:17:41.602528 24066 pending_rounds.cc:85] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 5
I20260709 12:17:41.602834 24066 pending_rounds.cc:107] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:17:41.603127 24066 raft_consensus.cc:2889] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:41.603972 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1710) took 1297 ms. Trace:
I20260709 12:17:41.604358 24066 rpcz_store.cc:276] 0709 12:17:40.306626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.534450 (+1227824us) service_pool.cc:224] Handling call
0709 12:17:41.584374 (+ 49924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.603691 (+ 19317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.603909 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.575742 26261 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:41.601766 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 53403.5us
I20260709 12:17:41.613396 24035 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.570335 26722 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:41.464444 26100 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.126s
I20260709 12:17:41.596125 26390 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:41.601744 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:41.608958 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1709) took 1302 ms. Trace:
I20260709 12:17:41.644193 24068 rpcz_store.cc:276] 0709 12:17:40.306341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.528660 (+1222319us) service_pool.cc:224] Handling call
0709 12:17:41.578580 (+ 49920us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.608726 (+ 30146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.608902 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.599876 26606 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.575563 26740 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.582906 26767 raft_consensus.cc:697] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:41.566403 26653 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:17:41.586915 26560 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.586966 26625 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:41.464267 26341 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.462049 26611 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.592176 26365 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.577023 26730 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:41.594473 26448 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:41.646894 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45223.8us
I20260709 12:17:41.543154 26736 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.539131 26786 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:41.610018 26700 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.644570 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:41.579780 26667 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.613492 26513 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.641738 26743 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.672865 24065 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:41.644071 26602 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:41.673655 23918 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:41.675185 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 1913) took 1260 ms. Trace:
I20260709 12:17:41.702847 24061 rpcz_store.cc:276] 0709 12:17:40.414662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.130586 (+715924us) service_pool.cc:224] Handling call
0709 12:17:41.674990 (+544404us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b540021be54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:41.675127 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394393856}
I20260709 12:17:41.681260 26365 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.648546 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.660764 26606 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:41.662207 26297 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:41.528317 26780 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:41.710037 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.689659 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.609373 26540 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.617304 26261 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.676151 26789 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:41.665714 26763 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.680130 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.739725 26763 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:41.740686 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 60635.4us
I20260709 12:17:41.741813 26763 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.682997 26675 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.706050 26513 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.743400 26627 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:41.682821 26576 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.744480 26576 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.744814 26513 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.744961 26576 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.718521 26769 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.746425 26741 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.705488 26448 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.747085 26576 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.701242 26700 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.748653 26448 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.674803 26560 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.749521 26700 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.726115 26261 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:41.750406 26777 consensus_meta.cc:287] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.002s
I20260709 12:17:41.750959 26560 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.750802 26777 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:41.753337 26447 consensus_meta.cc:287] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.866s	user 0.011s	sys 0.000s
I20260709 12:17:41.753707 26447 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.755360 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.755553 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.729847 26736 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.674625 26625 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.758378 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.758607 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 459) took 1462 ms. Trace:
I20260709 12:17:41.642644 26704 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.759498 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.720530 24070 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:41.760154 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.760445 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.760779 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.730716 26767 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:41.762733 26787 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:17:41.691119 26730 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.765100 26792 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.765714 26792 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:41.766777 26788 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:17:41.767079 26730 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.748672 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1697) took 1857 ms. Trace:
I20260709 12:17:41.761159 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.769410 23989 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:41.770150 26792 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.725955 26611 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.768131 24062 rpcz_store.cc:276] 0709 12:17:39.891273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.921913 (+ 30640us) service_pool.cc:224] Handling call
0709 12:17:39.935252 (+ 13339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:40.734781 (+799529us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.734809 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:40.745947 (+ 11138us) log.cc:844] Serialized 52 byte log entry
0709 12:17:40.993547 (+247600us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:41.059343 (+ 65796us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.060160 (+   817us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.117190 (+ 57030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.117276 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.748461 (+631185us) raft_consensus.cc:1685] finished
0709 12:17:41.748481 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.748617 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":133878,"prepare.queue_time_us":113559,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":139475,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":19367,"thread_start_us":1009808,"threads_started":2,"wal-append.queue_time_us":412365}
I20260709 12:17:41.771446 26792 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:41.771916 26341 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.771991 26792 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.707542 26794 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.776860 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.778342 23914 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:41.738579 26789 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:41.759043 24063 rpcz_store.cc:276] 0709 12:17:40.295847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.326589 (+1030742us) service_pool.cc:224] Handling call
0709 12:17:41.326910 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:41.380039 (+ 53129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.380069 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:41.384159 (+  4090us) log.cc:844] Serialized 26 byte log entry
0709 12:17:41.597578 (+213419us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:41.640459 (+ 42881us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.640684 (+   225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.640759 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.758415 (+117656us) raft_consensus.cc:1685] finished
0709 12:17:41.758433 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.758551 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52749,"prepare.queue_time_us":42714,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":12466,"raft.queue_time_us":58422,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":17920,"thread_start_us":54859,"threads_started":1,"wal-append.queue_time_us":217926}
I20260709 12:17:41.789861 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:41.790344 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.791543 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.792284 24065 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:41.758545 26625 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.785780 26738 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.799163 26738 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:41.800415 26621 consensus_meta.cc:287] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.581s	user 0.009s	sys 0.000s
I20260709 12:17:41.800834 26621 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.801271 26738 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.801908 24598 raft_consensus.cc:2368] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:41.808861 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.810364 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.811571 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.812171 24063 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:41.816183 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:41.817858 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:41.837946 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.841320 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.842157 24065 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:41.845999 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.721269 26297 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:41.721614 26737 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.760185 26704 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:41.752768 26777 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:41.847155 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 56918.2us
I20260709 12:17:41.789346 26602 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:41.802680 26560 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:41.839497 26625 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:41.874739 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 271472us
I20260709 12:17:41.818120 26448 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.688604 26740 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.854897 26769 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:41.877532 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.755595 26447 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:41.892213 23887 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.875280 26790 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.880373 26341 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.900215 26627 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:41.886833 26730 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.721374 26780 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.905896 23887 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:41.889479 26738 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.914417 26513 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:41.918941 23918 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:41.802175 26794 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.926674 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.887986 26560 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.899024 26777 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:41.922752 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.924808 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.947208 23916 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:41.948292 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.914927 26730 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:41.927913 26793 log.cc:927] Time spent T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:17:41.924062 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.950600 23913 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:41.935218 23912 raft_consensus.cc:1240] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:41.937095 26808 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:41.938335 26803 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:17:41.948938 23916 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:41.938722 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.933436 24593 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:41.885219 26602 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.928349 26789 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.955401 26627 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.955865 26627 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.956434 26602 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.957171 24062 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:41.939466 26667 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.959656 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.959820 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.960338 23912 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:41.961269 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.962007 23912 raft_consensus.cc:2410] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:17:41.913378 26738 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.963889 26738 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.960359 23916 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:17:41.959301 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 73068.6us
I20260709 12:17:41.969916 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:41.970707 23913 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:41.971170 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:41.939944 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:41.972393 23919 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:41.933472 23921 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:41.940724 26390 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.892930 26448 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.906773 26297 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.941489 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.943075 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.911779 26598 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:41.944916 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.993155 24064 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
W20260709 12:17:41.910256 26292 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.015s	sys 0.025s
I20260709 12:17:41.950682 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:41.893198 26625 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.927959 26621 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.922346 26513 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.975907 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.940986 26794 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.994823 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.903903 26790 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:41.996896 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.912264 26341 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:41.998921 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:41.998797 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.000874 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:41.999132 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.003413 24064 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:42.002514 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.005381 23993 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:42.012714 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:42.013495 24064 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.003994 26513 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:42.015079 26733 consensus_meta.cc:287] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.678s	user 0.012s	sys 0.000s
W20260709 12:17:42.015322 26800 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:17:42.016434 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1719) took 1031 ms. Trace:
I20260709 12:17:42.016782 24068 rpcz_store.cc:276] 0709 12:17:40.984669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.645386 (+660717us) service_pool.cc:224] Handling call
0709 12:17:41.667116 (+ 21730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:41.667481 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.667510 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:41.676532 (+  9022us) log.cc:844] Serialized 26 byte log entry
0709 12:17:41.714885 (+ 38353us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:41.714921 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.715031 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:42.016214 (+301183us) raft_consensus.cc:1685] finished
0709 12:17:42.016237 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:42.016377 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15369,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":8588,"thread_start_us":37935,"threads_started":1,"wal-append.queue_time_us":162900}
I20260709 12:17:42.018611 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.019371 26780 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:41.996639 26292 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.016s	sys 0.025s
I20260709 12:17:42.020552 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:42.021374 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:41.994009 26627 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:42.002341 24066 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:42.027478 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.032648 26740 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:41.999461 26738 consensus_queue.cc:1059] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:17:42.033470 26738 consensus_queue.cc:1243] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer 0829ddf18f07439086398756b9c6d216 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:42.033932 26738 raft_consensus.cc:3055] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:42.034224 26738 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:42.034937 26390 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.035641 26792 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.036166 26513 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.038198 26790 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.038594 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.038748 26513 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:42.039040 26769 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:42.039165 23988 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.026400 26777 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:42.042447 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:42.043027 24592 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.045416 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:42.046594 23920 raft_consensus.cc:2368] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7.
I20260709 12:17:42.000916 26495 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:42.048717 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.064523 23992 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.049564 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:42.049858 23987 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:42.027678 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.066239 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.067255 26792 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:42.068377 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.069079 26792 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:42.070248 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:42.073210 24064 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:42.047405 26288 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.081105 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.061003 24592 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:42.065356 24597 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.081943 24594 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:42.083220 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.084656 23887 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.056324 23988 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:42.075531 24600 raft_consensus.cc:1240] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:42.084326 24594 raft_consensus.cc:2410] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:42.076023 24596 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:17:42.076776 26530 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.078558 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.087811 24591 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:42.088613 24035 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.074513 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.091836 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.092463 23993 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
W20260709 12:17:42.095156 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.706s (SENT) [suppressed 16 similar messages]
W20260709 12:17:42.112315 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.099747 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.073243 26495 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:42.132825 26288 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.098239 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.135233 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.136700 23995 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:42.096858 26767 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:42.143108 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.085794 26540 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.079627 26627 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:42.147239 24064 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:42.148411 24597 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
W20260709 12:17:42.151983 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 53817.5us
W20260709 12:17:42.143006 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.161645 23887 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.103268 26794 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:42.096884 26292 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:42.162842 24035 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.154937 23993 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:42.152571 26513 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:42.165490 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.157387 26792 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:42.150890 26495 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:42.167397 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 72276.5us
I20260709 12:17:42.154727 26767 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.034978 26738 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.172701 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.175601 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.177464 24034 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.159094 26627 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.184253 26448 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:42.185002 26804 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:17:42.190441 26448 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.191015 26448 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.193241 26448 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.141675 23988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "368f96220d5b4469885774acf06e4475"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:42.194298 23988 raft_consensus.cc:606] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:42.194727 23988 raft_consensus.cc:614] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:42.194837 26811 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:17:42.199635 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1711) took 1627 ms. Trace:
I20260709 12:17:42.200028 24067 rpcz_store.cc:276] 0709 12:17:40.572138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.602230 (+1030092us) service_pool.cc:224] Handling call
0709 12:17:41.681433 (+ 79203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.681596 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.681621 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.681660 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:41.681689 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.681741 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:42.199460 (+517719us) spinlock_profiling.cc:243] Waited 75.4 ms on lock 0x7b540021be50. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:42.199576 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173483904}
I20260709 12:17:42.180598 26769 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:42.203042 26769 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:42.203176 23989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:42.203548 26769 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:42.164978 26292 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.167598 26740 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:42.168434 26667 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:42.216717 26737 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.217137 24034 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.209743 23961 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:42.223966 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:42.214826 26796 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:42.166555 26513 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:42.169229 26794 raft_consensus.cc:697] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:42.229291 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.177307 26767 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:42.180748 26602 consensus_queue.cc:1175] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71a48f59ff764d249519c6a53ec57f02" responder_term: 6 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: [5.6-5.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:42.241983 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.242717 24064 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:42.183609 26627 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.243332 23988 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
W20260709 12:17:42.246189 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.247198 23961 leader_election.cc:400] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:42.247511 23961 leader_election.cc:403] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:17:42.244002 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 144638us
I20260709 12:17:42.249563 24566 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:42.250907 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.215600 26292 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.260089 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.261302 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.262748 26794 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.254565 26704 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:42.260869 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:42.268410 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.229461 26667 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:42.245764 26513 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:42.232894 26560 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:42.283090 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.273156 26559 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:42.314429 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.315088 24069 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:42.270630 26576 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:42.315586 26576 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:42.315999 26576 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.276067 26796 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:17:42.294457 26623 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:17:42.244810 26288 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.319423 26288 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.320762 26625 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:42.321794 23962 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:42.322109 26288 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:42.324280 26738 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.314375 26560 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:42.325013 26560 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.327040 26560 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.255856 26744 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:42.290042 26792 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:42.327893 26744 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:42.328523 26744 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.330298 26730 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.241537 26740 raft_consensus.cc:697] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:42.324488 26288 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:42.331601 26740 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:42.293109 26365 consensus_meta.cc:287] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.000s
I20260709 12:17:42.332307 26288 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:42.332748 26365 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.334277 23996 raft_consensus.cc:2393] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:42.333582 26288 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:42.300333 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.337630 24063 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:42.264727 26736 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:42.281896 24068 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:42.309103 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.340822 23990 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.302731 26704 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:42.302759 26667 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.314808 26559 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.254973 26790 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:42.289587 26802 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:42.328001 26792 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.306181 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:42.279604 26606 consensus_meta.cc:287] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 12:17:42.346844 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:42.349146 23992 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:42.298751 26341 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:42.356033 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.360286 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:42.362181 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 56094.9us
I20260709 12:17:42.363178 24564 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:42.343588 26736 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.365371 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.367558 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:42.368279 24067 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.351061 26802 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.353736 26716 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4.
I20260709 12:17:42.373768 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:42.388085 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.388454 23919 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:42.374420 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.389698 23992 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:42.393918 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.395531 26822 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:42.370196 26736 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.383471 26730 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:42.382603 26802 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:42.381680 26540 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.355877 26606 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.390789 26621 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:42.392884 26654 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:42.434688 26576 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.437528 26737 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:42.438760 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.442490 26576 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:42.446379 23993 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:42.451375 26744 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.452711 26606 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:42.461020 23993 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:42.462718 23991 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:42.463166 23989 raft_consensus.cc:606] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:42.463666 23989 raft_consensus.cc:614] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:42.460261 26744 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:42.468744 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.470229 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.476449 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.477383 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:42.480365 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.480978 23987 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:42.482641 26704 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.486582 26559 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:42.505182 26815 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.428s	user 0.002s	sys 0.000s
I20260709 12:17:42.505868 23990 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:42.508248 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:42.508842 23913 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.523772 23987 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:42.392258 26713 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 12:17:42.511184 24599 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:42.529506 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:42.530905 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:42.531720 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:42.544024 23921 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:42.533388 26769 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:42.540593 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:42.549773 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 273008us
I20260709 12:17:42.535980 26513 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.559345 23918 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:42.560633 26513 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:42.540160 26811 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:17:42.562919 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:42.589908 23921 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:42.591197 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:42.581377 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:42.592029 23919 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:42.593031 23921 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:42.568531 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:42.606926 23920 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:42.624635 24067 raft_consensus.cc:2410] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:17:42.625845 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:42.627413 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:42.631829 23913 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:42.640214 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:42.641690 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.639865 23919 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:42.648774 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:42.652232 23988 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:42.671308 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:42.672238 23919 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:42.641996 23917 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:42.643114 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:42.568238 26261 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:42.678088 23913 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.684471 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.686023 23913 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:42.686131 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.689002 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.678153 26261 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.690861 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.691507 24061 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:42.691754 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.692325 26261 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:42.692348 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:42.687260 26495 consensus_meta.cc:287] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.002s
I20260709 12:17:42.693842 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:42.694694 24061 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:42.694432 26495 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.695905 23912 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:42.697348 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2018) took 1444 ms. Trace:
I20260709 12:17:42.697715 23914 rpcz_store.cc:276] 0709 12:17:41.241216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.242016 (+   800us) service_pool.cc:224] Handling call
0709 12:17:41.247915 (+  5899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.778801 (+530886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:42.684834 (+906033us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54001e0354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:42.685066 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219241216}
I20260709 12:17:42.692384 24066 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:42.643950 26792 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:42.702101 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 308244us
I20260709 12:17:42.704916 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.706714 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.707450 23996 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:42.710961 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.711612 24592 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:42.714469 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:42.723030 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.725121 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.726859 24061 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:42.717936 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:42.728411 24591 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:42.706676 26777 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:42.733603 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.736835 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.733422 26448 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:42.738631 26448 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.739028 26448 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:42.739537 26826 log.cc:927] Time spent T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:17:42.743319 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.743849 23996 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:42.745116 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.747066 23921 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:42.730427 26513 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:42.722505 26559 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:42.748601 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.756050 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:42.756392 23988 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:42.750602 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.751197 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.757143 24064 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:42.751914 26802 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.754917 23996 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:42.761474 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.764298 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.758154 23887 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.764854 24592 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:42.765503 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.755980 26513 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:42.748929 26769 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.771149 26513 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:42.757529 24591 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:42.778637 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:42.777570 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.795092 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 2034) took 1202 ms. Trace:
I20260709 12:17:42.795519 23995 rpcz_store.cc:276] 0709 12:17:41.580397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.580613 (+   216us) service_pool.cc:224] Handling call
0709 12:17:42.780420 (+1199807us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b540036f954. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:42.780555 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1208207104}
I20260709 12:17:42.796029 26667 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.799764 26736 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:42.801538 26540 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:42.801862 26736 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:42.802749 24067 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:42.762725 26841 log.cc:927] Time spent T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:17:42.830809 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 687) took 1207 ms. Trace:
W20260709 12:17:42.831689 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 73601.6us
I20260709 12:17:42.840404 24593 rpcz_store.cc:276] 0709 12:17:41.573055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.573235 (+   180us) service_pool.cc:224] Handling call
0709 12:17:42.780750 (+1207515us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b5400483d54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:42.780848 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":759076096}
W20260709 12:17:42.838451 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 60960us
I20260709 12:17:42.919898 24598 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:42.754029 26767 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:42.947345 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:42.927680 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:42.804493 26292 consensus_meta.cc:287] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.001s
I20260709 12:17:42.922104 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:42.963088 23988 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:42.924667 24592 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:42.964247 23990 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:42.965777 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:42.927119 24566 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:42.920331 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 79484.3us
I20260709 12:17:42.920483 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:42.967964 24068 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:42.941668 23886 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:42.967957 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:42.971827 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:42.948796 26559 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:42.947695 26704 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.920390 26777 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:42.979344 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 52300.1us
I20260709 12:17:42.949407 26769 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:42.947804 26495 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:42.980628 24566 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:42.993252 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.971812 26297 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:42.968021 26737 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.998828 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:42.976227 26796 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:42.993520 26540 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:42.970027 26292 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.013720 26540 raft_consensus.cc:697] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:43.005795 26495 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:43.014672 26495 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:43.015110 26495 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:43.014819 26540 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.002311 26341 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:43.003325 26769 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.983418 26611 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:17:43.000116 26777 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:43.013760 26836 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.272s	user 0.002s	sys 0.001s
I20260709 12:17:43.008464 26796 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:42.997200 26704 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.005942 26737 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:43.042431 24062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 1914) took 1267 ms (client timeout 1671 ms). Trace:
W20260709 12:17:43.044695 24062 rpcz_store.cc:269] 0709 12:17:41.775322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.789296 (+ 13974us) service_pool.cc:224] Handling call
0709 12:17:43.042203 (+1252907us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54000d1454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:43.042356 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254187264}
I20260709 12:17:43.027781 26769 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.012923 26559 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:17:43.022477 26736 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:17:43.034516 26796 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:43.043421 26606 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:43.069208 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 98339us
I20260709 12:17:43.033340 26341 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:43.074067 26767 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.074775 26292 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.087951 23886 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:43.082409 24068 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:17:43.072515 26802 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:43.116884 24068 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:17:43.119143 24068 pending_rounds.cc:85] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 5
I20260709 12:17:43.119517 24068 pending_rounds.cc:107] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:17:43.119880 24068 raft_consensus.cc:2889] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:43.122136 26842 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 12:17:43.122509 26845 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:17:43.124518 26627 consensus_meta.cc:287] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.859s	user 0.007s	sys 0.003s
I20260709 12:17:43.124910 26627 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:43.125231 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:43.125772 24594 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.127950 26737 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:43.117161 26390 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:43.129608 26390 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.135782 26792 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.118160 26297 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:17:43.139752 26704 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.141134 26627 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:43.141783 26292 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:43.142441 26292 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:43.143177 26796 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:43.144466 26813 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:43.144498 26292 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:43.146347 24595 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:43.150969 26448 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.153117 24594 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:43.154803 26769 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.157582 26769 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.092365 26606 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.159353 26796 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:43.161971 26777 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.168030 26341 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:43.178103 24068 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:43.170018 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 1932) took 1178 ms. Trace:
I20260709 12:17:43.173377 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.179867 24063 rpcz_store.cc:276] 0709 12:17:41.991220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.994503 (+  3283us) service_pool.cc:224] Handling call
0709 12:17:43.169801 (+1175298us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b540010f254. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:43.169956 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765804288}
I20260709 12:17:43.180915 24066 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:17:43.184481 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 216585us
I20260709 12:17:43.184734 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.116616 26767 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:43.185851 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.198704 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:43.186136 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.198930 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.141057 26621 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:43.195525 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.199934 23921 raft_consensus.cc:2368] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6.
I20260709 12:17:43.157769 26513 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:43.198648 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 225463us
I20260709 12:17:43.201354 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.199956 23919 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:43.203329 23917 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 8: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:43.204576 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:43.206014 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.205737 23886 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
W20260709 12:17:43.208242 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 207271us
I20260709 12:17:43.209823 23962 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:43.214972 23914 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:43.214855 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:43.216521 24594 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.200232 26767 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.229768 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:43.229892 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:43.230629 23988 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:43.232133 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:43.223295 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:43.233422 24063 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:43.236462 23919 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:43.242056 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:43.242808 23912 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 8: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:43.242528 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:43.230458 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:43.249192 23917 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:43.258587 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:43.259312 23996 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:43.262538 23987 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:43.206995 26621 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:43.263253 23992 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:43.244593 26767 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:43.221099 26852 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:43.226976 26606 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.291512 23917 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:43.296653 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.311558 23996 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:43.312601 23991 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:43.323231 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:43.326707 26667 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.334841 26744 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:43.335572 26744 raft_consensus.cc:697] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:43.336633 26744 consensus_queue.cc:237] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:43.241761 26713 consensus_queue.cc:1059] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:17:43.315356 24594 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:43.355062 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:43.315869 24063 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
W20260709 12:17:43.320813 26825 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.635s	user 0.003s	sys 0.000s
I20260709 12:17:43.285588 26789 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:43.372997 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:43.373229 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:43.374570 23912 raft_consensus.cc:2376] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8. Re-sending same reply.
I20260709 12:17:43.376634 23917 raft_consensus.cc:2368] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7.
I20260709 12:17:43.308312 26852 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:43.382592 23917 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:43.387210 23961 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:43.289265 26478 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:17:43.389433 23961 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:43.375413 26560 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:43.395464 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:43.399024 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:43.399469 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:43.400161 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:43.400907 23991 raft_consensus.cc:2393] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:43.375655 26789 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:43.402048 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:43.403057 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:43.407306 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:43.409888 23887 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:43.380935 26713 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:43.414662 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:43.415751 24564 leader_election.cc:400] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6.
I20260709 12:17:43.415989 24564 leader_election.cc:403] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:43.416781 24564 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:43.413632 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:43.417534 24066 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.417717 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:43.418952 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:43.419167 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:43.419871 24061 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.432211 23912 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:43.432658 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:43.432863 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:43.433342 24594 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.387873 26704 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.434561 24069 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:43.436288 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:43.437251 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:43.437819 23987 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.438835 24564 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:43.441042 24597 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:43.441622 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:43.442215 24070 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.414487 26830 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.403129 26448 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.454464 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:43.455344 24066 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:43.458735 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:43.411237 26789 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.492208 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:43.419947 26560 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:43.437537 26780 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:43.498471 24594 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:43.519441 24061 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:43.451627 26627 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:43.441361 26769 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:43.534178 26863 consensus_queue.cc:1059] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:43.534356 26560 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.392171 26621 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.500517 26513 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:43.535099 26863 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:43.500169 26777 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:43.460167 26559 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:17:43.458490 26297 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:17:43.518057 26855 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:43.460642 26830 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.517382 26540 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.530503 26627 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.597115 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 1732) took 1014 ms. Trace:
W20260709 12:17:43.599786 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 430362us
I20260709 12:17:43.600718 24067 rpcz_store.cc:276] 0709 12:17:42.582398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.648476 (+ 66078us) service_pool.cc:224] Handling call
0709 12:17:43.596854 (+948378us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400071054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:43.597040 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345153792}
I20260709 12:17:43.601398 23960 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:43.599236 26737 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:43.603700 26495 consensus_meta.cc:287] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
I20260709 12:17:43.603999 26737 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.604136 26495 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.612788 26495 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.614447 26737 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.617725 26803 raft_consensus.cc:3055] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:43.618134 26803 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:43.618912 26803 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.620095 26803 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:43.614727 24070 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:43.595464 26777 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.623168 26576 raft_consensus.cc:3055] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:43.623731 26576 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:43.624696 26576 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.625826 26777 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.632680 26365 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:43.634490 26704 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:43.645539 26390 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.529222 26853 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:17:43.539357 26769 raft_consensus.cc:697] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:43.529470 26852 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.535601 26713 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 12:17:43.666023 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:43.702956 23991 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:43.679275 23987 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
W20260709 12:17:43.680902 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 188742us
I20260709 12:17:43.537171 26780 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:17:43.669382 26627 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:43.706895 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:43.707170 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 497417us
I20260709 12:17:43.674422 26741 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.707998 23962 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:43.708963 23915 raft_consensus.cc:2393] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:43.708335 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.710741 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.711551 23915 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:43.695057 26704 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.714671 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.715862 23962 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:43.717536 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.717917 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.718410 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.704309 26829 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.719659 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.704679 26862 raft_consensus.cc:2764] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:43.721065 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:43.722352 23962 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:43.723827 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.706480 26261 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:43.706640 26854 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:43.758186 23919 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:43.755012 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.757715 23912 raft_consensus.cc:2393] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:43.757936 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:43.754727 23962 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:43.712664 26859 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.775941 23916 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:43.717310 26704 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:43.769704 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.018s	sys 0.015s
W20260709 12:17:43.780581 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.018s	sys 0.015s
W20260709 12:17:43.781317 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 538790us
I20260709 12:17:43.783596 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:43.762982 26365 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:43.788162 23920 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.010s	sys 0.018s
I20260709 12:17:43.756842 26390 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:43.717479 26741 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.778177 26100 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:17:43.791685 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 352895us
I20260709 12:17:43.845145 24564 leader_election.cc:400] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7.
I20260709 12:17:43.812093 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.796578 23916 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:43.848121 26548 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:43.848824 26548 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:43.816882 23920 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.010s	sys 0.023s
I20260709 12:17:43.784708 26606 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:43.842438 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:43.817165 26341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.015s	sys 0.020s
I20260709 12:17:43.862282 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.864332 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:43.866011 24066 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:43.866439 23916 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:43.858596 23886 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
W20260709 12:17:43.860265 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.869992 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:43.809099 26365 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.871968 23994 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:43.772887 26261 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.756654 26829 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:43.854892 26777 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:43.869518 26341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.016s	sys 0.020s
I20260709 12:17:43.896517 24593 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:43.897468 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:43.857570 26802 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:43.875944 26606 raft_consensus.cc:697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:43.901417 26261 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.857167 26100 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.910818 26830 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.779528 26854 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.876253 26448 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:43.919584 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:43.887576 26365 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:43.876020 26654 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:43.897172 26767 consensus_meta.cc:287] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.003s
I20260709 12:17:43.941920 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.942704 23916 raft_consensus.cc:2393] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:43.944077 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:43.944837 23920 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
W20260709 12:17:43.938789 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 305301us
I20260709 12:17:43.947364 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:43.842338 26769 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.886197 26731 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:17:43.955994 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:43.935173 26839 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:43.948437 26767 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:43.935199 26858 consensus_queue.cc:1059] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 12:17:43.976805 26829 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:43.979063 26741 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:43.988006 26863 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.990072 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:43.992192 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:44.001298 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45381.4us
I20260709 12:17:44.013307 23987 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:44.013499 23992 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:44.013939 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:43.909170 26855 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6.
I20260709 12:17:43.935355 26857 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
W20260709 12:17:44.006251 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 55421.5us
W20260709 12:17:43.999542 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.004s	sys 0.013s
W20260709 12:17:44.025588 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.004s	sys 0.013s
I20260709 12:17:43.954577 26448 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:44.023893 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:43.957707 26873 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:44.031373 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.025769 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:43.951210 26654 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:44.047052 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 262696us
I20260709 12:17:44.007375 26560 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:43.999249 26813 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:17:44.005684 26390 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:43.985988 26789 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.026546 26839 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:44.032122 26559 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:44.062476 23960 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:44.051384 26495 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:44.085237 26495 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:44.072041 26853 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.085678 26495 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.086092 26853 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:44.089912 26879 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:17:43.967161 26606 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.076913 26548 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:44.080436 26390 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.079983 26873 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:17:44.097335 26390 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.099951 26789 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.100380 24591 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.101192 26839 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.056249 26513 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:44.111738 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:44.111740 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 49380.5us
I20260709 12:17:44.114308 24069 raft_consensus.cc:2368] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:44.077411 26872 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:44.031486 26863 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.056113 26667 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:17:44.135387 26390 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:44.136636 26513 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:44.187274 26854 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:44.187731 26877 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.241s	user 0.002s	sys 0.000s
I20260709 12:17:44.155377 26448 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:44.195230 26875 log.cc:927] Time spent T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:17:44.177969 26873 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:17:44.196995 26513 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:44.199627 26869 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.338s	user 0.000s	sys 0.002s
I20260709 12:17:44.203421 24591 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:44.204387 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 593) took 1057 ms. Trace:
I20260709 12:17:44.213739 26851 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:44.214293 26851 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:44.216017 26892 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:44.216444 26892 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:44.217281 26892 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.218416 26892 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:44.218989 26341 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:44.219532 26341 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:44.220160 26495 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.220687 26341 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:44.222779 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:44.223215 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 155515us
I20260709 12:17:44.223819 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.204908 24592 rpcz_store.cc:276] 0709 12:17:43.146831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.146965 (+   134us) service_pool.cc:224] Handling call
0709 12:17:43.147273 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:43.147598 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:43.147633 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:43.148084 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:17:43.421424 (+273340us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:43.421476 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:43.421560 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:44.198887 (+777327us) spinlock_profiling.cc:243] Waited 8.2 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:44.204009 (+  5122us) raft_consensus.cc:1685] finished
0709 12:17:44.204046 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:44.204308 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28041,"raft.queue_time_us":8230,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"spinlock_wait_cycles":18853760,"thread_start_us":272945,"threads_started":1,"wal-append.queue_time_us":630333}
I20260709 12:17:44.238971 26829 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.239336 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.248615 26829 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.241379 24599 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:44.249987 24035 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:44.245384 24596 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:44.242098 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.246079 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.242812 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:44.256143 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 134834us
I20260709 12:17:44.200021 26625 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:44.219040 26390 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:44.263108 23988 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.005s	sys 0.019s
W20260709 12:17:44.282824 23988 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.020s
W20260709 12:17:44.268438 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:44.281498 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 234961us
I20260709 12:17:44.245922 26713 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.180974 26876 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:17:44.239933 26621 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:44.254514 26737 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.303377 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.301653 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e7023603694b9d8a378858f72b4532"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:44.304704 23987 raft_consensus.cc:606] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:44.305099 23987 raft_consensus.cc:614] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:44.251930 26863 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.262916 26341 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.253935 26100 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:44.181339 26859 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.101s
I20260709 12:17:44.312137 24599 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:44.260524 26261 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:44.310830 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.315810 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:44.317592 23887 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:44.260705 26741 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:17:44.302248 26830 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:44.303697 26767 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:44.308197 26713 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.312914 26737 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.350770 26737 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:44.312772 26852 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:44.351781 26852 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:44.352883 26891 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:17:44.353168 26852 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:44.314774 26895 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:17:44.308583 26621 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.360854 26390 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.340847 26261 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:44.363488 26261 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.215432 26851 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.321570 26559 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:44.312407 26297 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.071s
I20260709 12:17:44.322052 26829 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:44.346056 26654 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.354000 26852 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:17:44.408483 23990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2055) took 1180 ms. Trace:
I20260709 12:17:44.410265 23990 rpcz_store.cc:276] 0709 12:17:43.228356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.228488 (+   132us) service_pool.cc:224] Handling call
0709 12:17:43.228870 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:43.723076 (+494206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:43.723105 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:43.756162 (+ 33057us) log.cc:844] Serialized 26 byte log entry
0709 12:17:44.114396 (+358234us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:44.406431 (+292035us) log.cc:844] Serialized 14 byte log entry
0709 12:17:44.407692 (+  1261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.408233 (+   541us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:44.408279 (+    46us) raft_consensus.cc:1685] finished
0709 12:17:44.408293 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:44.408422 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3163,"raft.queue_time_us":231720,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":16840,"thread_start_us":1028302,"threads_started":3,"wal-append.queue_time_us":463802}
I20260709 12:17:44.392462 26872 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:44.418840 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:44.421931 23987 raft_consensus.cc:606] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:44.422444 23987 raft_consensus.cc:614] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:17:44.420101 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.384405 26830 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:44.427721 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 106696us
W20260709 12:17:44.423991 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 122735us
I20260709 12:17:44.429557 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.435381 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.435686 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:44.440402 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:44.445026 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 71789.3us
I20260709 12:17:44.447710 23912 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:17:44.449105 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.423727 26495 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:44.431005 26627 consensus_meta.cc:287] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.715s	user 0.004s	sys 0.008s
I20260709 12:17:44.449716 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.454511 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:44.454707 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:44.458849 23990 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:44.460381 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:44.460497 23912 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:44.461436 24034 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.462626 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:44.463263 23913 raft_consensus.cc:2368] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:44.467650 23913 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:44.439898 26513 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:44.469983 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.471275 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:44.473796 24564 leader_election.cc:400] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:44.476446 24564 leader_election.cc:403] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:44.473978 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:44.478109 23990 raft_consensus.cc:606] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:44.478854 26907 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:44.479660 26907 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:44.480891 26907 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:44.483249 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:44.483990 23915 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:44.485347 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:44.487995 24069 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:44.488845 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:44.489435 24067 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.488212 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:44.490031 24034 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.491855 24066 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:44.494772 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:44.502084 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:44.503646 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:44.455509 26621 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.511166 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.442864 26654 consensus_queue.cc:1059] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:17:44.518394 23915 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:17:44.490324 26803 consensus_meta.cc:287] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.870s	user 0.013s	sys 0.001s
I20260709 12:17:44.525635 24034 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.475871 26829 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:44.529407 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:44.524717 24067 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:44.485617 26736 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:44.538529 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:44.541191 23915 raft_consensus.cc:2393] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:44.543080 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:44.543911 23920 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:44.543813 24066 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:44.500519 26737 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:44.455336 26627 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.500075 26513 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:44.427131 26872 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.527608 26906 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.523636 26100 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:44.533967 26854 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:44.533610 26297 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.511420 26859 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:17:44.545709 26738 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:44.569039 23921 raft_consensus.cc:2368] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:44.490303 26903 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 12:17:44.551275 26576 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:44.546963 26390 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.552481 26261 consensus_queue.cc:1059] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260709 12:17:44.583091 26909 log.cc:927] Time spent T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:17:44.577684 26902 log.cc:927] Time spent T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:17:44.551980 26923 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.569499 26736 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:44.580824 26713 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.578612 26627 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:44.677045 26914 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:17:44.678987 26627 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:44.679548 26627 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.680258 26540 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:44.680619 26540 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:44.681567 26627 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.681382 26540 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.617686 26390 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.682408 26540 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:44.684569 26913 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:17:44.685061 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2069) took 1019 ms. Trace:
I20260709 12:17:44.579391 26297 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:44.625041 26910 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 12:17:44.690025 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.685592 23988 rpcz_store.cc:276] 0709 12:17:43.665310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.666662 (+  1352us) service_pool.cc:224] Handling call
0709 12:17:43.667031 (+   369us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:43.667480 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:43.667519 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:43.677592 (+ 10073us) log.cc:844] Serialized 52 byte log entry
0709 12:17:44.283356 (+605764us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:44.283409 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.283486 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:44.684776 (+401290us) raft_consensus.cc:1685] finished
0709 12:17:44.684806 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:44.684983 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1612,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":29602,"thread_start_us":578848,"threads_started":1,"wal-append.queue_time_us":690142}
W20260709 12:17:44.693482 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.693156 23920 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:44.683102 26919 log.cc:927] Time spent T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:17:44.577176 26906 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.687306 26736 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:44.699193 26830 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.665719 26513 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.727612 26713 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:44.728559 26713 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.622421 26923 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.707024 26917 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:17:44.714807 26736 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:44.734419 26365 consensus_meta.cc:287] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.778s	user 0.008s	sys 0.004s
W20260709 12:17:44.739712 26918 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:17:44.739787 26365 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.746747 26906 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.749396 26736 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:44.751063 26736 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:44.751487 23995 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:44.751642 26736 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.753803 26736 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:44.754136 26829 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:44.756734 23886 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.758006 26744 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:44.758697 26830 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.758594 26744 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.759176 26830 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.760707 26744 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:44.761487 26627 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:44.761590 26741 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:44.762219 26741 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.764376 26741 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:44.767429 26741 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.767917 26741 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.769976 26741 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:44.771416 24070 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:44.773782 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 410) took 1380 ms. Trace:
I20260709 12:17:44.774578 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.776006 24070 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:44.777118 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.778998 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:44.783048 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.779175 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.783756 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.783267 23988 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:44.784219 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.784901 24600 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
W20260709 12:17:44.786075 26928 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:17:44.778239 26365 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.786651 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.787268 24595 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:44.788218 26923 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:44.788733 23995 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:44.779282 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.781430 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.793660 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.794835 26713 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:44.797417 24591 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:44.794884 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.795241 23961 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:44.794037 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.804541 26921 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:44.806869 26576 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:44.808005 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:44.808573 24600 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:44.813277 24594 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:44.815652 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.817262 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:44.821544 26906 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.850823 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.820628 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.820951 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:44.834728 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.853567 23918 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 3.
I20260709 12:17:44.854197 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2022) took 1133 ms. Trace:
I20260709 12:17:44.854413 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.835402 24566 leader_election.cc:400] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8.
I20260709 12:17:44.836977 24067 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:17:44.864821 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 46658.4us
I20260709 12:17:44.865470 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.774178 23917 rpcz_store.cc:276] 0709 12:17:43.393406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.394793 (+  1387us) service_pool.cc:224] Handling call
0709 12:17:43.420841 (+ 26048us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:43.421162 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:43.484460 (+ 63298us) log.cc:844] Serialized 14 byte log entry
0709 12:17:43.759997 (+275537us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b18001e1600. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f223a 00007f75c0c5ca2a
0709 12:17:43.961218 (+201221us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:44.743230 (+782012us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18001e1600. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb332a6 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a
0709 12:17:44.744872 (+  1642us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b2c0001b8d8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:17:44.745265 (+   393us) log.cc:844] Serialized 26 byte log entry
0709 12:17:44.772762 (+ 27497us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:44.773252 (+   490us) log.cc:844] Serialized 14 byte log entry
0709 12:17:44.773485 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.773558 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:44.773610 (+    52us) raft_consensus.cc:1685] finished
0709 12:17:44.773622 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:44.773730 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19351,"prepare.queue_time_us":70227,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":2483,"raft.queue_time_us":2310,"raft.run_cpu_time_us":433,"raft.run_wall_time_us":23030,"spinlock_wait_cycles":34778240,"thread_start_us":200885,"threads_started":1,"wal-append.queue_time_us":620214}
I20260709 12:17:44.841001 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:44.821985 26867 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.006s	sys 0.029s
I20260709 12:17:44.866389 24067 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 3.
I20260709 12:17:44.821388 26917 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:44.818660 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.846391 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.870934 24063 raft_consensus.cc:2410] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:44.869297 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.854621 23918 rpcz_store.cc:276] 0709 12:17:43.720400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.720528 (+   128us) service_pool.cc:224] Handling call
0709 12:17:44.820775 (+1100247us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b5800002798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:17:44.854129 (+ 33354us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5668608}
W20260709 12:17:44.872223 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55056.5us
I20260709 12:17:44.873155 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:44.885190 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.886320 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.886559 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:44.886978 24063 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:44.887410 24068 raft_consensus.cc:2393] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:44.905095 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.890436 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.907470 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:44.889981 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:44.912184 24065 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
W20260709 12:17:44.884761 26867 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.007s	sys 0.029s
I20260709 12:17:44.915390 24036 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:44.920363 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 378271us
I20260709 12:17:44.920851 24062 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:44.886144 26767 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:44.925721 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:44.924264 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.928323 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:44.923336 26704 consensus_meta.cc:287] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 1.139s	user 0.010s	sys 0.004s
I20260709 12:17:44.940920 24600 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:44.924469 26802 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:44.885150 26906 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.949092 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:44.927820 26904 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:44.937793 26829 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:44.955746 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.958782 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.959806 23988 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:44.959910 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.960261 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.960677 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:44.963514 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.940115 26865 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:44.968892 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:44.971848 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 98797.7us
I20260709 12:17:44.969586 23994 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:17:44.972781 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:44.974536 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:44.962327 26829 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.961678 26495 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:44.945474 26704 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:44.966641 26904 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:44.984462 26829 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:44.970409 26865 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:44.956516 26802 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:44.982637 26947 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:45.003705 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:45.010152 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:45.001296 26548 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:45.000595 26865 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.023721 26872 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.004176 26946 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:45.024288 26872 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.024677 26621 raft_consensus.cc:3055] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:44.976934 26934 consensus_queue.cc:1059] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:17:45.013563 26854 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:44.994796 26495 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.028398 26621 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:45.046427 26802 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.030642 26767 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:45.046788 26495 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.054935 26953 raft_consensus.cc:3055] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:45.049063 26955 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:45.064774 26767 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:45.065552 26953 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:45.092875 26955 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:45.096932 26948 log.cc:927] Time spent T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.058s	user 0.001s	sys 0.001s
W20260709 12:17:45.098238 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 134809us
I20260709 12:17:45.065126 26621 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.099223 26955 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:45.101682 26950 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:45.102170 26940 log.cc:927] Time spent T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:17:45.093146 26767 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.104977 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.107482 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.114974 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:45.097733 26906 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.121477 26931 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:45.123044 26949 log.cc:927] Time spent T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 12:17:45.123914 26901 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.763s	user 0.002s	sys 0.000s
I20260709 12:17:45.125154 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2063) took 1722 ms. Trace:
I20260709 12:17:45.103012 26704 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.037269 26904 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.117364 26953 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.132473 26953 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.120577 26872 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.125514 23996 rpcz_store.cc:276] 0709 12:17:43.402336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.403410 (+  1074us) service_pool.cc:224] Handling call
0709 12:17:43.403692 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:43.790330 (+386638us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:43.790364 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:43.791176 (+   812us) log.cc:844] Serialized 26 byte log entry
0709 12:17:44.178640 (+387464us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:44.178680 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.178756 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:45.123125 (+944369us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:45.124866 (+  1741us) raft_consensus.cc:1685] finished
0709 12:17:45.124893 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.125095 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":229733,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"spinlock_wait_cycles":45264768,"thread_start_us":678675,"threads_started":2,"wal-append.queue_time_us":456134}
W20260709 12:17:45.144802 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.114890 26736 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.144382 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:45.151762 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:45.152030 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 234250us
I20260709 12:17:45.147564 26621 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.146121 26934 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.155140 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.153431 24034 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:45.114622 26950 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.153136 26741 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.168556 26741 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.168967 26741 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:45.174389 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.163704 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:45.163820 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 153711us
I20260709 12:17:45.165386 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.166728 23996 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:45.178036 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.176136 26704 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:45.186923 23996 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:17:45.188735 23996 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:45.189179 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.190496 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.191047 23996 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:45.192510 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.192754 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.164177 26947 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:45.195632 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.187734 26540 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.187997 26951 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.201431 26961 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:45.201943 26961 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.203902 26961 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.204501 26829 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.205708 26621 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.206178 26621 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.207564 26736 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:45.207960 26736 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:45.208106 26621 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.208353 26736 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.210587 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.215941 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.191964 26854 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.224176 26540 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:17:45.232787 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:45.215219 26548 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.195253 26954 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:45.188266 26704 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.230142 26829 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.218007 26946 raft_consensus.cc:697] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:45.255980 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 63276.4us
I20260709 12:17:45.225432 26767 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.247684 26954 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.260943 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.262012 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.263672 26829 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.263854 26960 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:45.264374 26829 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.264534 26960 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.266439 26548 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.267067 26548 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.268525 26960 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.269658 26548 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.270720 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.270994 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.271522 23995 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:45.260352 26954 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.274474 26741 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.286082 26853 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.294732 26959 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:45.258538 26865 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.320264 26959 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.320673 26959 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:45.321780 26865 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.322708 26946 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.323340 26767 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.324924 26704 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.326545 26950 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:45.331696 26938 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 12:17:45.332096 26736 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.335093 26736 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.316229 26830 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:45.316825 26966 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:17:45.318346 26731 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.319099 26741 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.258236 26947 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:45.341158 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.343851 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:45.365546 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:45.366385 24599 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:45.356694 26830 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:45.355541 26559 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:45.346902 26767 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:45.376829 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.334046 26955 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:45.390054 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 125982us
I20260709 12:17:45.391675 23989 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:45.392067 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:45.393858 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:45.356145 26731 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.397540 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:45.399202 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.400113 23912 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:45.400707 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.401813 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.403713 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:45.404569 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.389395 26970 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.406036 24593 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:45.406486 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.408179 23919 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:45.394426 26704 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:45.387418 26559 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.394420 26767 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:45.405521 26896 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 1.144s	user 0.000s	sys 0.004s
I20260709 12:17:45.413828 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.419987 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.421087 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.420756 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:45.427708 26965 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:17:45.431512 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:45.438899 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.432474 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:45.437186 24034 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.440718 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.396649 26858 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:17:45.449416 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.449530 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:45.395427 26830 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:17:45.452088 23919 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:45.418478 26777 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:45.423720 26767 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.447535 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.460225 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.461273 26865 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:45.461611 26625 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:45.462329 26625 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:45.414913 26970 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.459856 26934 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.469112 23919 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:45.445772 26968 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.450156 23912 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 4: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:45.450721 26736 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.445510 26802 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.420503 26977 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:45.420230 26704 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.456606 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.453142 26744 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.460465 26767 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:45.455365 26905 consensus_queue.cc:1059] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:17:45.493427 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.481746 26977 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.507053 26977 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.460212 26777 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.516991 26777 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.496131 23989 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:45.495489 26731 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.519368 24566 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:45.506557 26974 log.cc:927] Time spent T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:17:45.521788 26731 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:45.523195 26731 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.523590 26731 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.528225 26704 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.528074 26954 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.487514 26858 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:45.485919 26959 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:45.538190 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 201308us
I20260709 12:17:45.537887 26540 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.551581 26858 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.562127 23886 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.565539 23886 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:45.570392 26777 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:45.572183 26777 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.572659 26777 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:45.589293 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.556771 26830 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:17:45.569865 26513 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:45.607538 23918 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:45.569542 26858 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.615094 26625 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.616998 26970 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.618682 26955 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.620420 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2054) took 1181 ms. Trace:
I20260709 12:17:45.620796 23914 rpcz_store.cc:276] 0709 12:17:44.438806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.439006 (+   200us) service_pool.cc:224] Handling call
0709 12:17:45.620224 (+1181218us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002ec554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:45.620360 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448786688}
W20260709 12:17:45.623426 26952 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:17:45.625022 26930 log.cc:927] Time spent T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.926s	user 0.002s	sys 0.000s
I20260709 12:17:45.626539 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 1962) took 1138 ms. Trace:
I20260709 12:17:45.626915 24064 rpcz_store.cc:276] 0709 12:17:44.488222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.488659 (+   437us) service_pool.cc:224] Handling call
0709 12:17:44.489294 (+   635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:44.489596 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:44.489622 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:44.489996 (+   374us) log.cc:844] Serialized 26 byte log entry
0709 12:17:44.564868 (+ 74872us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:44.564922 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.565013 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:45.624481 (+1059468us) spinlock_profiling.cc:243] Waited 1.28 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:45.626216 (+  1735us) raft_consensus.cc:1685] finished
0709 12:17:45.626235 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.626478 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":552,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":25695,"spinlock_wait_cycles":3748992,"thread_start_us":74512,"threads_started":1,"wal-append.queue_time_us":124197}
I20260709 12:17:45.630613 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:45.631335 24599 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:45.633596 26977 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.636665 26794 raft_consensus.cc:3055] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:45.637158 26794 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:45.638175 26794 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.604871 26954 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.642119 26977 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:45.650885 26925 log.cc:927] Time spent T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.949s	user 0.000s	sys 0.002s
W20260709 12:17:45.667377 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 195466us
I20260709 12:17:45.660717 26790 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:45.670796 26985 log.cc:927] Time spent T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 12:17:45.670265 26625 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.683027 24596 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 707) took 1322 ms. Trace:
I20260709 12:17:45.676328 26959 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.675406 26790 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.689900 26767 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.683588 24596 rpcz_store.cc:276] 0709 12:17:44.361145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.376768 (+ 15623us) service_pool.cc:224] Handling call
0709 12:17:44.377242 (+   474us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:44.377677 (+   435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:44.377718 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:44.378397 (+   679us) log.cc:844] Serialized 52 byte log entry
0709 12:17:44.487535 (+109138us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:44.487574 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:44.487634 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:45.639667 (+1152033us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:45.679936 (+ 40269us) raft_consensus.cc:1685] finished
0709 12:17:45.679967 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.682942 (+  2975us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4931,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":6692,"spinlock_wait_cycles":2635136,"thread_start_us":108766,"threads_started":1,"wal-append.queue_time_us":202124}
I20260709 12:17:45.697583 23990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35252 (request call id 28) took 1223 ms. Trace:
I20260709 12:17:45.698025 23990 rpcz_store.cc:276] 0709 12:17:44.473743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.473865 (+   122us) service_pool.cc:224] Handling call
0709 12:17:45.697151 (+1223286us) spinlock_profiling.cc:243] Waited 6.43 ms on lock 0x7b54001b5e20. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0bcf520 00007f75c0c4c652 00007f75c5c1a60a 00007f75bf1a07d4 00007f75bf1a0762 00007f75bf1a0691 00007f75bf1a060c 00007f75bf19f8c2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:45.697504 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14787968}
I20260709 12:17:45.702572 26911 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:45.703048 26911 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:45.703814 26731 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.705960 26731 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.717278 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:45.731321 26790 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.701653 26777 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.738788 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:45.740278 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:45.749892 26731 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:45.750574 26731 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.751034 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:45.753240 26731 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:45.760638 23915 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:45.766053 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1866) took 1331 ms. Trace:
I20260709 12:17:45.766600 23987 rpcz_store.cc:276] 0709 12:17:44.434543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.436860 (+  2317us) service_pool.cc:224] Handling call
0709 12:17:44.439136 (+  2276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:44.439381 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:45.716418 (+1277037us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b180045fe80. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75c07fa4bc 00007f75bdb4848b 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb62455 00007f75c464a3c7 00007f75c0c5c9a7 00007f75c0c6c0bf
0709 12:17:45.729042 (+ 12624us) log.cc:844] Serialized 14 byte log entry
0709 12:17:45.765595 (+ 36553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:45.765667 (+    72us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:45.765725 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.765825 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.765981 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1941,"prepare.queue_time_us":88614,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"spinlock_wait_cycles":6912896,"thread_start_us":126214,"threads_started":2}
I20260709 12:17:45.788350 26767 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.790052 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:45.792726 26959 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:45.793313 26959 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.798012 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:45.798789 24591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37704 (request call id 924) took 1575 ms (client timeout 1600 ms). Trace:
I20260709 12:17:45.799263 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:45.799321 24591 rpcz_store.cc:269] 0709 12:17:44.222912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.223547 (+   635us) service_pool.cc:224] Handling call
0709 12:17:45.798569 (+1575022us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b540071dc54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:45.798713 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1317243648}
I20260709 12:17:45.800607 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.801266 24034 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:45.816514 26954 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:45.816926 26954 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.817330 26954 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.817924 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:45.818624 24591 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.804834 26959 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:45.820168 23921 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2021) took 2100 ms (client timeout 2055 ms). Trace:
I20260709 12:17:45.820456 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:45.820590 23921 rpcz_store.cc:269] 0709 12:17:43.719224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.719379 (+   155us) service_pool.cc:224] Handling call
0709 12:17:45.819929 (+2100550us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b54002c2c54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:45.820060 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946277120}
I20260709 12:17:45.821708 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:45.820210 23913 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:45.822721 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:45.823241 23995 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.823798 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2037) took 1352 ms. Trace:
I20260709 12:17:45.824209 26737 consensus_queue.cc:1059] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:45.824163 23913 rpcz_store.cc:276] 0709 12:17:44.471616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.471722 (+   106us) service_pool.cc:224] Handling call
0709 12:17:45.820039 (+1348317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.822804 (+  2765us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.823632 (+   828us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54002c2c50. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:45.823745 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3100147456}
I20260709 12:17:45.826116 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:45.825433 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.827751 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:45.811077 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.842048 26858 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.842542 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.844913 23913 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:45.808843 26777 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.845978 23990 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:45.813500 23914 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:45.846318 23960 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:45.848271 23991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 444) took 1983 ms. Trace:
I20260709 12:17:45.848721 23960 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:45.849334 26738 raft_consensus.cc:3055] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:45.849797 26738 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:45.850553 23918 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:45.850915 24591 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:45.852489 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:45.815337 26390 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.809425 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.828785 26954 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.830297 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:45.831624 26829 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.835908 26794 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:45.861522 23918 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:45.822212 23921 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:45.866462 23995 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:45.828692 26559 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:45.812662 24597 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 705) took 1566 ms. Trace:
I20260709 12:17:45.855144 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.855824 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:45.856438 26704 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.848641 23991 rpcz_store.cc:276] 0709 12:17:43.864451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.866837 (+  2386us) service_pool.cc:224] Handling call
0709 12:17:43.867134 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:44.144768 (+277634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:44.144926 (+   158us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:44.206309 (+ 61383us) log.cc:844] Serialized 26 byte log entry
0709 12:17:44.421163 (+214854us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:44.421216 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.843159 (+1421943us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5400310e54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:45.843208 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:45.843250 (+    42us) raft_consensus.cc:1685] finished
0709 12:17:45.843263 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.848215 (+  4952us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21732,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"spinlock_wait_cycles":55496448,"thread_start_us":466880,"threads_started":2,"wal-append.queue_time_us":276488,"wal-append.run_cpu_time_us":2247,"wal-append.run_wall_time_us":1080257}
I20260709 12:17:45.870347 24597 rpcz_store.cc:276] 0709 12:17:44.246062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.246197 (+   135us) service_pool.cc:224] Handling call
0709 12:17:44.246481 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:44.376426 (+129945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:44.376470 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:44.376528 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:44.376572 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.812441 (+1435869us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54004713d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:45.812486 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:45.812596 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":298278784}
I20260709 12:17:45.858556 23919 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:45.885607 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.860407 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:45.884449 23921 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:45.857772 26716 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:45.847143 26903 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.847447 26962 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:45.893159 23921 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:45.890893 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:45.851714 26731 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:45.854784 26937 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:45.850666 26738 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:45.895592 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.897166 26970 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:45.897269 26716 consensus_queue.cc:1059] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:45.922567 26731 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:45.927394 26716 raft_consensus.cc:3055] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:45.927173 26970 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.927748 26716 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:45.928556 26716 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:45.895038 26903 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:45.902565 26995 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:17:45.871400 26955 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.858955 26513 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:46.008229 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:45.970938 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:46.022853 23988 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:46.026335 24597 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:46.032171 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:46.033829 23918 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:46.006206 26716 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.906168 26962 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.037163 26962 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:45.929250 26970 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.031500 26738 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.024154 26513 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.038241 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:46.038657 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.040287 26513 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.041323 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:46.041925 24597 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:46.046736 26954 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:46.062090 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:46.063225 23987 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:46.024401 26955 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.070236 26892 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:46.103533 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 215519us
I20260709 12:17:46.106189 23988 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
W20260709 12:17:46.076866 26876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.762s	user 0.008s	sys 0.005s
W20260709 12:17:46.112919 26991 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.367s	user 0.005s	sys 0.000s
I20260709 12:17:46.104889 26892 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.117189 26892 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:46.122376 26876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.809s	user 0.008s	sys 0.006s
I20260709 12:17:46.132081 26955 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.169493 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:46.178747 26100 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:46.187275 26903 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.191610 26829 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.204981 26829 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.195152 26100 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:46.203001 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.203737 26297 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.207692 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:46.210860 26829 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:46.213075 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.213020 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.215894 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:46.211720 26100 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.216349 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:46.217216 24070 raft_consensus.cc:2410] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:17:46.217430 26903 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:46.217937 26903 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.217434 23886 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:46.219772 23886 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:46.220678 26851 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.220829 26667 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:46.221064 26559 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:46.221483 26667 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:46.222684 26559 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:46.223093 26513 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:46.225436 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:46.226461 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.227255 24070 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:46.229816 24067 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:46.230772 24066 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:46.233371 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:46.233491 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.235546 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.236531 24066 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:46.238304 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:46.242880 24065 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.226459 26903 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.248972 23962 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:46.252506 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:46.223115 26559 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:46.253551 26559 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.249469 27004 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:17:46.239573 26922 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.256628 27003 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:46.257258 24594 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:17:46.259042 26560 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.266039 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:46.259888 26625 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.264792 26513 consensus_queue.cc:1059] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:17:46.268383 26513 raft_consensus.cc:3055] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.268771 26513 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:46.265385 26667 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.270571 26957 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.276124 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:46.264812 26922 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:46.259498 26560 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.295766 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.296682 24066 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:46.297520 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:46.274413 26100 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:46.299603 23960 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:46.269631 26513 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.316658 26513 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.318437 26892 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:46.321324 23921 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:46.308616 23989 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:46.310082 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.310900 23912 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:46.314551 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.324600 24065 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:46.279582 27004 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.326839 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 413) took 1867 ms. Trace:
I20260709 12:17:46.327615 23916 rpcz_store.cc:276] 0709 12:17:44.459833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.461573 (+  1740us) service_pool.cc:224] Handling call
0709 12:17:44.461912 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:44.462169 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:44.500791 (+ 38622us) log.cc:844] Serialized 14 byte log entry
0709 12:17:46.186894 (+1686103us) spinlock_profiling.cc:243] Waited 9.91 ms on lock 0x7b18001bfb20. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f223a 00007f75c0c5ca2a
0709 12:17:46.326323 (+139429us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:46.326399 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:46.326507 (+   108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.326637 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:46.326755 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38444,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":5728,"raft.queue_time_us":104,"spinlock_wait_cycles":22801664,"thread_start_us":139037,"threads_started":1}
I20260709 12:17:46.280014 26606 consensus_queue.cc:1059] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:17:46.329777 26881 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:46.305681 26704 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:17:46.322376 26100 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.320453 26716 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 12:17:46.353062 26992 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.605s	user 0.004s	sys 0.001s
I20260709 12:17:46.343564 26956 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:46.336320 26625 consensus_queue.cc:1059] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:17:46.350411 26880 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:46.383373 26829 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.383946 26829 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.386065 26829 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:46.387776 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.388586 23989 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:46.372062 26937 raft_consensus.cc:3055] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.402925 26937 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:46.403707 26937 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.404825 26937 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.397807 26625 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:46.371996 26716 consensus_queue.cc:1243] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer 0829ddf18f07439086398756b9c6d216 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:17:46.407239 26881 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:46.417347 24035 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:46.411192 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1868) took 1976 ms. Trace:
I20260709 12:17:46.419368 26738 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.420109 23992 rpcz_store.cc:276] 0709 12:17:44.435238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:44.436947 (+  1709us) service_pool.cc:224] Handling call
0709 12:17:44.437300 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:44.441860 (+  4560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:44.441902 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:44.442442 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:17:45.613214 (+1170772us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b1800428860. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:17:45.675514 (+ 62300us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:45.675561 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.675630 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:46.274698 (+599068us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:46.410993 (+136295us) raft_consensus.cc:1685] finished
0709 12:17:46.411014 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:46.411136 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26660,"raft.queue_time_us":4259,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":4222,"spinlock_wait_cycles":145096832,"thread_start_us":62130,"threads_started":1,"wal-append.queue_time_us":1286066}
I20260709 12:17:46.429579 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:46.417165 26881 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.373200 26956 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.443478 26654 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:46.443637 26794 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.444142 26654 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.444247 26794 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.443531 26907 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:46.446400 26907 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.446972 26513 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:46.447489 26513 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.448544 26560 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.456130 24035 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:46.456913 26794 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.457844 26738 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:46.460496 26852 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:46.409344 26625 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:46.461898 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:46.395854 26880 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.458590 26965 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:46.469594 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:46.469696 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.468794 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:46.471119 23913 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:46.471447 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 143691us
I20260709 12:17:46.458570 26858 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.473557 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.471223 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:46.476680 23921 raft_consensus.cc:2368] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:46.476922 23919 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:46.473803 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.475404 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.477697 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.478508 23921 raft_consensus.cc:2410] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:17:46.478741 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:46.479503 23916 raft_consensus.cc:2410] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:17:46.478144 23912 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:46.460265 24035 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:46.477942 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:46.484760 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 157275us
I20260709 12:17:46.468396 26560 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:46.486538 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.486647 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.488643 23915 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:46.490449 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.487484 23962 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:46.483927 24035 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:46.493646 26560 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:46.495604 26560 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.496974 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.475638 26920 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:17:46.486172 26954 raft_consensus.cc:2764] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:46.460100 26794 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:46.507565 23913 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:46.503192 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:46.511724 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.514959 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.515246 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:46.505539 26873 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.518931 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.519765 26880 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.521633 23996 raft_consensus.cc:3055] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.521993 23996 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:46.522562 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:46.499935 26956 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.531466 26956 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:46.532145 26956 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.532658 26956 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.509686 26829 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.534938 26829 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.537113 26829 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:46.538579 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:46.539244 24593 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:46.504616 26954 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:46.525074 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.525242 27013 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:46.526263 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.510938 26794 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.524959 26513 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.530828 26100 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:46.523548 26704 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:17:46.494132 26731 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.540499 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:46.481909 26858 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.544267 23989 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:46.548521 26920 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:46.555497 26920 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:46.555773 26858 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.555867 26920 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.556280 26794 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.558900 26704 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:46.522671 23996 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.548143 26905 consensus_queue.cc:1059] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:17:46.566378 26905 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:46.566788 26905 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:46.566473 26911 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.567713 26911 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.567566 26905 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.574618 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.576463 24593 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:46.581326 23996 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:46.586462 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.587522 23913 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:17:46.590165 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.591060 23918 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:46.591554 26559 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.595692 23921 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:46.587545 23962 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:46.598583 23915 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:46.543277 26907 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.601336 23989 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:46.603446 24034 leader_election.cc:400] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6.
I20260709 12:17:46.568689 26905 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.604676 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.606391 23992 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:46.607880 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:46.502343 26625 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.620747 23996 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:17:46.622129 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 119028us
I20260709 12:17:46.593916 26559 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.641911 24035 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:46.627277 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:46.648054 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.651156 24594 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:46.653121 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:46.653882 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:46.654693 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:46.655396 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:46.605836 26767 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:17:46.656541 24597 raft_consensus.cc:2368] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8.
I20260709 12:17:46.599920 26859 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.052s
W20260709 12:17:46.644114 27003 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:17:46.659075 23920 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:46.661242 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:46.662741 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:46.603292 26704 consensus_queue.cc:1059] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:17:46.642155 26937 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:46.666674 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:46.666206 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:46.664106 26851 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.672128 26851 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:46.673441 27011 log.cc:927] Time spent T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.283s	user 0.003s	sys 0.000s
I20260709 12:17:46.658568 26625 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:46.651718 26872 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:17:46.678930 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:46.679986 27009 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.308s	user 0.000s	sys 0.004s
I20260709 12:17:46.674096 26851 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.685585 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.660099 26513 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:46.693181 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.668967 26937 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.651640 26903 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.695143 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:46.725297 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 58708.9us
I20260709 12:17:46.725963 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.681114 26954 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:46.730741 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.735286 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:46.688632 26956 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.739033 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.739642 23916 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:46.740435 23917 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:46.736922 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.737727 24566 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:46.738229 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:46.714098 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45950.5us
I20260709 12:17:46.683728 26870 consensus_queue.cc:1059] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:17:46.678910 27005 raft_consensus.cc:3055] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:46.691715 26100 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:46.746109 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.747282 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:46.751484 23916 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:46.703020 26937 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:46.714514 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60520.5us
I20260709 12:17:46.724447 26964 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.737803 26895 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:46.703075 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:46.757905 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:46.766144 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 63156.5us
W20260709 12:17:46.766429 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 52936.8us
I20260709 12:17:46.754397 24564 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:46.761256 26713 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:46.745380 26540 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:46.767419 23887 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:46.737576 27023 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:46.690349 27013 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:17:46.730741 26954 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:46.750820 27005 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:46.751119 26100 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:46.798317 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 144496us
I20260709 12:17:46.755898 27012 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:46.699050 26513 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.764881 26895 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:46.808347 23915 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:46.811427 26830 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:46.811614 27016 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:17:46.803284 26100 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:46.812898 26895 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.813872 26895 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:46.814270 26654 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.814854 26654 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.815284 26654 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.817392 26654 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.781136 26540 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:46.800055 26954 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:46.810863 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 43537.2us
W20260709 12:17:46.852497 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.854547 23921 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:46.806691 27023 raft_consensus.cc:697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:46.768224 26964 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.848623 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:46.861135 23920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2045) took 1459 ms (client timeout 1609 ms). Trace:
W20260709 12:17:46.863708 23920 rpcz_store.cc:269] 0709 12:17:45.401610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.404426 (+  2816us) service_pool.cc:224] Handling call
0709 12:17:46.860926 (+1456500us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b540017af54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:46.861061 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2884022016}
W20260709 12:17:46.870843 27021 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:46.873732 26513 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.874850 26903 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.874512 27005 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.875962 27005 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:46.877233 27014 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:17:46.877127 26654 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:46.821250 26713 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:46.878492 26713 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.878837 26713 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.882123 26964 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:46.854140 26540 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:46.885538 26920 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.886407 27027 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:46.810089 27012 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.877923 26654 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.891230 27023 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.892195 26738 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:46.896611 24596 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:46.927452 26954 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:46.933427 27012 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:46.934430 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:46.921763 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73224us
I20260709 12:17:46.954221 26830 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:46.955343 26767 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:46.955710 26767 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:46.956775 26767 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:46.959753 26964 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:46.962888 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:46.965400 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:46.971087 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 207228us
I20260709 12:17:46.979748 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:46.982508 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.982868 24063 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.984413 24063 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:46.985705 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:46.986081 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 219082us
I20260709 12:17:46.987018 24036 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:46.987046 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.988108 24070 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:17:46.992313 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.993999 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.994776 24070 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:46.996786 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.997668 24070 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:46.998770 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.999855 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.001508 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.002120 24067 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 4.
I20260709 12:17:47.002856 24070 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:46.975955 26903 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:46.975258 26559 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.004423 27045 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:47.033739 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:47.018415 26654 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.005901 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.966300 26899 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:17:47.020666 26713 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.024629 26937 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.029485 24036 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:47.031742 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 277392us
I20260709 12:17:47.036934 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:47.037624 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.038267 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.038357 24062 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:17:47.038789 23913 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:47.040417 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:46.995487 26829 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.981577 27022 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.044962 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:47.057322 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.057349 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.058630 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.059182 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.059520 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.050612 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:47.060124 24069 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:47.050807 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:47.053097 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.001493 26390 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:47.048599 24066 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:47.060786 24063 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.062762 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.033680 26903 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.063700 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.060418 23989 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:47.065095 24066 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:47.066871 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.067818 24070 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.032097 26954 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:47.069866 24062 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:47.072072 24062 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:47.066102 24564 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:47.068967 26903 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:47.075388 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.079162 23915 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:47.076005 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.080817 24068 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:47.081091 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.081799 24066 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:47.082845 24066 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:17:47.086257 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:47.090116 24068 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:47.073450 27043 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.088676 24063 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:47.101024 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:47.043229 27045 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.101704 24596 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:47.103219 27045 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:47.090746 27033 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:47.104203 27033 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.104547 27033 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:47.062484 26829 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.107722 24062 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:47.108480 26829 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:47.106339 27027 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.110306 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.110967 24069 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:47.086452 26906 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:47.168352 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 190387us
I20260709 12:17:47.099009 26920 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.068786 26390 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.175262 26540 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.176432 24593 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:47.122519 26937 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.177277 26390 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:47.169798 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:47.178678 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:47.179066 23915 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.179468 26713 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.181625 26540 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.182956 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:47.184394 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:47.185137 24070 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:47.190053 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.190860 24068 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:47.193126 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:47.199903 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:47.216477 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.067616 27022 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.219732 24069 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:47.224771 26540 consensus_queue.cc:1059] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:47.226372 26540 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:47.228047 26540 raft_consensus.cc:3055] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:47.228443 26540 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:47.226140 27035 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.232470 27043 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.233748 24591 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:47.236284 23919 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:47.238515 24592 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:47.238710 26540 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.240170 26540 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:47.243731 26100 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.254657 24064 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:47.251945 23915 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:47.256405 24061 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:47.260176 27022 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:47.266182 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:47.273319 26738 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:47.277832 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 248414us
I20260709 12:17:47.221939 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:47.278810 26907 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:47.279268 26907 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:47.279691 26907 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.280099 27037 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:17:47.281774 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 111773us
I20260709 12:17:47.281878 26954 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:47.283071 26954 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.283438 26954 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.286829 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:47.288439 27045 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:47.289152 27045 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:47.290015 27045 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.288424 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.297497 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:47.298156 26911 consensus_queue.cc:1059] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:47.311262 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 89379.8us
I20260709 12:17:47.312131 26911 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:47.312510 26911 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:47.312367 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:47.313567 26540 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:47.314152 26540 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:47.314390 26365 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:47.314714 26540 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:47.315286 23818 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39296 (request call id 306) took 22328 ms (client timeout 15000 ms). Trace:
I20260709 12:17:47.302270 26876 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:47.311261 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:47.316160 26876 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:47.316489 26876 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:47.302632 26767 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:47.317251 26876 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.318773 26876 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.303411 26859 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:47.288224 26873 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:47.314913 26365 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.321795 26606 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:47.323555 26365 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:47.324608 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:47.325346 24593 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:47.326458 26100 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:47.305951 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:47.336405 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 251600us
I20260709 12:17:47.337184 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.337514 24566 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:47.338584 24593 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:17:47.338747 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.339073 24593 pending_rounds.cc:85] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 6
I20260709 12:17:47.339465 24593 pending_rounds.cc:107] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:17:47.339766 24593 raft_consensus.cc:2889] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:47.343554 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:47.345635 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:47.345966 24596 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:47.347709 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:47.348199 23991 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.368221 23989 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:47.368594 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 49097.1us
I20260709 12:17:47.369551 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:47.387967 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.421640 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:47.370956 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.459338 23991 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
W20260709 12:17:47.460206 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 124033us
I20260709 12:17:47.463112 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.463891 23913 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:47.466022 23960 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:47.332784 26738 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:47.479354 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 108478us
I20260709 12:17:47.480140 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.480304 24035 leader_election.cc:400] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8.
I20260709 12:17:47.481158 24035 leader_election.cc:403] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:17:47.478044 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 115445us
I20260709 12:17:47.359622 27019 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.313462 26911 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.489400 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.404381 26873 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:47.491943 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:47.517915 23919 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:47.493371 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.403707 27043 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.498649 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.524266 23920 raft_consensus.cc:2368] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7.
I20260709 12:17:47.504065 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.501497 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.634675 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:47.636528 23916 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:47.509370 23887 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.3:42409 timed out after 1.611s (SENT) [suppressed 7 similar messages]
I20260709 12:17:47.504974 23915 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:17:47.655524 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 175224us
I20260709 12:17:47.657023 24035 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:47.422290 26654 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:47.482791 26769 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 12:17:47.645561 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.507347 23989 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:17:47.646641 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 138415us
I20260709 12:17:47.524664 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.663582 24065 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:17:47.648756 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 168568us
I20260709 12:17:47.571460 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.535326 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.668720 24069 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:47.475996 26100 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:47.509791 26365 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:47.511919 26540 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.509240 26713 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.679823 26654 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:47.680999 26654 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.679970 26713 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.513945 26790 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:47.684731 26790 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.507375 26903 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.686861 26881 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:47.688297 26790 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:47.517201 26905 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.505231 26704 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:47.689652 27054 log.cc:927] Time spent T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:17:47.690197 26704 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:47.640983 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 138080us
I20260709 12:17:47.693327 26704 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.505733 26907 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.482486 26829 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.697168 26907 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.570561 26911 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:47.697474 26829 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.565775 26957 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:47.521370 24064 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:47.529579 26873 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:47.567770 26859 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:47.708132 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.708040 26859 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.708375 26873 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.598587 27004 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:47.369299 27026 consensus_queue.cc:1059] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.136s
I20260709 12:17:47.710718 27004 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:47.711812 27026 raft_consensus.cc:3055] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:47.712287 27026 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:47.712328 27004 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:47.332773 23818 rpcz_store.cc:269] 0709 12:17:24.986750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.994738 (+  7988us) service_pool.cc:224] Handling call
0709 12:17:25.657203 (+662465us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400180510. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2e0b2 00007f75c6aa7759 00007f75c6a3fa76 00007f75c6a10d58 00007f75c6b0f04e 00007f75c4fd02a4 00007f75c4fd0232 00007f75c4fd0161 00007f75c4fd00dc
0709 12:17:47.315217 (+21658014us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:41.615695 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:41.903277 (+287582us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:41.912640 (+  9363us) write_op.cc:435] Acquired schema lock
0709 12:17:41.912665 (+    25us) tablet.cc:662] Decoding operations
0709 12:17:42.226766 (+314101us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:42.228693 (+  1927us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:42.228729 (+    36us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:17:42.231264 (+  2535us) tablet.cc:701] Row locks acquired
0709 12:17:42.231311 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:17:42.231507 (+   196us) write_op.cc:270] Start()
0709 12:17:42.231657 (+   150us) write_op.cc:276] Timestamp: P: 1783599462231437 usec, L: 0
0709 12:17:42.231677 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:17:42.234052 (+  2375us) log.cc:844] Serialized 4397 byte log entry
0709 12:17:42.336595 (+102543us) spinlock_profiling.cc:243] Waited 9.22 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75bdb480ac 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b
0709 12:17:43.791011 (+1454416us) op_driver.cc:464] REPLICATION: finished
0709 12:17:44.691768 (+900757us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75bdb480ac 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c4688ef0
0709 12:17:44.948191 (+256423us) write_op.cc:301] APPLY: starting
0709 12:17:44.967179 (+ 18988us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:45.007146 (+ 39967us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:45.012882 (+  5736us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:45.197193 (+184311us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:45.197631 (+   438us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:17:45.197699 (+    68us) write_op.cc:312] APPLY: finished
0709 12:17:45.198182 (+   483us) log.cc:844] Serialized 83 byte log entry
0709 12:17:45.221418 (+ 23236us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:45.223934 (+  2516us) write_op.cc:454] Released schema lock
0709 12:17:45.226443 (+  2509us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:45.250910 (+ 24467us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:45.252311 (+  1401us) write_op.cc:454] Released schema lock
0709 12:17:45.649802 (+397491us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54002e4354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c4f32a 00007f75c0bd4f14 00007f75c0bd4ec3 00007f75c0bd4e38 00007f75c0bd4df3 00007f75c0bd40dc 00007f75c0bfde16 00007f75c0be5cbb 00007f75c0bd039d 00007f75c0bd3d75
Metrics: {"mutex_wait_us":6137177,"reported_tablets":24,"spinlock_wait_cycles":261891328,"child_traces":[["op",{"apply.queue_time_us":1078030,"apply.run_cpu_time_us":11733,"apply.run_wall_time_us":299783,"num_ops":11,"prepare.queue_time_us":487382,"prepare.run_cpu_time_us":32597,"prepare.run_wall_time_us":1058922,"raft.queue_time_us":592978,"raft.run_cpu_time_us":46992,"raft.run_wall_time_us":1942736,"replication_time_us":1541326,"spinlock_wait_cycles":123734400,"thread_start_us":1880385,"threads_started":5,"wal-append.queue_time_us":530525,"wal-append.run_cpu_time_us":58567,"wal-append.run_wall_time_us":3039725}]]}
I20260709 12:17:47.509308 27035 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:47.717074 27035 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:47.478603 27039 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:47.718966 27039 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.685141 26365 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:47.720400 26365 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:47.589327 27022 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8.
W20260709 12:17:47.723582 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 66820.2us
I20260709 12:17:47.724890 27022 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:47.509449 26964 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:47.688251 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:47.714035 27004 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.698164 26895 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:47.730640 26895 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.731168 27035 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:17:47.732101 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 44226us
I20260709 12:17:47.731974 27035 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.733351 27012 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.704403 26957 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.524175 27019 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.734934 24566 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:47.708598 23914 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:47.511024 27033 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.736254 27063 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:47.736773 27063 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:47.737361 26957 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:47.738014 24594 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:47.738225 27033 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.733353 26895 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:47.739476 26829 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:47.701017 26903 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.511471 27037 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:17:47.688087 26881 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.737143 27063 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:47.744324 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.746062 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.747015 26881 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:47.724785 24035 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:47.713876 27026 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.749665 27037 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:47.757622 27026 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:47.710933 26540 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.760376 26859 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:47.765108 27035 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.750397 24035 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.729727 26937 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:47.719275 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:47.750910 27039 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:47.750257 26713 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:47.765180 24061 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:47.693990 26704 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:47.777983 24065 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:47.787710 23916 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:47.737087 27019 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:47.791509 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 260884us
I20260709 12:17:47.808719 26704 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.793325 24035 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.811790 24035 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.812770 27056 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.813642 27056 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.814513 27039 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:47.815392 27039 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:47.819097 24035 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:47.820439 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:47.821477 24596 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:47.822664 26937 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.822654 26903 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:17:47.825078 26903 raft_consensus.cc:3055] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:47.825183 26937 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.825583 26903 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:47.794337 23919 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:47.796808 26365 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.798537 27065 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:47.805500 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:47.828244 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.839385 26704 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:47.846071 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 78512.7us
I20260709 12:17:47.846670 26365 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:47.849514 26954 consensus_meta.cc:287] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.565s	user 0.002s	sys 0.017s
I20260709 12:17:47.850512 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.851281 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:47.857694 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 138815us
I20260709 12:17:47.860924 23886 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:47.861626 26956 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:47.862526 26956 raft_consensus.cc:697] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:47.864265 26448 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:47.864687 26448 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.835305 27056 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:47.870517 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 51662.8us
I20260709 12:17:47.871416 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.852160 27039 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.868147 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:47.878500 26767 consensus_meta.cc:287] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.560s	user 0.002s	sys 0.015s
I20260709 12:17:47.879106 23915 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:47.867805 26448 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.865861 26937 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.878659 26876 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.902866 26876 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.905546 26876 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.891808 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.893653 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.894676 24591 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:47.897027 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.898216 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.877840 26903 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.906096 26876 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.928644 26876 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.930979 26876 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.931260 23990 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:17:47.931418 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.931954 24065 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:47.932250 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:47.932482 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.932941 23914 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:47.933310 24069 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:47.934224 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:47.934939 26903 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:47.936344 24596 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:47.938715 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.941159 26922 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:47.946880 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.947029 24566 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:47.947736 24066 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:47.948807 26769 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:47.950016 26769 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:47.950417 26769 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:47.951673 26769 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.953037 26540 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:47.953433 26540 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:47.953765 26540 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:47.955062 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.955145 24065 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:47.932003 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.959599 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.959825 23960 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:47.962232 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.963025 23919 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:47.934960 24063 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:47.931679 23990 pending_rounds.cc:85] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 2
I20260709 12:17:47.932298 24064 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:47.872314 26654 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.945251 23816 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 5 to 6, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 6 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:47.976775 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:47.978361 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:47.979674 27040 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.572s	user 0.005s	sys 0.000s
I20260709 12:17:47.979846 26767 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:17:47.982606 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 149318us
I20260709 12:17:47.985064 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.986567 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1901) took 1323 ms. Trace:
I20260709 12:17:47.965328 26937 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.987004 23996 rpcz_store.cc:276] 0709 12:17:46.662631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.662747 (+   116us) service_pool.cc:224] Handling call
0709 12:17:46.663020 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:46.666019 (+  2999us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:46.822959 (+156940us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.173716 (+350757us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.190344 (+ 16628us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:47.191237 (+   893us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.191404 (+   167us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:47.191447 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.191523 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.897627 (+706104us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:47.986072 (+ 88445us) raft_consensus.cc:1685] finished
0709 12:17:47.986113 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.986379 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18775,"prepare.queue_time_us":24628,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":43659,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":15801,"spinlock_wait_cycles":43683584,"thread_start_us":482970,"threads_started":2,"wal-append.queue_time_us":509524}
I20260709 12:17:47.988740 26937 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:47.915910 26956 consensus_queue.cc:237] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.964574 23990 pending_rounds.cc:107] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:17:47.990406 23990 raft_consensus.cc:2889] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:47.991593 27056 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:47.992158 26769 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:47.992374 27056 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:47.866886 26954 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:47.999233 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.003685 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.002307 23960 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.006052 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:47.995594 27056 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.010592 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.011233 24594 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:17:48.011652 26390 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:48.012197 26390 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:48.013129 27056 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.013216 26390 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:48.013809 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 79788.5us
I20260709 12:17:48.014671 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:48.019290 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.024133 26448 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.024399 26540 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:47.997797 23816 catalog_manager.cc:5697] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:48.031844 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 46973us
W20260709 12:17:48.049912 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.055356 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:47.994671 27063 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.037220 27039 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.043730 26895 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:48.061575 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:48.067353 26448 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.077837 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.048130 27056 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:48.074023 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.081213 24061 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:48.081723 24063 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:17:48.068169 26895 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.087611 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:48.078348 23816 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:48.088203 24594 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.090723 26606 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:48.091368 26606 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:48.091007 23816 catalog_manager.cc:5697] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 3 to 7, term changed from 2 to 6, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:48.092561 26606 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.093192 26905 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:48.094223 24595 raft_consensus.cc:1240] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:48.095558 24070 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 9. Ops: []
I20260709 12:17:48.096524 27066 consensus_queue.cc:1059] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:17:48.098052 27066 raft_consensus.cc:3055] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:17:48.101059 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45876.9us
I20260709 12:17:48.106024 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.088651 26895 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.098510 27066 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:48.085510 26873 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:48.084038 27039 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.120560 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.121197 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.113358 26922 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.141847 26922 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.145284 24065 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:48.126413 27051 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:48.129374 23912 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:48.146449 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.130347 24068 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:48.130995 26654 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.118587 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:48.131762 24591 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:48.134202 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:48.138170 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 94465.2us
I20260709 12:17:48.140950 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:48.134667 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:48.146486 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.173453 23962 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.180060 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.173030 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.217274 24598 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:48.171416 27077 log.cc:927] Time spent T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:17:48.165079 27070 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:17:48.161456 27072 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:17:48.192540 26905 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:48.164270 27012 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:48.170929 27004 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.224139 26905 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.225533 24062 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:48.172051 26540 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.227118 26873 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.224905 27004 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:48.228827 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.209934 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.229327 26873 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.229492 26899 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:48.229970 26899 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.230360 26899 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.231498 27063 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.231649 27004 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.231774 27012 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:48.232965 27012 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:48.236322 26922 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.242228 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:48.249593 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:48.247716 27064 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:48.170506 26859 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.242975 26964 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:48.249869 26448 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.214241 26937 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.250648 26667 consensus_queue.cc:1059] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:48.219538 26769 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:17:48.135136 27056 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:48.253364 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 43527.2us
I20260709 12:17:48.279579 23962 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.253866 26790 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:48.165225 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.261431 24594 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
W20260709 12:17:48.267302 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 48260.7us
W20260709 12:17:48.271518 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 63475.9us
I20260709 12:17:48.252591 26365 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.281323 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:48.297521 23991 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:17:48.295333 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.274320 24599 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:48.296582 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.301236 24566 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:48.299448 26964 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:48.300092 26905 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.310160 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.308842 24592 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:48.334739 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:48.285744 23962 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.363153 23991 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:17:48.310964 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 478) took 1223 ms. Trace:
I20260709 12:17:48.332723 23816 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:48.371616 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.300729 26873 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:48.374413 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 88783.9us
I20260709 12:17:48.326443 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.337386 26713 raft_consensus.cc:2764] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:17:48.309167 26859 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.376969 26957 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:48.378353 26859 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.378429 23996 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:17:48.379093 23915 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:48.330884 26964 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:48.380277 26964 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.375269 23917 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:48.375520 23961 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.318856 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:48.384100 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 49483.7us
I20260709 12:17:48.384433 23961 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.383391 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.386071 24566 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:48.322873 27039 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:48.314494 26954 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:48.324364 26903 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:48.332465 27065 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:48.371318 23988 rpcz_store.cc:276] 0709 12:17:46.989334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.989456 (+   122us) service_pool.cc:224] Handling call
0709 12:17:47.262769 (+273313us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2de9c 00007f75bdb2da5b 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c2bfc0 00007f75c5c16929 00007f75c5c163d2 00007f75bf18dbd4
0709 12:17:47.262987 (+   218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:47.263259 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:17:47.263556 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 12:17:48.071644 (+808088us) log.cc:844] Serialized 14 byte log entry
0709 12:17:48.101790 (+ 30146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:48.105393 (+  3603us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:17:48.110073 (+  4680us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.117262 (+  7189us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.212470 (+ 95208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56617,"prepare.queue_time_us":274974,"prepare.run_cpu_time_us":104,"prepare.run_wall_time_us":8076,"raft.queue_time_us":52097,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":5087,"spinlock_wait_cycles":3718400,"thread_start_us":636011,"threads_started":2,"wal-append.queue_time_us":339295}
I20260709 12:17:48.395349 26540 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:48.337069 27051 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:17:48.392946 23816 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 2, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 2 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:48.401610 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.388892 26713 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:48.329077 26895 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.387266 26957 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:48.362648 26365 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.415788 26540 raft_consensus.cc:697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:48.355252 26899 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.396797 26903 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:48.387112 27064 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 12:17:48.423272 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 47949.7us
I20260709 12:17:48.417873 23816 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:48.439359 23915 raft_consensus.cc:2410] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:17:48.438825 23962 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:17:48.444494 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 60154.2us
I20260709 12:17:48.446967 23961 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.311673 27066 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:48.449582 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 127974us
I20260709 12:17:48.450883 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.452584 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:48.437328 26713 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:48.440989 26859 raft_consensus.cc:2764] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:17:48.454319 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:48.463791 24070 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.461615 26540 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.465687 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:48.464210 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:48.467316 23886 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:48.450146 27012 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.477530 27012 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.459978 26876 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:48.458123 27065 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.482700 26876 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.468142 23816 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 5, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 5 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:48.483114 26876 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.483650 23816 catalog_manager.cc:5697] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 4, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 4 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:48.473158 26957 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:48.486443 27087 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:48.486608 26957 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:48.487017 26957 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.487495 26767 raft_consensus.cc:3055] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:48.487876 26767 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:48.488255 24070 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:48.488670 26767 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.489872 26767 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:48.481362 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 231881us
I20260709 12:17:48.457837 26390 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:48.492264 24592 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:48.485191 23816 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 6, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 6 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:48.466890 27004 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:48.497321 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.497831 24599 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:48.487035 27087 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:48.498522 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:48.502475 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:48.506204 26713 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.507763 26365 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.496045 27004 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:48.514693 26903 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.522866 27004 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.523468 26903 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.524708 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.525262 23919 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.515712 24067 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.531538 23912 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:17:48.532482 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.533957 26873 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.534530 26873 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.537053 26873 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.517350 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.538956 23916 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:48.498791 26829 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:48.539829 26829 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.541914 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.542785 26829 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.544040 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.545023 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.545485 24067 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:48.545643 24062 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:48.518441 27087 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.519162 27056 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.497354 27068 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:48.546936 27068 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:48.547525 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:48.547821 27068 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.520287 26899 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.520704 26513 raft_consensus.cc:3055] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:48.550268 26895 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.550441 26513 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:48.551198 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.551857 24061 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:48.495723 27066 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.553651 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.554078 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:48.556238 23991 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:17:48.558697 23961 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.538148 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.559126 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:48.498551 27012 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.551415 26513 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.559675 24063 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.492431 27065 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:48.571929 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 114657us
I20260709 12:17:48.562829 23919 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:48.570906 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.580682 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:48.582340 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 65851.8us
I20260709 12:17:48.585065 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.585848 23916 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.586527 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.500182 26448 consensus_queue.cc:1059] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:17:48.583676 27051 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:48.565529 26899 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.596271 24063 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:48.570946 27012 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.600883 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.561729 26876 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.588121 26859 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:48.602627 24061 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:17:48.603771 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.600122 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:48.607016 24063 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:48.607925 27056 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:48.608466 27056 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:48.591567 26829 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.612437 26829 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.608512 26911 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:48.614720 26911 raft_consensus.cc:697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:48.598294 26957 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.615693 26911 consensus_queue.cc:237] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.617566 26957 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.617369 26964 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.604746 26859 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.619166 26859 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.619673 26899 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.620438 23988 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:17:48.621268 27012 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.621862 26899 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.622218 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:48.626729 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:48.602145 27087 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:17:48.590986 26873 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.584326 26895 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:17:48.622381 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:48.602803 26513 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.595600 26365 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.597585 27065 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.650413 27065 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.650784 27064 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:48.638768 23962 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.643755 24065 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.638046 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:48.652849 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 54228.7us
I20260709 12:17:48.646149 24036 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.653959 23914 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:48.655773 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.656481 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.658552 26876 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.658756 26829 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.654608 24566 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:48.660349 23916 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:48.660646 24036 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:48.656474 23919 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:48.662712 23912 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:17:48.662576 26365 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.662978 26873 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.670739 26899 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:17:48.671353 27096 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:17:48.671800 27039 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:48.672853 23962 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:48.663149 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.674072 23962 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.659732 26905 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:48.675495 26390 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:48.675948 26390 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.676057 27012 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:48.676348 26390 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:48.663923 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.679728 24598 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:48.681298 26957 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:48.685267 26859 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.664511 23960 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.687004 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.666792 23915 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:48.663973 24065 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:48.690519 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.670037 26873 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.609617 27056 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.689481 24566 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:48.666442 27019 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:48.695278 27019 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.697602 27019 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:48.698066 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.698243 26957 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:48.698702 26957 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.699036 26957 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:48.666859 27065 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:48.700647 26713 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:48.705370 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:48.710932 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:48.715126 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:48.715950 23994 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:48.718680 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:48.719197 24063 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.719372 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.666926 26922 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:48.667675 26365 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.727406 24599 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:48.721953 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.729362 24065 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:48.729543 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:48.726209 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.688884 27064 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:48.730463 24594 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:48.702587 26905 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:48.703409 26876 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:48.728698 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.737421 23996 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:48.728257 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.739454 24070 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:17:48.740722 24063 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:48.740788 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:48.725639 26713 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:48.742475 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.743350 24061 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:48.721129 26873 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:48.745011 26954 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:48.745427 26713 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.726632 26881 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:17:48.748878 27097 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.070s	user 0.002s	sys 0.000s
I20260709 12:17:48.730878 27064 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:48.720036 27012 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:17:48.752547 26905 raft_consensus.cc:697] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:48.754376 27056 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:48.720541 27065 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.756781 26873 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.756155 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.720279 26895 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:17:48.764298 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:48.751878 26859 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.770874 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.783987 23915 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.757344 23962 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:48.770046 26790 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:48.756449 26954 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.791087 26790 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:48.791016 26954 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.791560 26790 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.791960 26790 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.792145 26957 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.774014 27019 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:48.798822 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 77589.1us
I20260709 12:17:48.798668 27019 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.799659 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:48.801601 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:48.790977 23962 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:48.802387 27087 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:48.802481 26513 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:48.802815 27087 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.802968 26513 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.803244 27087 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.803413 26513 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.803833 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:48.804459 23988 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:48.805289 26859 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:48.805822 26859 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:48.806738 26859 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.808672 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.809651 26540 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:48.810024 26540 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.810434 26540 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:48.777055 24063 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.772212 26881 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.778134 26905 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.781255 26964 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.782434 27065 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.769194 26922 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:48.768708 27064 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:48.766686 26876 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:48.776449 26873 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:48.755694 27004 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.843325 26954 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.843976 27004 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.845342 27091 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.845734 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.846064 26954 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:48.845881 27091 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.803300 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:48.848073 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:48.816272 23915 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
W20260709 12:17:48.848623 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45395.1us
I20260709 12:17:48.800952 27019 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:48.850266 26895 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:48.850675 26895 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.851194 26895 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.851536 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:48.852278 26899 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:48.812867 26390 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.767580 26937 consensus_queue.cc:1059] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:17:48.835088 26767 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:48.830494 26903 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:48.836090 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.856146 26390 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.856758 26390 raft_consensus.cc:3055] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:48.838310 26769 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:48.838938 26876 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.857101 26390 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:48.840518 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.860428 23912 raft_consensus.cc:2410] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:17:48.860735 23988 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:48.846339 23914 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:48.861431 24063 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:48.856156 26903 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.862339 26654 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:17:48.863215 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.863665 27065 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.864104 26903 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.864452 24070 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:48.864578 26903 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.865106 26903 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.790171 27063 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:48.866323 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:48.866459 27063 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:48.866879 27063 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.866914 24594 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
W20260709 12:17:48.841004 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:48.868629 24035 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:48.870692 23914 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:48.872937 24566 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:48.874881 26540 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.886088 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.887305 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.888976 26540 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:48.892091 26790 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.890236 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:48.900668 23996 raft_consensus.cc:2393] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:48.905393 23988 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:48.900274 23916 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:48.886024 26881 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.871840 26922 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:48.903062 24034 leader_election.cc:336] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.609s (SENT)
I20260709 12:17:48.858124 26390 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.881634 26957 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.882428 26956 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:48.932042 26956 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.932533 26956 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.848171 27091 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.921181 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:48.926687 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.927275 26922 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.931020 26903 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.900801 26790 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:48.960351 26956 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:48.964715 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.966389 27043 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:48.966807 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 63795.5us
I20260709 12:17:48.967134 27065 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:48.967829 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:48.970978 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 241486us
I20260709 12:17:48.972782 23914 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:48.973062 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.937893 26895 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:48.986773 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:48.987459 23916 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:48.986816 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:48.988770 24594 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:48.988863 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:48.993433 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:48.995270 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 240242us
I20260709 12:17:49.003607 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:49.006444 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:48.966801 27043 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:48.925261 27087 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.017078 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.022109 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.022919 23921 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:48.969477 27064 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:49.053149 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.086949 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.109297 23919 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:49.118728 23915 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:49.118770 23916 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:49.014780 27043 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:49.009382 26964 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:49.119299 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 77251us
I20260709 12:17:49.122695 27064 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:49.123303 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.154016 23920 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:49.141312 24066 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:17:49.124485 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.125149 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.125873 26956 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:49.126927 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:49.129393 27087 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:48.995298 26873 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.134531 26769 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:49.135293 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.161258 24594 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:49.173306 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:49.182483 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 191136us
I20260709 12:17:49.186610 23961 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:49.015275 26513 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:49.188221 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:49.189621 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:49.191367 24068 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.197674 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:49.198581 24061 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:49.197685 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:49.201961 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:49.209762 24062 raft_consensus.cc:2393] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:49.210566 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:49.211390 24594 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:49.213933 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 87132.2us
I20260709 12:17:49.215385 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:49.217023 23914 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:17:49.242527 27105 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:17:49.191670 26769 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:49.197750 26957 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:49.255098 26769 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:49.183008 26964 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:49.254724 26957 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:49.298763 24068 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:17:49.300334 24062 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:49.261487 23913 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:49.262828 23988 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:17:49.263520 24594 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:49.237287 26903 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:49.216632 27087 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:49.311228 26964 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:49.311058 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:49.311616 27103 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:49.316859 26767 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:49.319180 26390 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.321270 27019 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:49.323094 26873 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:49.290354 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:49.331863 24598 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:49.331001 23912 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:49.334532 23987 raft_consensus.cc:2368] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
W20260709 12:17:49.338884 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.339762 23961 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:49.346428 26903 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.346767 27118 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.347185 26903 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.347411 27118 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.339125 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:49.355304 24595 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:17:49.356550 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.357764 24062 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:49.359441 23960 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:49.365700 23912 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:17:49.386798 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.389400 24069 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:49.337946 27019 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:49.397244 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.394794 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:49.376401 26654 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:17:49.407155 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 67507.5us
I20260709 12:17:49.377837 26937 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:49.379881 26895 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:49.410486 23921 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
W20260709 12:17:49.410517 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 51218.4us
I20260709 12:17:49.419308 24062 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:49.423174 23987 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:49.405089 27103 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:49.398248 26957 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:49.415423 27039 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.434140 26540 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:49.441685 24036 leader_election.cc:400] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:17:49.441918 24036 leader_election.cc:403] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:17:49.418092 27118 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:49.427176 26905 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:49.434863 27012 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:49.435151 26881 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:49.400491 27019 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.439042 26513 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:49.415469 27051 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:49.454126 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:49.460247 24598 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:49.433728 26713 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:17:49.422442 26937 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:49.467586 26873 consensus_queue.cc:1059] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:17:49.471832 27116 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 12:17:49.474908 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 58694.5us
I20260709 12:17:49.475697 27022 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:49.467880 27012 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:49.486019 27012 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.440799 27039 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.488763 27022 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:17:49.503283 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:49.510970 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 49940.9us
I20260709 12:17:49.452304 26905 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:49.443965 27111 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:17:49.517998 24062 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
W20260709 12:17:49.515439 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 80054.5us
I20260709 12:17:49.537211 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.538117 23915 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:49.542433 23913 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:49.522475 26899 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:49.523658 26881 raft_consensus.cc:3055] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:17:49.552136 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 59868.4us
I20260709 12:17:49.546512 26767 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:49.562841 26767 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:49.571290 24595 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:49.545365 26899 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.546622 26881 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:49.597436 27103 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.601810 26767 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:49.613922 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 70186.5us
I20260709 12:17:49.615337 27111 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:17:49.608686 27122 log.cc:927] Time spent T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:17:49.598858 26899 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:49.597694 27087 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.659212 23913 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:49.659742 23913 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:49.650806 26905 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:49.661054 27125 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:17:49.661525 27121 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:17:49.663529 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:49.663298 23913 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:49.664270 24061 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:49.664595 23913 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.665294 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:49.665915 24070 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:49.666536 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:49.666772 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:49.667462 23988 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:49.667989 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:49.667352 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:49.674789 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:49.691820 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:49.692672 24067 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:49.732739 23913 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:17:49.733340 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:49.740195 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:49.743428 23913 pending_rounds.cc:85] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 4
I20260709 12:17:49.743975 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:49.744625 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:49.745041 23913 pending_rounds.cc:107] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:17:49.745427 23913 raft_consensus.cc:2889] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:49.746210 23996 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:49.755369 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:49.763401 24067 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:49.775893 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:49.776785 23990 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
W20260709 12:17:49.779654 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 104953us
I20260709 12:17:49.780646 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:49.657809 27087 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:49.805207 24564 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:49.812615 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:49.782191 27063 consensus_meta.cc:287] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.915s	user 0.012s	sys 0.000s
I20260709 12:17:49.817381 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:49.819351 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:49.828523 24070 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:49.783993 27037 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:49.804358 27022 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:49.835089 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.803671 26954 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.830289 23991 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:49.804729 26964 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.843148 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:49.843523 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.844326 23912 raft_consensus.cc:2410] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:49.840184 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:49.848510 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:49.848156 27100 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:17:49.851460 23916 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:17:49.854838 23916 pending_rounds.cc:85] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 7
I20260709 12:17:49.855088 23916 pending_rounds.cc:107] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:17:49.855331 23916 raft_consensus.cc:2889] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:49.850028 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 93393.1us
I20260709 12:17:49.857553 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:49.859236 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.859966 23913 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:49.834815 26365 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:49.862116 24564 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:49.863005 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:49.866562 24065 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:49.846612 27111 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:17:49.858331 27135 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 12:17:49.875880 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.881088 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:49.825090 27063 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.887041 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.887861 27149 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:49.888414 27149 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:49.889277 27149 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.889737 27087 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:49.861459 26954 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.895087 23912 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:17:49.897176 27140 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:17:49.882509 27111 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:49.899313 27111 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.900023 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.902243 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.902547 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.902954 23916 raft_consensus.cc:2368] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:17:49.903031 24064 raft_consensus.cc:1217] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Deduplicated request from leader. Original: 6.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 12:17:49.903604 24064 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:17:49.903841 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.904517 23916 raft_consensus.cc:2368] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7.
I20260709 12:17:49.858537 26964 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:49.908169 26903 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:49.912354 27019 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.970880 26954 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:49.935963 27039 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:49.945755 26937 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:49.973591 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.974550 23961 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:49.938791 27063 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:49.916761 27043 consensus_meta.cc:287] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.729s	user 0.001s	sys 0.008s
I20260709 12:17:49.975875 27043 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.976366 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.998422 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.999050 23914 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:49.977069 24592 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:49.978313 27043 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:49.981031 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:49.982630 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.879645 26365 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:49.983651 27039 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:49.984318 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 103341us
I20260709 12:17:49.984853 27063 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:49.985337 23917 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:17:50.031589 24062 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:49.987565 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:49.987984 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:49.990720 23918 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:49.991547 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.982549 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.978003 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:49.976629 27129 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:50.029747 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:50.001420 23913 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:17:50.015228 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:50.018935 23993 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:50.040860 23919 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:50.019448 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:50.041656 24593 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:50.041850 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:50.042689 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.020687 24599 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:17:50.022486 23916 raft_consensus.cc:2376] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7. Re-sending same reply.
I20260709 12:17:50.024317 23994 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:50.026342 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:50.045007 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 57094.1us
W20260709 12:17:50.026664 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 45717.4us
I20260709 12:17:50.048758 23960 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:49.986754 26964 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:50.034233 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.035220 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:50.065160 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.035907 24061 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:50.037106 23988 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:17:50.039419 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:50.052840 23912 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:50.036690 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:50.063534 23913 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:50.064471 23920 raft_consensus.cc:2376] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6. Re-sending same reply.
I20260709 12:17:50.056866 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:50.078662 27039 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:50.079592 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.080592 26903 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:49.960507 26881 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:50.081972 26881 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.082122 23919 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:17:50.082747 27142 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:17:50.084357 23916 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:17:50.085103 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:50.086421 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:50.088106 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:50.084009 24062 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:50.094880 23994 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:17:50.096455 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 57090.5us
I20260709 12:17:50.097201 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:50.097682 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:50.044567 26954 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.038628 26859 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:50.105341 23921 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:17:50.116604 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:50.132239 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 74844.6us
I20260709 12:17:50.143903 24600 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:50.062222 27012 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:50.151609 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:50.153259 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:50.056344 26899 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:50.050199 27123 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:17:50.175866 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:50.179821 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:50.180550 24595 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 6: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:50.181970 23914 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:17:50.095651 27022 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:50.102044 26769 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:50.100344 27129 raft_consensus.cc:697] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:50.133000 27091 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.150104 27043 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:50.191648 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:50.192610 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:50.192855 27109 log.cc:927] Time spent T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:17:50.155184 26937 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:17:50.193791 27151 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:50.132000 27134 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:50.188875 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:50.101759 27037 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:50.182294 26859 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:50.175344 26829 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:50.223995 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:50.235018 24597 raft_consensus.cc:2410] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:17:50.101984 27087 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:17:50.172926 26956 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.146968 26767 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:17:50.181354 26513 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:17:50.222038 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 236150us
I20260709 12:17:50.255640 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:50.256263 23962 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:50.173295 27012 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:50.257078 27012 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.198239 24061 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:50.233340 24064 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:50.174329 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.223083 24600 raft_consensus.cc:1240] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:50.187899 26964 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:50.194964 26769 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.254760 26829 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:50.259115 24062 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:50.175583 26954 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:50.268055 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.271683 24067 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:50.228888 27043 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:50.224290 26365 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:50.274055 24061 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:17:50.196684 27022 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:50.252900 27151 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:50.287055 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 113234us
I20260709 12:17:50.292315 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.281687 27043 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:50.252386 27051 consensus_queue.cc:1059] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:17:50.243691 26704 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:17:50.264771 26769 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:50.310951 26829 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:50.311506 27022 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:50.269163 26956 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:50.333709 27119 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:50.317775 24064 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:50.303292 26881 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:17:50.338291 27109 log.cc:927] Time spent T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:17:50.242647 27037 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:50.392287 24035 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:50.396744 27153 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:17:50.397578 26903 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.334796 27151 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:50.405500 27111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.023s	sys 0.016s
W20260709 12:17:50.405853 27111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.023s	sys 0.016s
I20260709 12:17:50.407909 27043 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:50.410228 27039 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:50.419780 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:50.420787 24068 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:50.339063 27129 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:50.354130 27104 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.223s
I20260709 12:17:50.344787 26859 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:50.433676 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 387921us
I20260709 12:17:50.403470 27066 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:50.418196 27043 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:50.457871 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.438948 26899 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:50.452968 27066 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:50.471271 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 215076us
W20260709 12:17:50.472385 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 237268us
I20260709 12:17:50.467612 26829 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:50.476841 23962 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:50.472098 27066 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:50.531587 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 48253.7us
W20260709 12:17:50.532589 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55858.8us
W20260709 12:17:50.541520 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 249273us
I20260709 12:17:50.542585 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:50.544310 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:50.483014 27087 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:50.545830 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:50.548072 27160 log.cc:927] Time spent T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:17:50.549278 26881 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:50.549321 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:50.551469 26881 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.551916 26881 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:50.552317 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:50.553013 23991 raft_consensus.cc:2368] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7.
I20260709 12:17:50.553068 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:50.553925 23994 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:50.555260 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:50.541242 26365 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:50.556582 26365 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:50.557448 26365 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:50.558368 27156 log.cc:927] Time spent T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:17:50.557741 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.563282 27123 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:50.568871 27004 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:50.561499 26881 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:50.574769 26922 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:50.576757 26922 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:50.582634 26954 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:50.586150 27037 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:50.589444 23994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:50.590354 23994 raft_consensus.cc:606] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:50.598560 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:50.599332 24595 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:50.607542 24600 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:50.612545 24597 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:17:50.614459 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 467879us
I20260709 12:17:50.612462 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:50.614162 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:50.620530 24591 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
W20260709 12:17:50.608776 27141 log.cc:927] Time spent T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:17:50.631986 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.640316 23915 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:50.609977 26899 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.685137 24595 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:50.642413 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.608527 26903 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:17:50.696787 26899 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:50.617394 26956 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:50.687052 27144 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:17:50.706921 23994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:50.708024 23994 raft_consensus.cc:606] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:50.708359 23994 raft_consensus.cc:614] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:50.709710 27173 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:50.710435 27173 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:50.711637 27163 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:50.712280 27163 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:50.712245 27173 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:50.623667 27104 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 12:17:50.722666 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 164980us
I20260709 12:17:50.750447 23987 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:50.751151 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.753803 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:50.755431 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 94386.3us
W20260709 12:17:50.766963 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 301982us
I20260709 12:17:50.779917 23915 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:17:50.775665 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 138769us
W20260709 12:17:50.786320 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 252209us
I20260709 12:17:50.785441 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.757130 27163 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:50.781949 23914 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:50.782124 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:50.817602 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:50.823597 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:50.824059 24594 raft_consensus.cc:2410] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:50.776677 26905 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.818545 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:50.818822 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:50.819002 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:50.830976 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 46762.9us
I20260709 12:17:50.829917 23919 raft_consensus.cc:2376] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9. Re-sending same reply.
I20260709 12:17:50.831727 23921 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:50.772413 27087 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.820075 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:50.820344 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 64158.7us
I20260709 12:17:50.826751 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:50.833982 23987 raft_consensus.cc:606] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:50.834335 23987 raft_consensus.cc:614] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:50.826751 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:50.789072 27149 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:17:50.840097 27189 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:50.840584 27149 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:50.840729 27189 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:50.842350 27037 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:17:50.842839 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:50.841209 27149 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:50.843031 27188 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:50.819665 27167 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.848034 26905 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:50.848863 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 57699.5us
I20260709 12:17:50.850003 26899 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:50.775254 27172 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:17:50.843619 23919 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
W20260709 12:17:50.851539 27012 consensus_meta.cc:287] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.001s
I20260709 12:17:50.850893 27087 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:50.781836 27019 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:17:50.843560 27169 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:50.865769 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:50.865991 27163 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:50.867280 24065 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:17:50.909317 24065 pending_rounds.cc:85] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 7
I20260709 12:17:50.909804 24065 pending_rounds.cc:107] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 8.8
W20260709 12:17:50.890755 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 64090.5us
I20260709 12:17:50.910455 24034 leader_election.cc:400] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
W20260709 12:17:50.911115 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 269052us
I20260709 12:17:50.911509 24034 leader_election.cc:400] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7.
I20260709 12:17:50.911809 24034 leader_election.cc:403] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:17:50.895531 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73620.2us
I20260709 12:17:50.897578 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:50.914966 23987 raft_consensus.cc:606] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:50.901882 23914 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:17:50.915794 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:50.910101 24065 raft_consensus.cc:2889] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:50.919061 27149 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:50.920140 27149 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:50.921475 27149 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:50.926386 27163 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:50.913067 27168 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:17:50.825800 27051 consensus_queue.cc:1059] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:17:50.928392 26704 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:50.928800 27163 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:50.930480 26905 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:50.931089 26905 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.900602 27179 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:50.904214 27012 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:50.950914 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 118756us
I20260709 12:17:50.951800 23996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8132db9882c041d1845d0a8815c39788"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:50.934105 27012 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:50.952553 23996 raft_consensus.cc:606] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:50.909235 27037 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:50.968753 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:50.971107 27178 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.971838 27178 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:50.957579 26769 consensus_meta.cc:287] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.013s
I20260709 12:17:50.982568 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:50.986683 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 75295.5us
I20260709 12:17:50.991487 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:50.992817 24034 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:50.950183 27163 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:17:50.999557 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:51.000784 23920 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:50.995801 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:17:50.976686 26829 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7.
W20260709 12:17:51.018996 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 76427.1us
I20260709 12:17:50.976812 27151 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:51.024698 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 108951us
I20260709 12:17:50.995635 27175 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:50.996484 27182 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:51.019423 26954 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:51.004196 27181 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:50.995054 27066 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.058174 27174 consensus_queue.cc:1059] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.092s
I20260709 12:17:50.991834 26769 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:51.068317 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 65025.9us
I20260709 12:17:51.069103 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:51.085566 23921 raft_consensus.cc:2368] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8.
I20260709 12:17:51.032737 27151 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:51.131475 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 52308.8us
I20260709 12:17:51.059616 26829 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 12:17:51.141783 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 72744.6us
W20260709 12:17:51.145153 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 124833us
I20260709 12:17:51.129544 27181 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:51.146293 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:51.132817 26899 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.128902 27149 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:17:51.163640 24036 leader_election.cc:400] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7.
I20260709 12:17:51.164052 24036 leader_election.cc:403] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:51.168299 27181 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.172411 27206 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.173044 27206 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.173633 27188 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.174166 27188 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.160181 26954 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:51.154742 27210 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:51.181537 27199 raft_consensus.cc:3055] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:51.182050 27199 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:17:51.182451 27195 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:17:51.183073 27183 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:51.183406 27134 raft_consensus.cc:3055] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:51.183054 27199 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:51.184111 27165 log.cc:927] Time spent T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:17:51.183914 27183 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.184710 27199 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.186578 27183 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:51.183883 27134 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:51.192044 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.155210 27163 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:17:51.197484 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.198132 24068 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:51.200012 24070 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:51.207206 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:51.163259 26899 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.212692 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.215135 24070 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:51.220134 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.217576 23996 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:51.221143 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:51.199281 27200 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:17:51.222682 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.223621 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.227331 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:51.228268 24070 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:51.230576 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 171240us
I20260709 12:17:51.232517 27192 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:51.233040 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:51.233131 27192 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.236656 27192 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.241741 27198 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:51.242431 27198 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.244582 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.244910 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:51.245903 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.249143 23996 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.249269 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.250373 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.250963 24070 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:51.259512 24070 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:51.261111 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:51.272673 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.273612 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.275596 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.277742 27170 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:51.191354 27134 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.260152 27172 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:51.267836 27066 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.276269 26859 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:51.273856 26769 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:51.301326 27172 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.286911 26957 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:17:51.306715 27172 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:51.306852 27207 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:51.307478 27207 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.309744 27207 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.311260 26899 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.322090 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1832) took 1320 ms. Trace:
I20260709 12:17:51.323206 27134 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:51.324322 26767 raft_consensus.cc:3055] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:51.324741 26767 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:51.325635 26767 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:51.327158 27211 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:51.200063 27210 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.330530 27210 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:51.331575 23913 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:17:51.336372 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.337076 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:51.344887 23996 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:51.350320 23915 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:51.322582 24069 rpcz_store.cc:276] 0709 12:17:50.001401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.221580 (+220179us) service_pool.cc:224] Handling call
0709 12:17:50.221900 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:50.306802 (+ 84902us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:50.306836 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:50.306897 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:50.306949 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.321772 (+1014823us) spinlock_profiling.cc:243] Waited 84.7 ms on lock 0x7b5400265a54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:51.321851 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.322005 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194783616}
I20260709 12:17:51.306571 26937 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:17:51.279412 26922 consensus_queue.cc:1059] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:17:51.354465 27004 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:51.372551 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.373345 26922 raft_consensus.cc:3055] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:51.305258 27206 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.362823 27178 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.381551 27004 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:51.381349 26922 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:51.382560 27214 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:51.372212 27184 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:51.480165 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:51.459383 27103 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.479547 27181 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7.
I20260709 12:17:51.483665 27039 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.495661 27039 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:51.498909 27212 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:17:51.498699 27103 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.500227 26922 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.500857 27103 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:51.506925 27217 log.cc:927] Time spent T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:17:51.485865 27184 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.513509 27198 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:51.498025 27039 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:51.493158 27214 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.521250 27214 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.491567 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:51.528604 24065 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
W20260709 12:17:51.533629 27221 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:17:51.535576 27182 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:51.538483 27184 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:51.557300 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:51.558635 27111 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:51.559340 27111 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:51.559732 27189 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.561046 26957 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:51.561760 27151 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.561635 26957 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.564173 26704 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:51.564661 26704 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.566728 26704 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.567948 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.568600 23919 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:17:51.569608 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.573762 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.576853 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:51.578474 26954 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:51.578646 23960 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:51.579021 26954 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.579835 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:51.560398 27111 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.581228 26954 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.581820 27170 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:51.582193 27170 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.582523 27170 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:51.589406 23960 leader_election.cc:400] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8.
I20260709 12:17:51.589982 23960 leader_election.cc:403] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:51.603569 27133 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:51.608410 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.608992 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:51.609196 24595 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:51.607883 24035 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:51.610354 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.563869 26957 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.505890 27172 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.591157 26954 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:51.594648 26704 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:51.611994 27039 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:51.612370 27012 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:17:51.666312 27154 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 1.313s	user 0.003s	sys 0.003s
I20260709 12:17:51.674603 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:51.676046 24034 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:51.676234 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.674542 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:51.676842 24061 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:51.678615 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:51.660233 26513 raft_consensus.cc:3055] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:51.680397 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:51.663098 27012 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.683100 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.684053 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.684876 27232 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:51.685451 27163 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:51.685441 27232 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.687714 27232 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.682090 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:51.678072 26957 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8.
I20260709 12:17:51.704602 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:51.692545 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.680039 27181 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:51.693790 27151 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:51.679821 27133 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:51.681640 27066 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:51.697800 27170 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.699455 27163 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:51.662531 26954 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.702209 26895 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:51.689162 27012 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:51.702884 26903 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.703394 27039 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.682188 26513 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:51.679267 27162 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:51.703954 27189 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:51.710543 24061 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:51.711495 27184 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:51.727334 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 454331us
I20260709 12:17:51.620986 27004 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.718544 27133 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:51.727476 27151 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:51.734360 27189 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.767094 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2184) took 1117 ms. Trace:
I20260709 12:17:51.767577 23918 rpcz_store.cc:276] 0709 12:17:50.649638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.649917 (+   279us) service_pool.cc:224] Handling call
0709 12:17:50.650286 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:50.756393 (+106107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:50.756433 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.571516 (+815083us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b2c0001b8d8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:17:51.571964 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:17:51.720493 (+148529us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:51.720531 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.720596 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:51.766783 (+ 46187us) raft_consensus.cc:1685] finished
0709 12:17:51.766804 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.767008 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67212,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":47,"spinlock_wait_cycles":3753216,"thread_start_us":253834,"threads_started":2,"wal-append.queue_time_us":164461}
I20260709 12:17:51.769771 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.770438 23918 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:17:51.771971 27230 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:51.772056 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.772629 27230 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.774400 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.775111 23918 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:51.777056 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.777631 27133 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.778970 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:51.785135 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.786578 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.788609 23990 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:17:51.789424 23914 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:17:51.787196 23994 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:51.792689 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.793570 27210 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.794204 27210 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.795260 27170 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:51.795948 27175 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:51.796406 27170 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:51.796710 27210 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.797025 27170 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.796475 27175 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.798512 27174 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:51.798652 27169 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:51.799019 27174 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.799223 27169 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.800164 27175 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:51.800295 26954 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:51.801177 27174 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.799402 27170 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:51.801875 27169 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.733345 26903 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:51.804217 26903 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.733731 27039 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.733829 26895 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.819249 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.844938 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:51.862123 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.862919 24066 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:51.870009 24068 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:51.871547 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.872030 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.872356 24064 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
W20260709 12:17:51.873042 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 185674us
I20260709 12:17:51.847743 27172 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.807412 27151 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.880201 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.881886 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.882858 23994 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:17:51.891098 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:51.892035 24066 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:51.790246 26513 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.893124 27192 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.897787 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:51.899502 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.900573 24593 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:51.902493 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.898451 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.904863 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.904975 23917 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:51.911347 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.916594 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.918669 23994 raft_consensus.cc:2410] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:17:51.903519 27087 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:51.924125 26513 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.925912 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.927166 24064 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:51.913672 27230 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:51.930869 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.938004 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.920125 27203 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:17:51.911177 27192 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:51.946841 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.947752 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.947847 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:51.952025 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.961014 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.962255 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.964354 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.964828 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.964497 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.966444 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.966642 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.942205 27189 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:51.969732 27235 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:17:51.968995 23886 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:51.974431 24066 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:51.974596 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.980067 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.984238 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:51.985250 27189 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:51.986647 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.987250 24064 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:51.989006 24593 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:17:51.989120 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:51.990152 27111 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:51.990260 24566 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:51.975950 27231 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:17:51.991791 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.993957 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:51.971822 26922 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:51.971630 27039 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:51.975495 26895 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:51.989006 27173 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:51.990573 27111 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:51.996588 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:51.993373 24593 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:52.000874 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:52.197522 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 196707us
I20260709 12:17:52.013476 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:52.198031 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 49223.2us
I20260709 12:17:52.013777 23886 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:52.198489 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:51.997742 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:52.200356 23887 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:52.200771 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 187093us
I20260709 12:17:52.203182 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:52.001436 24069 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:52.200207 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:52.207919 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:52.209334 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:52.210069 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:52.166880 27250 log.cc:927] Time spent T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:17:52.212302 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:52.212821 23886 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:52.212308 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:51.995977 27171 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.008s	sys 0.016s
W20260709 12:17:52.168556 27236 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:17:52.188342 26767 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.215574 23912 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:17:52.097317 27111 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:52.098845 27203 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.268482 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:52.216231 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:52.200331 27233 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.260596 27037 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:52.274019 27233 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:52.274562 27037 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:52.275012 27037 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.275283 27162 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.275756 27162 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.276443 27233 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:52.205124 27189 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:17:52.272372 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 59606us
W20260709 12:17:52.260069 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 47818.2us
I20260709 12:17:52.188920 27192 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:52.005702 27225 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:52.149037 27239 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:52.272119 24566 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:52.277585 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 114640us
I20260709 12:17:52.193558 27012 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:52.260355 27171 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.008s	sys 0.017s
W20260709 12:17:52.301056 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 84908.6us
I20260709 12:17:52.301180 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:52.303505 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:52.209825 27178 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:52.214426 26903 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:52.304795 27163 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:52.342702 27163 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:52.343137 27163 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:52.305106 27149 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:52.346537 27149 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.348537 27261 raft_consensus.cc:993] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:17:52.348974 27149 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:52.349090 27261 raft_consensus.cc:1081] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:17:52.305315 27194 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.279227 27189 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.350736 27189 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.212047 26513 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:52.008086 27019 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.263s
I20260709 12:17:52.310927 23989 raft_consensus.cc:2410] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:17:52.354501 26903 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:52.356678 26903 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:52.333634 24061 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:52.339730 27178 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.357671 27178 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.261484 27210 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:52.349912 27194 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.360375 27194 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:52.214742 26954 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:52.210794 27051 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 12:17:52.279003 27087 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:52.353778 27192 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:52.362615 23990 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:52.361768 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:52.367765 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:52.314424 27043 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:52.372048 23994 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:52.374074 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:52.363598 27250 log.cc:927] Time spent T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:17:52.374452 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:52.379192 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 89706.6us
I20260709 12:17:52.380590 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:52.381913 23988 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:17:52.382309 23886 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:52.364533 26954 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.371101 27174 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:52.300769 27203 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.334266 27239 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.385707 26513 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:52.392164 27162 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:52.399006 27111 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.416618 24595 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:52.416855 27111 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:52.385818 27190 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:52.383980 27225 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:52.384298 27184 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:52.375020 27019 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:17:52.406566 27151 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:52.406654 27203 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:52.413494 27037 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.381362 27087 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:52.419178 23961 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:52.386684 26954 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:52.527004 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:52.540400 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 121322us
I20260709 12:17:52.540568 23915 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:17:52.528402 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:52.526685 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:52.387610 27174 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:52.526685 27247 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 12:17:52.577184 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:52.417487 27190 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:52.528746 27225 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:52.577698 27174 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:52.576785 26957 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:52.539734 27091 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:52.585505 27190 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:52.641793 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:52.600230 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 222851us
I20260709 12:17:52.686826 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:52.691879 24061 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:52.584381 27087 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:52.539857 27151 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:52.586910 27225 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:52.734493 27037 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:52.735321 27037 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:52.735955 27037 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:52.758890 27263 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:17:52.693787 26957 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:52.763430 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 476) took 1063 ms. Trace:
I20260709 12:17:52.763818 23920 rpcz_store.cc:276] 0709 12:17:51.700149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.815323 (+115174us) service_pool.cc:224] Handling call
0709 12:17:51.815656 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.815887 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.815914 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.816328 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 12:17:52.142342 (+326014us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:52.142398 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.142490 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:52.763190 (+620700us) raft_consensus.cc:1685] finished
0709 12:17:52.763211 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.763374 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":310545,"threads_started":1,"wal-append.queue_time_us":393199}
I20260709 12:17:52.693768 27091 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.754094 27012 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:52.778379 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 223771us
W20260709 12:17:52.780252 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 428270us
W20260709 12:17:52.781350 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 139070us
I20260709 12:17:52.782671 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:52.784111 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:52.781358 23960 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:52.810566 24061 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:52.815807 26957 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.818379 27241 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:52.807973 27012 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:52.820993 27091 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:52.821410 27189 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:52.824010 26767 consensus_meta.cc:287] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.546s	user 0.006s	sys 0.001s
I20260709 12:17:52.824605 27270 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.825106 27270 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.828878 27270 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:52.839623 23912 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:17:52.849372 27239 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:52.846345 26899 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.875057 26899 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:52.877813 26899 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:52.879240 27151 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:52.892212 27037 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:52.935779 27163 consensus_meta.cc:287] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.001s
I20260709 12:17:52.936384 27163 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:52.944022 27163 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:52.969310 26954 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:52.980332 27189 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:53.098395 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 285301us
W20260709 12:17:52.993579 27178 consensus_meta.cc:287] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.002s
I20260709 12:17:53.101223 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.105927 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.106784 23920 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:53.101414 27163 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.102149 27104 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.100780 27184 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.134249 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:53.141202 23996 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:53.149405 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.150753 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:53.113547 27037 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.114787 27265 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:53.123334 27216 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.159725 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.166074 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:53.099841 27190 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.126399 27270 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:53.168998 24061 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:53.129771 27272 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.158267 27051 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:53.107791 27178 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.131772 27174 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.217660 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:53.134991 27163 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.156165 27104 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.166532 27151 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:17:53.222525 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.214454 27051 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.168358 27184 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.219161 27189 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:53.170663 27037 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.202658 27270 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.229534 27239 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:53.273922 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:53.274662 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:53.274854 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:53.197503 27265 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.189432 27216 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.279487 27216 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.265007 27189 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.281951 27189 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.282840 27189 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.288453 27189 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.292456 27189 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.293278 27037 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.295804 26859 raft_consensus.cc:993] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:17:53.296347 26859 raft_consensus.cc:1081] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:17:53.302470 27275 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:53.303117 27275 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.303920 27274 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:53.304628 27274 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.306447 26956 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:53.307089 27268 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.307919 27037 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:53.307744 27268 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.308961 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.310222 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.310457 27269 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:53.310843 24067 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:53.311012 27269 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:53.312294 27269 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.306965 26956 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.213068 27272 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.252413 27273 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:53.314522 24065 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:53.330189 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.252948 27051 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:53.329274 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.326355 27268 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.276806 27239 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.322434 27022 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.306190 27275 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.327503 27273 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.252570 27210 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:17:53.331842 27201 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:53.327162 27199 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.344730 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:53.331892 27268 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:53.354365 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:53.337915 27239 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.336247 26954 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.401036 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:53.401787 24067 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:53.347416 27022 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.405442 27272 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.340404 27274 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.406729 27022 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.407006 27274 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:53.407469 27274 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.409473 27274 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.410626 24067 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:53.411443 27270 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.412892 27265 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.413443 27268 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.415663 27268 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.346403 27273 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.398241 27199 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.424682 27199 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.392560 27201 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.425465 27201 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:53.430629 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.431484 24067 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:53.432672 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.431957 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.356694 27275 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:53.392211 27134 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.438912 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.398590 26881 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:53.427588 26713 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.453545 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:53.438033 27275 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.439528 27199 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:53.462239 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:17:53.461264 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 157844us
I20260709 12:17:53.463188 24598 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:53.449321 27225 consensus_meta.cc:287] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.696s	user 0.012s	sys 0.000s
I20260709 12:17:53.463553 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:53.470510 27272 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:53.470973 27272 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.471315 27272 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:53.471946 27277 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 12:17:53.472927 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:53.473223 27104 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.447409 27134 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.472347 24036 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:53.476260 27134 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.476874 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:53.477626 27022 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:53.478839 27022 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:53.479127 27174 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.480597 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:53.481900 27276 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:17:53.460582 26713 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.464618 27163 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.489753 24062 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 12:17:53.462792 26956 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.491122 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:53.496143 23916 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:53.492027 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.493942 27268 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:53.494542 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:53.494576 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.486032 26713 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.499915 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.501251 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.465598 27275 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:53.503279 24067 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:53.503044 23912 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:53.498895 24062 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:53.505067 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.506206 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.507644 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:53.508057 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:53.508169 24068 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:53.505652 23912 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:53.498682 27268 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.503854 27216 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:53.509227 27268 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:53.509797 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:53.489987 27225 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.509501 27216 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.511268 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.511912 23912 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:53.510646 27233 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:53.512795 27225 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.513065 27233 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.495153 27178 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.513589 27233 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.507268 27184 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.458258 26881 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.514410 24598 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:53.517110 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:53.466096 27199 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:53.514607 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:53.551479 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:53.515666 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 182290us
I20260709 12:17:53.552841 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.553570 26956 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:53.515599 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:53.553961 26956 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.554373 26956 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.529314 27239 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.541067 24068 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:53.551111 27199 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.554459 24597 raft_consensus.cc:2368] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:17:53.513083 27216 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.539852 27273 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.561221 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:53.561735 26954 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:53.569587 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.576449 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:53.577582 26704 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.560247 27043 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.588899 27216 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.596197 27216 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.597551 27239 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.598250 27216 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.593838 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:53.599112 24593 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:53.599246 27273 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.565974 27201 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.588661 26954 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.595269 26704 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.588809 27163 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:53.570394 27178 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:53.570340 27281 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:53.602412 23912 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:53.593954 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.588661 27174 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.611968 27270 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:53.621373 27272 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.621757 27270 raft_consensus.cc:697] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:53.621665 27174 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.622884 27270 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.624859 27174 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.612310 27281 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.632277 27281 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.633184 26881 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.604132 27043 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.635565 27188 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.636778 27043 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.637046 23991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 519) took 1509 ms. Trace:
I20260709 12:17:53.637151 27275 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.615883 26954 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.618608 27201 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.619547 26704 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.620177 27178 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.607278 27163 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.637409 23991 rpcz_store.cc:276] 0709 12:17:52.127801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.127983 (+   182us) service_pool.cc:224] Handling call
0709 12:17:52.156594 (+ 28611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.539179 (+382585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.539222 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.539273 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:52.539315 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.636800 (+1097485us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400026f54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:53.636871 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.636992 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":879373568}
I20260709 12:17:53.651371 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:53.658701 24068 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.641124 23920 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:53.652172 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:53.652338 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:53.608630 27233 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.657231 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 783) took 1451 ms. Trace:
I20260709 12:17:53.659824 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.654059 27274 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.661527 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.661779 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.666333 23916 raft_consensus.cc:2410] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:17:53.662910 24595 rpcz_store.cc:276] 0709 12:17:52.206326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.206479 (+   153us) service_pool.cc:224] Handling call
0709 12:17:52.206743 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.417026 (+210283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.656984 (+1239958us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54005c2454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:53.657154 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481915264}
I20260709 12:17:53.671422 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.671648 24068 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:53.672809 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.680855 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.695418 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:53.696218 24068 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:53.696941 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.697975 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:53.698571 24069 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 4.
I20260709 12:17:53.698758 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:53.699457 23920 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:53.662626 27163 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:53.708443 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2114) took 2475 ms. Trace:
I20260709 12:17:53.709213 23921 rpcz_store.cc:276] 0709 12:17:51.227472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.593392 (+365920us) service_pool.cc:224] Handling call
0709 12:17:51.593679 (+   287us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:51.594026 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.594056 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:51.612715 (+ 18659us) log.cc:844] Serialized 52 byte log entry
0709 12:17:51.820243 (+207528us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:51.874521 (+ 54278us) log.cc:844] Serialized 14 byte log entry
0709 12:17:53.295154 (+1420633us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b18001d7700. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:17:53.653457 (+358303us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b18001d7700. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdadfc0a 00007f75c721f219 00007f75bdb67a40 00007f75bdb624e4 00007f75bdb62455 00007f75c464a3c7 00007f75c0c5c9a7 00007f75c0c6c0bf 00007f75c0c6c038
0709 12:17:53.653655 (+   198us) log.cc:844] Serialized 14 byte log entry
0709 12:17:53.702796 (+ 49141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.702913 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:53.702964 (+    51us) raft_consensus.cc:1685] finished
0709 12:17:53.702982 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.703127 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1757779,"prepare.queue_time_us":1836045,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":3741,"raft.queue_time_us":4031,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":160,"spinlock_wait_cycles":5753472,"thread_start_us":187990,"threads_started":2,"wal-append.queue_time_us":281419,"wal-append.run_cpu_time_us":3070,"wal-append.run_wall_time_us":1327682}
I20260709 12:17:53.695987 26713 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:53.679751 26954 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:53.713431 26956 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.714105 27233 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:53.718655 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.755175 23921 raft_consensus.cc:2368] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:17:53.756385 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.715967 27178 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:53.723703 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2205) took 2022 ms. Trace:
I20260709 12:17:53.728010 23920 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:53.703830 24566 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:53.738313 24068 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:17:53.667735 27260 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:17:53.752926 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.679883 27274 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.906354 24594 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:53.886050 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:53.725656 27170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.575s	user 0.035s	sys 0.012s
I20260709 12:17:53.730573 26713 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.953300 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:54.047013 27178 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:53.840909 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 362268us
I20260709 12:17:54.057895 27178 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.059199 27272 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.059523 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:54.048200 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:53.838567 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 139289us
I20260709 12:17:53.952558 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2119) took 2243 ms. Trace:
W20260709 12:17:54.074059 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 370300us
I20260709 12:17:54.075431 24035 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:53.704276 27210 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:53.756608 24034 leader_election.cc:400] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:17:54.091400 24034 leader_election.cc:403] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:53.838946 23990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 517) took 1843 ms. Trace:
I20260709 12:17:54.026906 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:54.081719 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:54.061295 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:54.090154 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.934245 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:53.940194 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 474) took 2247 ms. Trace:
I20260709 12:17:53.955250 23961 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:54.044783 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:54.099633 24035 leader_election.cc:400] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:17:53.887740 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:54.100260 24035 leader_election.cc:403] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:54.101204 24035 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:54.101322 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:54.094890 24036 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:54.098922 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 143787us
W20260709 12:17:53.871399 27279 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:17:54.061157 27039 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.103489 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:53.933934 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:53.928570 23962 connection.cc:256] RPC call timeout handler was delayed by -1.6184738330000528s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
I20260709 12:17:54.098021 23914 rpcz_store.cc:276] 0709 12:17:51.692901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.803455 (+110554us) service_pool.cc:224] Handling call
0709 12:17:51.803704 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.804723 (+  1019us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:51.811722 (+  6999us) log.cc:844] Serialized 14 byte log entry
0709 12:17:51.959625 (+147903us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.963198 (+  3573us) log.cc:844] Serialized 26 byte log entry
0709 12:17:51.963376 (+   178us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:53.662757 (+1699381us) log.cc:844] Serialized 14 byte log entry
0709 12:17:53.939787 (+277030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.939889 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:53.939943 (+    54us) raft_consensus.cc:1685] finished
0709 12:17:53.939961 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.940116 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1818432,"prepare.queue_time_us":1768692,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":97556,"raft.run_cpu_time_us":335,"raft.run_wall_time_us":67550,"thread_start_us":340950,"threads_started":2,"wal-append.queue_time_us":178889,"wal-append.run_cpu_time_us":10735,"wal-append.run_wall_time_us":1442067}
I20260709 12:17:54.102944 23961 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:53.867483 27242 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 1.742s	user 0.030s	sys 0.005s
I20260709 12:17:54.060966 27275 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:17:54.077376 27170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.927s	user 0.037s	sys 0.034s
I20260709 12:17:53.960269 26881 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:53.736003 27134 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:54.075353 23919 rpcz_store.cc:276] 0709 12:17:51.708739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.986897 (+278158us) service_pool.cc:224] Handling call
0709 12:17:51.987163 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.991616 (+  4453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.991644 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:52.005854 (+ 14210us) log.cc:844] Serialized 26 byte log entry
0709 12:17:52.196709 (+190855us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:53.681111 (+1484402us) log.cc:844] Serialized 14 byte log entry
0709 12:17:53.952133 (+271022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.952229 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:53.952289 (+    60us) raft_consensus.cc:1685] finished
0709 12:17:53.952308 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.952484 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1531349,"prepare.queue_time_us":1615911,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":2300,"raft.queue_time_us":85692,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9409,"spinlock_wait_cycles":20507520,"thread_start_us":303166,"threads_started":2,"wal-append.queue_time_us":309216,"wal-append.run_cpu_time_us":1484,"wal-append.run_wall_time_us":1003432}
I20260709 12:17:54.061671 26956 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:53.884356 27269 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:54.074118 23917 rpcz_store.cc:276] 0709 12:17:51.701064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.918020 (+216956us) service_pool.cc:224] Handling call
0709 12:17:51.918684 (+   664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.918925 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:53.657052 (+1738127us) log.cc:844] Serialized 14 byte log entry
0709 12:17:53.723384 (+ 66332us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:53.723437 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:53.723478 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.723539 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:53.723650 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1737797,"prepare.queue_time_us":1738565,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":722,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":4314,"thread_start_us":65211,"threads_started":1}
W20260709 12:17:54.181334 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 78450.6us
I20260709 12:17:54.118216 27022 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.054808 26713 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:53.953465 27184 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:54.074738 27280 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:53.951100 27123 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:54.118785 27289 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260709 12:17:54.106369 27287 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:17:54.080070 27201 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:54.030261 27239 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:54.181890 27037 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.243171 27039 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.195999 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:54.105746 27210 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:53.776139 26954 raft_consensus.cc:697] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:53.960465 27232 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:54.007838 27270 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.092123 23990 rpcz_store.cc:276] 0709 12:17:51.995494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.995662 (+   168us) service_pool.cc:224] Handling call
0709 12:17:51.995912 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.371602 (+375690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.838690 (+1467088us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54002aadd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:53.838884 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842843008}
I20260709 12:17:54.197405 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:53.821185 27285 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:53.838145 27051 consensus_meta.cc:287] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.500s	user 0.005s	sys 0.006s
I20260709 12:17:54.110958 26895 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:54.243031 27134 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.079010 27043 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:53.905046 27174 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:54.106910 27271 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:54.106005 27091 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:53.847141 27282 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.240685 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:54.264317 27239 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:54.351155 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 59397.5us
I20260709 12:17:53.961423 27151 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:53.930053 27191 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:53.954711 27133 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.119834 27103 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:54.098637 27272 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:54.250516 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:54.230415 27233 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.262414 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:54.195626 27172 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:54.274252 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 566) took 2553 ms. Trace:
I20260709 12:17:54.423493 24063 rpcz_store.cc:276] 0709 12:17:51.711989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.712183 (+   194us) service_pool.cc:224] Handling call
0709 12:17:51.712632 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.776276 (+ 63644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.776304 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.776761 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:17:51.926792 (+150031us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:51.926829 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.839540 (+1912711us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b54000703d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:53.839606 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:53.866801 (+ 27195us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:17:54.265610 (+398809us) raft_consensus.cc:1685] finished
0709 12:17:54.265631 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.265771 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17733,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":113314688,"thread_start_us":149657,"threads_started":1,"wal-append.queue_time_us":215124}
I20260709 12:17:54.278162 23914 raft_consensus.cc:2393] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:54.264477 27162 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:53.740589 27268 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.429061 27304 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:54.429843 27268 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:54.243135 27275 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:54.301158 24062 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.031s	sys 0.049s
W20260709 12:17:54.430692 24062 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.032s	sys 0.049s
I20260709 12:17:54.431136 24067 raft_consensus.cc:2410] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:17:54.303134 23989 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 2183) took 2446 ms (client timeout 1802 ms). Trace:
I20260709 12:17:54.366433 26954 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:54.434448 23989 rpcz_store.cc:269] 0709 12:17:51.844239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.844395 (+   156us) service_pool.cc:224] Handling call
0709 12:17:54.279998 (+2435603us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54003d72d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:54.290233 (+ 10235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1064619264}
W20260709 12:17:54.434818 27292 log.cc:927] Time spent T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 12:17:54.401559 27151 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:54.436331 27301 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:17:54.437330 27295 log.cc:927] Time spent T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:17:54.437439 27151 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.321069 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1949) took 1744 ms. Trace:
I20260709 12:17:54.438339 27239 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.438004 23988 rpcz_store.cc:276] 0709 12:17:52.576438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.577979 (+  1541us) service_pool.cc:224] Handling call
0709 12:17:52.586847 (+  8868us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:52.587231 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.587272 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:53.600205 (+1012933us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b2c00000e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:17:53.600560 (+   355us) log.cc:844] Serialized 26 byte log entry
0709 12:17:53.696954 (+ 96394us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:53.696999 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.697065 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:54.293035 (+595970us) raft_consensus.cc:1685] finished
0709 12:17:54.293064 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.320997 (+ 27933us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":50998,"spinlock_wait_cycles":2605952,"thread_start_us":96068,"threads_started":1,"wal-append.queue_time_us":151904}
I20260709 12:17:54.416903 27191 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.445039 27191 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.453440 27190 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.454887 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2223) took 1298 ms. Trace:
I20260709 12:17:54.455233 23912 rpcz_store.cc:276] 0709 12:17:53.156927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.555560 (+398633us) service_pool.cc:224] Handling call
0709 12:17:53.560414 (+  4854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:53.634672 (+ 74258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.454662 (+819990us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b54001e0354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:54.454833 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96167168}
I20260709 12:17:54.352386 27174 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.459703 27037 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:17:54.241062 26881 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.344146 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:54.260025 27123 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.277386 27022 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:54.346652 24592 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:54.251772 27184 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.060936 27178 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.350328 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:54.259809 27280 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.264371 27201 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:53.960081 27129 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:54.374956 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 271511us
W20260709 12:17:54.377115 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 273522us
W20260709 12:17:54.381237 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 140295us
I20260709 12:17:54.264763 27284 consensus_queue.cc:1059] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:17:54.290122 27270 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.348146 27091 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:54.289929 27232 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.406086 27133 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:54.407541 27291 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:17:54.408210 27134 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.409099 27188 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:54.407027 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:54.303426 27051 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.320317 27285 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.428000 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:54.461488 23921 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
W20260709 12:17:54.465348 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 708794us
I20260709 12:17:54.405227 27305 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:54.464247 27169 raft_consensus.cc:993] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:17:54.429733 27304 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.373056 27282 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.646636 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.670910 23917 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.691939 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.672798 24066 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:54.672889 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.426687 27172 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.673791 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:54.695339 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 288370us
I20260709 12:17:54.702610 24062 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:17:54.446120 27274 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:54.703163 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:54.466799 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 225317us
I20260709 12:17:54.673985 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2232) took 1060 ms. Trace:
I20260709 12:17:54.705680 23914 rpcz_store.cc:276] 0709 12:17:53.613960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.427684 (+813724us) service_pool.cc:224] Handling call
0709 12:17:54.673926 (+246242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:54.602182 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:54.706600 23918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.012s	sys 0.012s
I20260709 12:17:54.706875 23912 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
W20260709 12:17:54.707360 23918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.012s	sys 0.012s
I20260709 12:17:54.707533 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56870 (request call id 486) took 1015 ms. Trace:
I20260709 12:17:54.708077 23912 rpcz_store.cc:276] 0709 12:17:53.692599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.541802 (+849203us) service_pool.cc:224] Handling call
0709 12:17:54.707461 (+165659us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:54.690724 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.709297 23990 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
W20260709 12:17:54.576982 23886 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.4:34635 timed out after 1.686s (SENT) [suppressed 6 similar messages]
I20260709 12:17:54.537953 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:54.639688 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:54.694375 24070 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:54.426849 27233 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.693718 27315 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:54.714546 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.714705 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.701700 27216 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:17:54.714844 27133 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.721048 23916 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:54.722332 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2135) took 1142 ms. Trace:
I20260709 12:17:54.722687 23921 rpcz_store.cc:276] 0709 12:17:53.579589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.089802 (+510213us) service_pool.cc:224] Handling call
0709 12:17:54.722158 (+632356us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54000a91d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:54.722249 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839168256}
I20260709 12:17:54.717082 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.716315 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:54.700981 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.630648 27321 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:54.425154 27272 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.723673 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:54.724934 23920 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:17:54.496656 27190 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.724339 23912 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:54.466707 27210 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.716923 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:54.767513 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.730075 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:54.687462 27188 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.769716 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:54.703598 27162 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:17:54.778156 27284 raft_consensus.cc:3055] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:54.778594 27284 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:54.778986 27239 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:54.779881 27322 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:54.779531 27284 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.735211 27321 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.734200 23921 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:54.715361 27233 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.535867 27123 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.689167 27151 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:54.693817 26895 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:54.688128 27320 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:54.715832 27134 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:54.694519 27103 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:54.687773 27305 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.734956 27244 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:54.735148 27004 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:54.772413 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:54.731704 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2224) took 1570 ms. Trace:
I20260709 12:17:54.716243 27172 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:54.790624 26956 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.785734 27091 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.799075 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:54.725952 27129 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.835291 23988 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.837662 27129 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.739904 24070 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:17:54.777375 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 2056) took 1262 ms. Trace:
I20260709 12:17:54.829684 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.777472 27199 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:54.780306 27322 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:54.781117 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:54.731822 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 57770.2us
I20260709 12:17:54.867184 24067 rpcz_store.cc:276] 0709 12:17:53.505609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.506007 (+   398us) service_pool.cc:224] Handling call
0709 12:17:54.767709 (+1261702us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b540010ed54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:54.767843 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2123773312}
I20260709 12:17:54.715675 27043 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.783910 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.872802 23990 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:54.784548 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:54.770147 27163 consensus_meta.cc:287] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 1.033s	user 0.012s	sys 0.000s
I20260709 12:17:54.717586 27315 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.767755 27316 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:54.838325 27319 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
W20260709 12:17:54.823383 26713 consensus_meta.cc:287] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.563s	user 0.008s	sys 0.000s
I20260709 12:17:54.788419 27190 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.839000 27174 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.839895 27134 raft_consensus.cc:697] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:54.775260 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:54.901866 24564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.006s	sys 0.009s
I20260709 12:17:54.802182 27051 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.841199 27282 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:54.800987 23816 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43626 (request call id 195) took 24212 ms (client timeout 15000 ms). Trace:
I20260709 12:17:54.736307 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 475) took 3036 ms. Trace:
I20260709 12:17:54.889331 27043 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:54.795038 23913 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.028s	sys 0.040s
I20260709 12:17:54.812543 24066 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
W20260709 12:17:54.914539 23913 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.029s	sys 0.040s
I20260709 12:17:54.845834 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2136) took 1225 ms. Trace:
I20260709 12:17:54.830500 24065 raft_consensus.cc:2410] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:54.823459 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:54.915210 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.830643 23914 rpcz_store.cc:276] 0709 12:17:53.161740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.730479 (+1568739us) service_pool.cc:224] Handling call
0709 12:17:54.730861 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.731073 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.731122 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:54.731180 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:54.731227 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.731304 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.731644 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:54.916314 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.800007 23960 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:54.767980 26903 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:54.845023 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.803577 27260 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:17:54.912989 23918 rpcz_store.cc:276] 0709 12:17:51.699890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.805762 (+105872us) service_pool.cc:224] Handling call
0709 12:17:51.806247 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.813210 (+  6963us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.813238 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.819903 (+  6665us) log.cc:844] Serialized 26 byte log entry
0709 12:17:52.003406 (+183503us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:53.636344 (+1632938us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4800002dd8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c5b7baa1 00007f75c5b72b37 00007f75c5b729ca 00007f75c5c6a26f 00007f75c5c69f37 00007f75c5c7e55c 00007f75c5c7e508 00007f75c5c7e488 00007f75c5c7e443 00007f75c5c7d6ec 00007f75c4ba7a96
0709 12:17:54.097731 (+461387us) log.cc:844] Serialized 14 byte log entry
0709 12:17:54.735796 (+638065us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.736001 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:54.736053 (+    52us) raft_consensus.cc:1685] finished
0709 12:17:54.736130 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.736250 (+   120us) inbound_call.cc:177] Queueing success response
0709 12:17:54.836816 (+100566us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b180035c560. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
Metrics: {"mutex_wait_us":1747139,"prepare.queue_time_us":1882525,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":66809,"raft.run_cpu_time_us":24938,"raft.run_wall_time_us":1834861,"spinlock_wait_cycles":16234496,"thread_start_us":1174295,"threads_started":3,"wal-append.queue_time_us":977208,"wal-append.run_cpu_time_us":1505,"wal-append.run_wall_time_us":1059532}
I20260709 12:17:54.902145 27225 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:54.872110 23961 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:54.787449 27210 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:17:54.852774 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 94327us
I20260709 12:17:54.895375 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:54.896073 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 115029us
I20260709 12:17:54.895098 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.831852 27151 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:54.934474 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 62441.9us
I20260709 12:17:54.941110 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:54.899662 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2218) took 1795 ms. Trace:
I20260709 12:17:54.802736 27169 raft_consensus.cc:1081] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:17:54.901022 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.832002 27184 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.846019 27304 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:54.901991 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 325027us
W20260709 12:17:54.904109 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 514043us
I20260709 12:17:54.827117 27232 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.829504 26881 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.798708 27312 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:54.823614 27285 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:54.870682 27321 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.889350 27199 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:54.917300 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 117368us
I20260709 12:17:54.933852 27305 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.915493 23916 rpcz_store.cc:276] 0709 12:17:53.579862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.743323 (+163461us) service_pool.cc:224] Handling call
0709 12:17:54.804986 (+1061663us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54001fe354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:54.805127 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1589978880}
I20260709 12:17:54.919387 23912 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:54.818663 24068 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
W20260709 12:17:54.912249 23816 rpcz_store.cc:269] 0709 12:17:30.589048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.589255 (+   207us) service_pool.cc:224] Handling call
0709 12:17:54.800890 (+24211635us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:49.317414 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:49.318079 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:49.318136 (+    57us) write_op.cc:435] Acquired schema lock
0709 12:17:49.318154 (+    18us) tablet.cc:662] Decoding operations
0709 12:17:49.319251 (+  1097us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:49.319327 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:49.319360 (+    33us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:17:49.320278 (+   918us) tablet.cc:701] Row locks acquired
0709 12:17:49.320324 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:17:49.320504 (+   180us) write_op.cc:270] Start()
0709 12:17:49.320654 (+   150us) write_op.cc:276] Timestamp: P: 1783599469320432 usec, L: 0
0709 12:17:49.320679 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:17:49.321322 (+   643us) log.cc:844] Serialized 3985 byte log entry
0709 12:17:49.816402 (+495080us) op_driver.cc:464] REPLICATION: finished
0709 12:17:50.294134 (+477732us) write_op.cc:301] APPLY: starting
0709 12:17:50.307962 (+ 13828us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:50.353574 (+ 45612us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:50.353727 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:50.393204 (+ 39477us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:50.393527 (+   323us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:17:50.393575 (+    48us) write_op.cc:312] APPLY: finished
0709 12:17:50.393986 (+   411us) log.cc:844] Serialized 77 byte log entry
0709 12:17:50.394172 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:50.394311 (+   139us) write_op.cc:454] Released schema lock
0709 12:17:50.394374 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:50.394799 (+   425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:50.394837 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":188298,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":435802,"apply.run_cpu_time_us":3810,"apply.run_wall_time_us":121369,"num_ops":10,"prepare.queue_time_us":545557,"prepare.run_cpu_time_us":67293,"prepare.run_wall_time_us":123446,"raft.queue_time_us":153461,"raft.run_cpu_time_us":83611,"raft.run_wall_time_us":215038,"replication_time_us":495569,"spinlock_wait_cycles":1759616,"thread_start_us":691725,"threads_started":4,"wal-append.queue_time_us":130090,"wal-append.run_cpu_time_us":38423,"wal-append.run_wall_time_us":1938781}]]}
W20260709 12:17:54.930016 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 159260us
I20260709 12:17:54.898167 27316 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:54.844520 23988 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:54.831734 26956 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.978904 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.980072 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.980334 26956 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.966874 27312 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.981145 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.981680 23988 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:54.822772 27103 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.983757 27103 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.942600 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.984412 23990 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:17:54.945112 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:54.946182 24070 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:54.986847 27280 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.987159 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.988538 24070 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:54.828249 27004 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.991052 27004 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.943216 23915 rpcz_store.cc:276] 0709 12:17:53.104626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.104771 (+   145us) service_pool.cc:224] Handling call
0709 12:17:53.105134 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:53.105392 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:54.018985 (+913593us) log.cc:844] Serialized 14 byte log entry
0709 12:17:54.899303 (+880318us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:54.899362 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:54.899409 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.899480 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.899605 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":603118,"prepare.queue_time_us":710489,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":12465,"raft.queue_time_us":50776,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":1155207,"threads_started":3,"wal-append.queue_time_us":427604}
W20260709 12:17:54.949062 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 210966us
I20260709 12:17:54.991670 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2143) took 1375 ms. Trace:
I20260709 12:17:54.992013 23920 rpcz_store.cc:276] 0709 12:17:53.616102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.100971 (+484869us) service_pool.cc:224] Handling call
0709 12:17:54.991527 (+890556us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54003359d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:54.991620 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1432312064}
I20260709 12:17:54.993153 23920 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:54.993650 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2228) took 1775 ms. Trace:
I20260709 12:17:54.919953 27173 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:54.827890 27244 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.995903 27270 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.996163 27244 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.898094 27163 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.954823 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:54.998930 27163 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:55.000867 27151 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.954953 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.006780 27190 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:55.007110 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2127) took 1665 ms. Trace:
I20260709 12:17:55.007280 23996 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:55.007477 27188 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.974665 27199 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:55.008524 27324 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:17:55.009083 27326 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:17:55.010011 27326 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:54.957064 24067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:17:55.010377 27326 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:55.010668 27201 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:55.011229 27326 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:55.012427 27326 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:54.993927 23920 rpcz_store.cc:276] 0709 12:17:53.218034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.992760 (+1774726us) service_pool.cc:224] Handling call
0709 12:17:54.993008 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.993465 (+   457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.993604 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.019716 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:55.020299 23920 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 3.
I20260709 12:17:55.021207 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:55.021754 23920 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:17:54.958143 27210 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:55.026472 23987 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:17:55.007516 23912 rpcz_store.cc:276] 0709 12:17:53.341520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.006348 (+1664828us) service_pool.cc:224] Handling call
0709 12:17:55.006629 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.006813 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.006837 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.006888 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:55.006919 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.006969 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.007058 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:54.936390 27328 log.cc:927] Time spent T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:17:54.840517 27320 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:54.932035 27129 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:54.961714 24564 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:54.902220 26713 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.936612 27191 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:54.832479 26895 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:55.057602 27340 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:17:55.058158 27296 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:55.058601 27296 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:55.059442 27296 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.968813 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:55.060956 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.062251 27320 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:54.915268 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 472) took 3222 ms. Trace:
I20260709 12:17:54.933900 27225 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:54.946194 27315 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:54.973603 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:55.079458 27225 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.022889 27316 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:55.090942 27210 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:55.093986 27172 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:54.970626 27134 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:55.063241 23913 rpcz_store.cc:276] 0709 12:17:51.692439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.803142 (+110703us) service_pool.cc:224] Handling call
0709 12:17:51.803433 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:51.803740 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:51.803765 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:51.804195 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:17:51.898398 (+ 94203us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:53.700512 (+1802114us) log.cc:844] Serialized 14 byte log entry
0709 12:17:54.914923 (+1214411us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.915024 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:54.915075 (+    51us) raft_consensus.cc:1685] finished
0709 12:17:54.915086 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.915209 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1880930,"prepare.queue_time_us":1757941,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":181259,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":8828,"thread_start_us":1228083,"threads_started":4,"wal-append.queue_time_us":916595,"wal-append.run_cpu_time_us":1872,"wal-append.run_wall_time_us":1186098}
I20260709 12:17:55.099273 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:55.099833 23913 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:54.974192 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:54.974391 24064 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:54.917285 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.104578 24066 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:55.105281 24067 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:55.105772 24067 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:54.937230 27322 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:55.027132 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:54.955381 24566 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:55.120391 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 94164.5us
W20260709 12:17:55.120527 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 165191us
I20260709 12:17:54.935423 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2226) took 1719 ms. Trace:
I20260709 12:17:55.123438 23918 rpcz_store.cc:276] 0709 12:17:53.216203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.932453 (+1716250us) service_pool.cc:224] Handling call
0709 12:17:54.934477 (+  2024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.934990 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.935031 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:54.935092 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:17:54.935143 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.935217 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.935357 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.031767 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.033712 23917 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:55.125245 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2234) took 1350 ms. Trace:
I20260709 12:17:55.125555 23917 rpcz_store.cc:276] 0709 12:17:53.774663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.350058 (+575395us) service_pool.cc:224] Handling call
0709 12:17:55.125194 (+775136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.126875 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2130) took 1784 ms. Trace:
I20260709 12:17:55.127184 23917 rpcz_store.cc:276] 0709 12:17:53.342415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.126144 (+1783729us) service_pool.cc:224] Handling call
0709 12:17:55.126436 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.126587 (+   151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.126611 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.126660 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:55.126689 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.126739 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.126828 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:55.039278 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 77635.7us
I20260709 12:17:55.051717 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.128911 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:55.123152 27133 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:55.122094 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:55.037873 27163 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:55.051267 23960 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:55.052317 27129 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:55.052896 27226 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:55.054368 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2128) took 1712 ms. Trace:
I20260709 12:17:55.076364 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.051891 27004 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:55.129978 27260 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:55.431705 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:55.373188 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.375288 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:55.435269 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.297299 24599 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:55.437203 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.437573 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.438328 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:55.438745 27163 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:55.439725 24065 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:55.461113 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:55.441857 27172 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:55.475920 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:55.476644 24070 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.168059 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:55.433226 27322 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.130052 27312 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:55.444756 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:55.446542 27129 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.203495 24067 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:55.434439 27284 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.448980 27320 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:55.511080 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.130098 27133 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:55.512526 27133 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.500409 27163 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:55.518751 26713 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:55.430439 27296 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:55.475518 27226 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:55.522765 27226 raft_consensus.cc:697] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:55.447291 23920 rpcz_store.cc:276] 0709 12:17:53.341827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.029453 (+1687626us) service_pool.cc:224] Handling call
0709 12:17:55.053703 (+ 24250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.053911 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.053949 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.054004 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:55.054073 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.054143 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.054269 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:55.442202 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 313321us
I20260709 12:17:55.543179 24564 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:55.545423 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:55.443423 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:55.445802 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 323759us
I20260709 12:17:55.459601 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.462909 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:55.463923 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.465283 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.453888 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2126) took 2113 ms. Trace:
I20260709 12:17:55.473451 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.489895 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.549172 24069 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:55.550526 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:55.569836 23921 rpcz_store.cc:276] 0709 12:17:53.340091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.999464 (+1659373us) service_pool.cc:224] Handling call
0709 12:17:54.999720 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.999902 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:55.194794 (+194892us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.448669 (+253875us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.448729 (+    60us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:55.448785 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.453566 (+  4781us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.453825 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86680,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":9509,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9690,"thread_start_us":445356,"threads_started":2,"wal-append.queue_time_us":247568}
I20260709 12:17:55.572680 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:55.499774 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.603741 23996 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:55.500396 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 489) took 1806 ms. Trace:
I20260709 12:17:55.502254 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2142) took 1890 ms. Trace:
W20260709 12:17:55.456284 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 405171us
I20260709 12:17:55.524384 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:55.530436 27170 consensus_queue.cc:1059] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:55.531729 27172 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:55.532428 27173 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:55.533039 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.637111 23921 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:55.533500 27191 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:55.574582 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.640213 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.575003 24070 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:55.575354 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.576272 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.576666 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.567870 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:55.537472 27043 consensus_meta.cc:287] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.003s
I20260709 12:17:55.584434 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:55.641506 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.473166 27232 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:55.639312 27343 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:17:55.494596 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.650892 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:55.651373 24068 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:55.651573 23987 raft_consensus.cc:2393] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:55.651300 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.651540 24070 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.652837 24068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8132db9882c041d1845d0a8815c39788"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:17:55.650599 23960 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:55.605250 23913 rpcz_store.cc:276] 0709 12:17:53.612046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.501475 (+1889429us) service_pool.cc:224] Handling call
0709 12:17:55.501774 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.501938 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.501968 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.502009 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:55.502043 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.502094 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.502200 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.649616 27232 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:55.654299 27232 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:55.646974 27173 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:55.659288 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.660408 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.661032 24064 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:55.661710 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.649490 23993 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:55.509899 27225 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:55.631181 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:55.648478 23995 raft_consensus.cc:2410] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:17:55.648864 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:55.662719 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2225) took 2491 ms. Trace:
W20260709 12:17:55.538179 27199 consensus_meta.cc:287] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.529s	user 0.006s	sys 0.000s
I20260709 12:17:55.648912 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.674732 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:55.650157 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 118066us
I20260709 12:17:55.621155 27091 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:55.589098 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:55.549242 27260 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:17:55.604250 23918 rpcz_store.cc:276] 0709 12:17:53.693609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.499647 (+1806038us) service_pool.cc:224] Handling call
0709 12:17:55.499935 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.500098 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.500124 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.500168 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:55.500200 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.500250 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.500344 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.682797 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:55.682886 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:55.683472 23918 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:55.683014 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.554157 27316 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:55.665867 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:55.678798 24070 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:55.681392 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:55.691983 23912 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:55.692224 24068 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:55.692224 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.650102 27043 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:55.648996 27313 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:55.682027 24595 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.663240 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.688311 23918 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:55.706550 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 490) took 2012 ms. Trace:
I20260709 12:17:55.702585 27313 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.707182 27313 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.707005 23918 rpcz_store.cc:276] 0709 12:17:53.693893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.687741 (+1993848us) service_pool.cc:224] Handling call
0709 12:17:55.688088 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.706212 (+ 18124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.706479 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.708676 24062 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:55.689534 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.709363 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.710430 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.711858 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.712566 23988 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:17:55.687273 27201 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:55.681500 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 75066.8us
I20260709 12:17:55.733255 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.693440 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:55.694133 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:55.684341 27134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.019s	sys 0.014s
I20260709 12:17:55.694185 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:55.686160 27172 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:55.735241 23912 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.696293 24070 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:55.705593 27225 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:55.692785 24068 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:55.736937 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 491) took 2042 ms. Trace:
I20260709 12:17:55.713713 23987 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:55.737349 23912 rpcz_store.cc:276] 0709 12:17:53.694187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.697613 (+2003426us) service_pool.cc:224] Handling call
0709 12:17:55.733925 (+ 36312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.736710 (+  2785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.736882 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.709070 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 494) took 2014 ms. Trace:
I20260709 12:17:55.738358 23918 rpcz_store.cc:276] 0709 12:17:53.694908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.708115 (+2013207us) service_pool.cc:224] Handling call
0709 12:17:55.708465 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.708662 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.708712 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.708769 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:55.708812 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.708879 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.708994 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.739367 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2236) took 1664 ms. Trace:
I20260709 12:17:55.740477 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2237) took 1659 ms. Trace:
I20260709 12:17:55.741240 24070 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:55.740942 23918 rpcz_store.cc:276] 0709 12:17:54.081183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.739555 (+1658372us) service_pool.cc:224] Handling call
0709 12:17:55.739892 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.740081 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.740118 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.740172 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:55.740216 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.740285 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.740414 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.694093 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.690725 27103 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:55.681509 27199 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:55.712231 27272 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:55.735394 23920 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:17:55.736466 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:55.739837 23912 rpcz_store.cc:276] 0709 12:17:54.075384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.738407 (+1663023us) service_pool.cc:224] Handling call
0709 12:17:55.738763 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.738964 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.739002 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.739059 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:55.739108 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.739176 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.739303 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.751682 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2240) took 1032 ms. Trace:
I20260709 12:17:55.755067 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2241) took 1028 ms. Trace:
I20260709 12:17:55.766661 23918 rpcz_store.cc:276] 0709 12:17:54.719229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.750973 (+1031744us) service_pool.cc:224] Handling call
0709 12:17:55.751239 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.751408 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.751432 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.751469 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:55.751496 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.751540 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.751633 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.767169 23915 rpcz_store.cc:276] 0709 12:17:54.726915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.754227 (+1027312us) service_pool.cc:224] Handling call
0709 12:17:55.754495 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.754678 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.754726 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.754778 (+    52us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:17:55.754821 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.754887 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.755003 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:55.768162 23918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:17:55.768800 23918 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:55.769259 23918 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.771186 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:55.771764 24064 raft_consensus.cc:2393] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:55.771899 23995 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:55.772303 23913 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:55.772599 23912 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:55.773084 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2235) took 1917 ms. Trace:
I20260709 12:17:55.773499 23913 rpcz_store.cc:276] 0709 12:17:53.855982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.737143 (+1881161us) service_pool.cc:224] Handling call
0709 12:17:55.772075 (+ 34932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.772812 (+   737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.773020 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:55.743381 23917 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.004s	sys 0.052s
I20260709 12:17:55.747225 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.662217 27133 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:55.733320 27201 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:55.735072 27134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.019s	sys 0.014s
I20260709 12:17:55.754436 24068 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:55.751093 24070 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:17:55.775938 23917 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.004s	sys 0.052s
I20260709 12:17:55.666952 27226 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:55.779120 23916 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:55.780390 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:55.781858 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2243) took 1001 ms. Trace:
I20260709 12:17:55.781919 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2230) took 2310 ms. Trace:
I20260709 12:17:55.782245 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.782434 23920 rpcz_store.cc:276] 0709 12:17:54.780504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.767049 (+986545us) service_pool.cc:224] Handling call
0709 12:17:55.781437 (+ 14388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.781594 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.781617 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.781653 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:55.781679 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.781726 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.781811 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:55.782559 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 200489us
I20260709 12:17:55.787454 24069 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:55.787567 23912 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:55.751461 27103 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:55.789552 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 532) took 1005 ms. Trace:
I20260709 12:17:55.784124 23917 rpcz_store.cc:276] 0709 12:17:53.471614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.128002 (+1656388us) service_pool.cc:224] Handling call
0709 12:17:55.128225 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.128389 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:55.147457 (+ 19068us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.780952 (+633495us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.781023 (+    71us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:55.781075 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.781146 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.781867 (+   721us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25358,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":32,"raft.queue_time_us":465,"thread_start_us":633030,"threads_started":1}
I20260709 12:17:55.789903 23992 rpcz_store.cc:276] 0709 12:17:54.784362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.785280 (+   918us) service_pool.cc:224] Handling call
0709 12:17:54.785633 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.015110 (+229477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.015139 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.015286 (+   147us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:55.015425 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.789350 (+773925us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54000695d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:55.789391 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.789504 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526489344}
I20260709 12:17:55.794502 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:55.778599 27201 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:55.748364 27129 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:55.792721 27103 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:55.748036 27172 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:55.797629 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.806082 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.807209 23987 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:17:55.807768 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:55.806150 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 312610us
I20260709 12:17:55.779008 27349 consensus_queue.cc:1059] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:17:55.812690 23993 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:55.814889 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 183804us
W20260709 12:17:55.816442 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 130217us
I20260709 12:17:55.817199 23962 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:55.824545 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:55.676165 23914 rpcz_store.cc:276] 0709 12:17:53.171088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.925482 (+1754394us) service_pool.cc:224] Handling call
0709 12:17:54.925778 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.946424 (+ 20646us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:54.957937 (+ 11513us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.086384 (+128447us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b1800390f40. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:17:55.655824 (+569440us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b1800390f40. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdadfc0a 00007f75c721f219 00007f75bdb67a40 00007f75bdb624e4 00007f75bdb62455 00007f75c464a3c7 00007f75c0c5c9a7 00007f75c0c6c0bf 00007f75c0c6c038
0709 12:17:55.656108 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.656296 (+   188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:55.656715 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 12:17:55.656826 (+   111us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:55.656854 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.656927 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:55.662505 (+  5578us) raft_consensus.cc:1685] finished
0709 12:17:55.662524 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.662659 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":233730,"prepare.queue_time_us":234172,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":89,"raft.queue_time_us":222109,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":15569,"spinlock_wait_cycles":26445952,"thread_start_us":224603,"threads_started":1,"wal-append.queue_time_us":472416}
I20260709 12:17:55.842085 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:55.844393 23988 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:55.853493 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:55.853672 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:55.854879 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:55.856279 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:55.857828 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 52720.5us
I20260709 12:17:55.858603 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:55.859038 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:55.859679 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:55.863653 27316 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:55.871097 27347 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:17:55.920317 27232 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:55.988631 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.843922 27191 raft_consensus.cc:3055] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:17:55.993017 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 175964us
I20260709 12:17:55.854205 24594 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:17:55.993470 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.010718 24593 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:17:55.995115 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 138923us
I20260709 12:17:56.012326 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:56.014252 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:55.995460 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:55.996089 23995 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:17:55.997689 23918 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.002658 23991 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:17:56.004864 26903 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:56.005959 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:56.003455 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.004627 27358 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:56.023264 23996 raft_consensus.cc:2393] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 4: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:56.002346 27225 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:56.011436 27134 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:56.010957 27226 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:56.009281 27191 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.030646 23918 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.040376 27134 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:56.044378 27134 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:56.045079 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.017966 27316 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:56.060717 27316 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.061225 27316 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:56.047106 27004 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:56.067530 27004 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.068684 27004 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.071168 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37704 (request call id 1011) took 1114 ms. Trace:
I20260709 12:17:56.071441 27004 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:56.073479 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.047937 27349 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:56.051091 24068 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.074819 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57842 (request call id 1881) took 1054 ms. Trace:
I20260709 12:17:56.075188 24068 rpcz_store.cc:276] 0709 12:17:55.020164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.652760 (+632596us) service_pool.cc:224] Handling call
0709 12:17:56.049559 (+396799us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b540004ae54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c49a3d 00007f75c5c19cd0 00007f75bf19e254 00007f75bf19e1e2 00007f75bf19e111 00007f75bf19e08c 00007f75bf19d342 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:56.074720 (+ 25161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89336192}
I20260709 12:17:56.074044 27349 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:56.049419 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:56.076789 26903 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:56.077184 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.077430 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.078094 27210 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:56.076346 27349 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.071998 27284 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:56.071540 24599 rpcz_store.cc:276] 0709 12:17:54.957172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.957461 (+   289us) service_pool.cc:224] Handling call
0709 12:17:56.070991 (+1113530us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400556c54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:56.071089 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":501794048}
I20260709 12:17:56.079335 27284 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:56.052181 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:56.079805 27284 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:56.079756 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.077258 26903 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:56.081430 27307 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:56.081875 27307 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.081283 26903 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.105754 27284 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.106799 24035 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:56.107061 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.072129 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 609305us
I20260709 12:17:56.107854 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:56.108105 27315 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:56.108183 27284 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.108578 27315 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:56.108991 27315 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:56.109611 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.108902 27284 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:56.110693 27284 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:56.111057 27284 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:56.082647 27307 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.111868 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.112238 27307 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:56.083498 27281 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:56.059634 27302 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:56.112967 27281 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.113608 27302 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.053467 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:56.088868 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 594) took 1128 ms. Trace:
I20260709 12:17:56.089437 27170 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:56.118625 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:56.125594 27265 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:56.125980 27265 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:56.126372 27265 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:56.126235 24034 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:56.127251 27022 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:56.052910 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 2063) took 1414 ms. Trace:
I20260709 12:17:56.128996 23991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 1958) took 1187 ms. Trace:
I20260709 12:17:56.129371 23991 rpcz_store.cc:276] 0709 12:17:54.941924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.942038 (+   114us) service_pool.cc:224] Handling call
0709 12:17:56.128821 (+1186783us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b5400311d54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:56.128914 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111182720}
I20260709 12:17:56.129747 24599 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:56.096642 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.100914 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.078694 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.095350 24070 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:17:56.131539 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 584) took 1375 ms. Trace:
I20260709 12:17:56.131852 27272 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.108902 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.123018 24598 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:17:56.131999 24062 rpcz_store.cc:276] 0709 12:17:54.755908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.756219 (+   311us) service_pool.cc:224] Handling call
0709 12:17:56.131392 (+1375173us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54001b7bd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:56.131488 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1751586560}
I20260709 12:17:56.118796 27312 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:56.113940 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:56.133148 27312 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.133488 23987 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:56.133822 23987 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.134032 27312 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.135373 27312 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:56.136140 27043 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:56.137609 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.103329 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:56.138144 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1855) took 1466 ms. Trace:
I20260709 12:17:56.138793 23996 raft_consensus.cc:2368] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8.
I20260709 12:17:56.138924 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2227) took 2921 ms. Trace:
W20260709 12:17:56.131402 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 52783us
I20260709 12:17:56.139329 23916 rpcz_store.cc:276] 0709 12:17:53.217739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.975137 (+1757398us) service_pool.cc:224] Handling call
0709 12:17:54.978150 (+  3013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.781564 (+803414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.138709 (+357145us) spinlock_profiling.cc:243] Waited 801 ms on lock 0x7b54000a82d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:56.138865 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1841603968}
I20260709 12:17:56.138115 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.141021 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.138667 24061 rpcz_store.cc:276] 0709 12:17:54.671623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.671727 (+   104us) service_pool.cc:224] Handling call
0709 12:17:54.671985 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.844293 (+172308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.844331 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:54.844778 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:17:54.946742 (+101964us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:54.946797 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.137798 (+1191001us) spinlock_profiling.cc:243] Waited 57.3 ms on lock 0x7b5400182754. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:56.137841 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:56.137885 (+    44us) raft_consensus.cc:1685] finished
0709 12:17:56.137898 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.138091 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106946,"raft.queue_time_us":137070,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":18781,"spinlock_wait_cycles":131852160,"thread_start_us":44250,"threads_started":1,"wal-append.queue_time_us":82220,"wal-append.run_cpu_time_us":12203,"wal-append.run_wall_time_us":1018203}
I20260709 12:17:56.143561 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:56.143927 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.145107 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.145478 27302 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.145678 24599 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:17:56.128235 24063 rpcz_store.cc:276] 0709 12:17:54.638024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.638154 (+   130us) service_pool.cc:224] Handling call
0709 12:17:54.638604 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:54.690002 (+ 51398us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:54.726785 (+ 36783us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.062897 (+336112us) spinlock_profiling.cc:243] Waited 7.79 ms on lock 0x7b1800498640. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f223a 00007f75c0c5ca2a
0709 12:17:55.147567 (+ 84670us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b1800498640. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb65522 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:17:55.490447 (+342880us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:55.491162 (+   715us) log.cc:844] Serialized 52 byte log entry
0709 12:17:55.491355 (+   193us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:55.491609 (+   254us) log.cc:844] Serialized 14 byte log entry
0709 12:17:56.052295 (+560686us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b1800498640. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdadfc0a 00007f75c721f219 00007f75bdb67a40 00007f75bdb624e4 00007f75bdb62455 00007f75c0c4a060 00007f75c0c5c716 00007f75c0c6d287 00007f75c0c6d208
0709 12:17:56.052498 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.052593 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:56.052659 (+    66us) raft_consensus.cc:1685] finished
0709 12:17:56.052680 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.052838 (+   158us) inbound_call.cc:177] Queueing success response
0709 12:17:56.105310 (+ 52472us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b1800498640. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
Metrics: {"mutex_wait_us":669594,"prepare.queue_time_us":50371,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":31908,"raft.queue_time_us":710095,"raft.run_cpu_time_us":446,"raft.run_wall_time_us":50393,"spinlock_wait_cycles":198856576,"thread_start_us":384352,"threads_started":1,"wal-append.queue_time_us":675788}
I20260709 12:17:56.146049 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:56.141317 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.146694 24591 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.146883 24598 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:56.130502 27284 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.147815 23987 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.148779 23987 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.149171 27320 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:56.150506 27320 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:56.150803 27210 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:56.098466 24068 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 8. Ops: []
I20260709 12:17:56.104803 27173 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.176252 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45120 (request call id 2248) took 1015 ms. Trace:
I20260709 12:17:56.168834 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.153777 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.154100 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.194168 24066 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:56.194448 24061 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:56.152982 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.158622 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.020184 27133 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.154042 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.196173 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.196964 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:56.197153 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.197875 24070 raft_consensus.cc:2410] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:17:56.154352 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.198381 24068 raft_consensus.cc:2376] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11. Re-sending same reply.
I20260709 12:17:56.199440 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.172053 23990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1964) took 1133 ms. Trace:
W20260709 12:17:56.172127 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 176748us
I20260709 12:17:56.172434 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.176306 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.202682 24069 raft_consensus.cc:2393] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:56.171584 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.114979 24065 rpcz_store.cc:276] 0709 12:17:54.960290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.586703 (+626413us) service_pool.cc:224] Handling call
0709 12:17:55.587147 (+   444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.587450 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:17:55.813788 (+226338us) log.cc:844] Serialized 14 byte log entry
0709 12:17:56.088451 (+274663us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:56.088517 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:17:56.088582 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.088669 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.088802 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49990,"prepare.queue_time_us":228060,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":50973,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"thread_start_us":399013,"threads_started":2}
I20260709 12:17:56.176510 24067 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.195094 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.195178 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.200313 23990 rpcz_store.cc:276] 0709 12:17:55.039133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.039567 (+   434us) service_pool.cc:224] Handling call
0709 12:17:55.039941 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:55.045016 (+  5075us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.045047 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:55.045537 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:17:55.674553 (+629016us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:55.674589 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.674646 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:56.171858 (+497212us) raft_consensus.cc:1685] finished
0709 12:17:56.171878 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.171997 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31133,"raft.queue_time_us":7188,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":12576,"thread_start_us":196237,"threads_started":1,"wal-append.queue_time_us":740894}
I20260709 12:17:56.208609 23987 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:56.193908 23918 rpcz_store.cc:276] 0709 12:17:55.038460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.768053 (+729593us) service_pool.cc:224] Handling call
0709 12:17:56.042119 (+274066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.207348 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:56.206502 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 52529.3us
I20260709 12:17:56.204916 24062 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:56.212811 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.194180 24063 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:56.205809 24066 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.203117 27302 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:17:56.121235 27281 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.024183 27356 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:56.153348 27284 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.241019 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.232290 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:56.252295 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:56.228788 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:56.230466 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:56.257071 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 49815.7us
I20260709 12:17:56.258180 23995 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:56.036494 27296 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.180s
I20260709 12:17:56.215996 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57842 (request call id 1875) took 1295 ms. Trace:
I20260709 12:17:56.260030 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:56.029860 27313 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:56.278831 23919 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56870 (request call id 488) took 2585 ms (client timeout 2356 ms). Trace:
I20260709 12:17:56.193624 27272 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:17:56.277662 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 267971us
I20260709 12:17:56.215260 27178 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:56.274845 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:56.225549 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 72643.3us
I20260709 12:17:56.295501 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:56.210017 27173 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:56.277206 24067 rpcz_store.cc:276] 0709 12:17:54.910576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.956949 (+ 46373us) service_pool.cc:224] Handling call
0709 12:17:56.158296 (+1201347us) spinlock_profiling.cc:243] Waited 94.4 ms on lock 0x7b540004c754. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c49a3d 00007f75c5c19cd0 00007f75bf19e254 00007f75bf19e1e2 00007f75bf19e111 00007f75bf19e08c 00007f75bf19d342 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:56.205960 (+ 47664us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217228032}
I20260709 12:17:56.278127 23994 raft_consensus.cc:2393] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:56.276051 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 82760.3us
I20260709 12:17:56.274573 23990 raft_consensus.cc:1240] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:56.043608 27225 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.304196 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:56.310824 23987 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:56.311235 24035 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:56.279237 23919 rpcz_store.cc:269] 0709 12:17:53.693311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.494166 (+800855us) service_pool.cc:224] Handling call
0709 12:17:56.278656 (+1784490us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000a87d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:17:56.278766 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2493702400}
I20260709 12:17:56.283504 27369 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:56.204193 27199 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:56.288401 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.288945 24591 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:56.281105 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:56.291306 24070 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:56.292896 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.211519 27129 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:56.273109 24066 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:56.242520 27326 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:56.203974 27364 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:56.313588 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 74155.6us
W20260709 12:17:56.315217 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.337379 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.338691 23962 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:56.340888 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:56.317250 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.314922 23961 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:56.343410 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.318863 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 1008) took 1368 ms. Trace:
I20260709 12:17:56.344699 24595 rpcz_store.cc:276] 0709 12:17:54.950461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.950596 (+   135us) service_pool.cc:224] Handling call
0709 12:17:54.950842 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.702759 (+751917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.318648 (+615889us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400462b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:56.318796 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1681037696}
I20260709 12:17:56.319182 24597 raft_consensus.cc:1240] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:56.280596 27322 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:56.215571 27230 consensus_queue.cc:1059] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:17:56.376444 23987 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:17:56.045728 27226 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.284970 27281 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.279484 27356 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:56.384718 24593 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:56.313206 27260 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:56.226140 27365 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260709 12:17:56.312608 27272 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:56.294652 27361 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260709 12:17:56.390105 27129 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:17:56.429831 27091 consensus_meta.cc:287] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.745s	user 0.007s	sys 0.008s
W20260709 12:17:56.429620 27201 consensus_meta.cc:287] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.007s
W20260709 12:17:56.441900 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 116812us
W20260709 12:17:56.432183 27103 consensus_meta.cc:287] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.614s	user 0.014s	sys 0.001s
I20260709 12:17:56.401680 27356 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:56.451786 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 239060us
I20260709 12:17:56.324234 27369 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:56.440074 27355 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.444s	user 0.001s	sys 0.001s
I20260709 12:17:56.404605 27260 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:56.460222 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.299044 27191 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.441032 27363 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:56.465574 24036 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.437861 27232 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:56.440088 27302 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.418370 27281 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.475039 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.444523 27372 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:56.390981 27364 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.444224 27367 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:56.449298 27284 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.461282 27103 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.495095 27091 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:56.503779 27191 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:56.479925 27173 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:17:56.520100 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.476806 26903 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:56.459403 27201 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.567973 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.508342 27133 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:56.509205 27230 raft_consensus.cc:3055] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:17:56.572377 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 280182us
I20260709 12:17:56.509963 27372 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.463047 27371 consensus_queue.cc:1059] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 12:17:56.575337 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 109837us
I20260709 12:17:56.602692 24036 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.601501 24595 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:17:56.604017 24595 pending_rounds.cc:85] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 7
I20260709 12:17:56.604288 24595 pending_rounds.cc:107] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:17:56.604568 24595 raft_consensus.cc:2889] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:56.582505 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:56.612426 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:56.614262 23989 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.569666 27091 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:56.601419 27362 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.385s	user 0.000s	sys 0.001s
I20260709 12:17:56.480813 27302 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:56.615849 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 139498us
I20260709 12:17:56.575798 27230 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.626255 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:56.577085 27366 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:56.572671 27367 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.626864 23993 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:56.608749 27372 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.632529 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:56.609683 27381 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:56.619156 27091 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:56.668573 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:56.669646 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:56.670246 23990 raft_consensus.cc:2368] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
I20260709 12:17:56.634330 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.613772 27313 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:56.635485 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:56.633539 23987 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:56.622954 27377 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:56.673168 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:56.674139 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 327351us
I20260709 12:17:56.620446 27379 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:56.628744 23993 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:17:56.679203 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 338372us
I20260709 12:17:56.701814 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:56.702003 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:56.681262 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:56.681638 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.682622 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:56.687444 27381 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.602757 27133 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:56.636562 27370 log.cc:927] Time spent T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:17:56.693689 23989 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:56.717868 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.697861 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.572055 27322 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.690414 27203 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.574501 27260 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.573750 27272 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.700268 23993 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.731673 23993 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:56.712489 23962 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:56.695365 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 175355us
I20260709 12:17:56.718423 23991 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:56.635465 27230 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.722301 27371 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:56.723205 27103 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.708101 27173 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.724124 27386 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.724639 27369 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.628115 23819 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 6 to 9, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3), now has a pending config: VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1), VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2), VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3), VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 9 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:17:56.728827 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.570825 27284 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:56.730180 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.624118 27373 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.092s
I20260709 12:17:56.698421 27225 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:56.711516 27210 consensus_meta.cc:287] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 12:17:56.699494 27281 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.708503 27244 consensus_queue.cc:1059] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 12:17:56.745741 23988 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:17:56.776754 23989 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:56.747488 23819 catalog_manager.cc:5697] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 4, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 4 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:56.742552 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:56.747768 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.782505 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.749264 24566 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:56.754516 23993 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
W20260709 12:17:56.769411 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.726015 27361 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:17:56.754932 27265 consensus_meta.cc:287] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.628s	user 0.005s	sys 0.004s
I20260709 12:17:56.738677 27385 consensus_queue.cc:1059] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:17:56.799312 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:56.799093 27265 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.798514 27367 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.799903 27385 raft_consensus.cc:3055] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:56.800292 27385 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.743432 27371 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.801385 27265 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.801123 27385 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.756934 26895 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:17:56.802191 26895 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.755357 27365 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:56.802999 27371 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.780367 27230 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:56.803565 27385 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:56.752346 27178 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:56.806265 27178 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.749331 27284 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.745632 27386 raft_consensus.cc:3055] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:56.806782 27178 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.807229 27386 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:56.808010 27386 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.809062 27178 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.809206 27386 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:56.738466 27199 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:56.810240 27312 consensus_meta.cc:287] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.674s	user 0.006s	sys 0.003s
I20260709 12:17:56.748775 27313 consensus_queue.cc:1059] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 12:17:56.757318 27307 consensus_meta.cc:287] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.000s
I20260709 12:17:56.810609 27199 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:56.750939 27349 consensus_meta.cc:287] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.002s
I20260709 12:17:56.811821 27349 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.813145 23819 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:56.754592 27210 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:56.816728 27199 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:56.817709 27349 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.817983 27302 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.744539 27392 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:56.715338 27379 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:56.746479 27004 consensus_meta.cc:287] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.674s	user 0.002s	sys 0.011s
I20260709 12:17:56.742866 27201 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:56.751588 27322 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:56.820261 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 71157.1us
I20260709 12:17:56.820387 27379 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.821682 27203 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:56.822219 27203 raft_consensus.cc:697] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:56.824395 27203 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.745182 27173 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.826512 27353 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:17:56.748832 27316 consensus_meta.cc:287] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.687s	user 0.009s	sys 0.001s
I20260709 12:17:56.828413 27173 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:56.839483 23987 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:56.736804 27226 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.843600 23819 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:17:56.844297 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.865484 24066 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:17:56.845707 24070 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:17:56.746769 27369 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.850618 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.867928 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:56.758456 27381 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:56.872431 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:56.771159 27359 raft_consensus.cc:3055] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:56.869372 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.873056 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.874617 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:56.874704 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:56.866981 27369 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:56.876276 24035 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:56.879642 24067 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:56.880599 24061 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:56.880503 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:56.862728 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:56.716051 27377 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:56.895174 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 292538us
I20260709 12:17:56.887732 23819 catalog_manager.cc:5697] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 4 to 5, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 5 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.896795 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.896690 23819 catalog_manager.cc:5697] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 3 to 4, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 4 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:56.897754 27386 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:17:56.898432 23819 catalog_manager.cc:5697] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 4 to 5, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 5 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:56.899128 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.900142 27386 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:56.899791 23819 catalog_manager.cc:5697] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 3 to 5, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 5 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.901332 23819 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 6, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 6 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:56.902606 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.902946 23960 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:56.904600 23913 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:56.881807 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 133714us
I20260709 12:17:56.876516 24068 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:56.884536 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:56.883011 23886 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:56.887560 24070 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 8: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:56.907518 23962 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:56.880540 24063 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:17:56.916491 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.893182 23920 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:56.759485 27387 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
I20260709 12:17:56.910126 23919 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:56.887519 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:56.917594 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:56.922052 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 285904us
I20260709 12:17:56.883311 27359 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:56.884379 27199 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:56.948699 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 46158us
I20260709 12:17:56.967335 24036 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.864565 27316 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:56.963740 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:56.964772 23915 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:56.964954 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:56.947300 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 64346.8us
I20260709 12:17:56.988745 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:56.962572 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:56.943645 24062 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:56.993160 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:56.906152 27381 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:57.005043 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 97622.4us
I20260709 12:17:57.005350 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:56.908308 27129 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.005920 23916 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:57.007094 23819 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 3 to 6, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:57.017983 24036 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.021350 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:57.021942 23913 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:56.959183 27386 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.029109 23886 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:57.030184 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:57.030903 23914 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 12. Ops: []
I20260709 12:17:56.958444 27313 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.909518 27210 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.118s
I20260709 12:17:57.032577 23918 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:57.040184 23918 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:57.034710 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:57.035897 23819 catalog_manager.cc:5697] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 6 to 7, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 7 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:57.037114 23886 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.044036 23915 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:57.045850 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:57.047039 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:57.047690 23886 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:57.048013 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:57.048836 23915 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:57.041168 23918 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.014146 27372 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:56.744793 26713 consensus_queue.cc:1175] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef0dd15ac654478b8371c22b8909240e" responder_term: 8 status { last_received { term: 6 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: [7.9-7.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:57.006453 27199 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.015079 27381 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:56.910478 27356 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.022887 27379 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.243053 23989 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:57.080044 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:57.052944 23918 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.223045 24599 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:57.105465 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:57.248664 23913 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
W20260709 12:17:57.230870 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 122657us
I20260709 12:17:57.071516 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 1972) took 1536 ms. Trace:
I20260709 12:17:57.249325 23988 rpcz_store.cc:276] 0709 12:17:55.535528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.064468 (+528940us) service_pool.cc:224] Handling call
0709 12:17:56.064709 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:56.776873 (+712164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.071205 (+294332us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b5400098654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:57.071435 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1565384960}
I20260709 12:17:57.249644 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:57.021085 27357 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:57.118002 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:57.252941 24063 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:17:57.089747 23960 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:57.165679 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.254117 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.254796 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 165102us
W20260709 12:17:57.256613 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.256935 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.097431 27315 consensus_meta.cc:287] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.988s	user 0.009s	sys 0.000s
W20260709 12:17:57.092463 27320 consensus_meta.cc:287] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.941s	user 0.008s	sys 0.001s
W20260709 12:17:57.060767 27134 consensus_meta.cc:287] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.016s	user 0.007s	sys 0.002s
I20260709 12:17:57.091465 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 496) took 1043 ms. Trace:
I20260709 12:17:57.093468 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:57.092389 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:57.238525 23916 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:17:57.049003 24036 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.004752 27394 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:57.013419 27393 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.077883 27388 raft_consensus.cc:3055] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:57.025614 27302 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:57.241511 23819 catalog_manager.cc:5697] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 5, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 5 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
W20260709 12:17:57.111447 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 76848.5us
I20260709 12:17:57.223752 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:57.258495 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.269529 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:57.243459 27366 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.271700 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:57.272236 23920 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:57.324003 23916 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:57.325344 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:57.225118 27129 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:57.250339 23913 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:17:57.327291 23913 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:57.328253 23913 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.329545 23913 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:57.330160 23819 catalog_manager.cc:5697] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:57.060237 27364 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.273321 23918 raft_consensus.cc:2410] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:17:57.270921 23914 rpcz_store.cc:276] 0709 12:17:56.048349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.048474 (+   125us) service_pool.cc:224] Handling call
0709 12:17:56.048772 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.036219 (+987447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.091225 (+ 55006us) spinlock_profiling.cc:243] Waited 982 ms on lock 0x7b540017aa54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:57.091407 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2258210688}
I20260709 12:17:57.238560 27381 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.064440 27377 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.063474 27316 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.039187 27384 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.085785 27133 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.072160 27172 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:57.277379 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 228416us
I20260709 12:17:57.318753 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:17:57.271446 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 223927us
W20260709 12:17:57.377925 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 59238.9us
I20260709 12:17:57.378217 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:57.378654 23962 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:57.325992 24063 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:57.050314 27391 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:57.049788 27371 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:17:57.382458 27284 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:57.382946 27357 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:57.321696 27379 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:57.272625 27322 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:57.276746 27320 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.344696 27356 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.241191 27395 consensus_queue.cc:1059] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 12:17:57.337025 27129 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.361197 27199 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.362879 27319 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:57.065430 27313 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.071964 27091 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.080034 26895 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:57.369529 26903 consensus_meta.cc:287] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.795s	user 0.006s	sys 0.003s
I20260709 12:17:57.276480 27178 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:57.273948 27201 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.375680 23913 raft_consensus.cc:2410] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:17:57.318784 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 60351.1us
I20260709 12:17:57.274801 27210 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:57.378940 23886 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:57.090178 27385 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.188s
I20260709 12:17:57.378666 23920 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:57.381270 23962 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:57.391757 27129 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.386585 24036 leader_election.cc:400] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8.
I20260709 12:17:57.418505 24036 leader_election.cc:403] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:17:57.419513 24036 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:57.419889 27385 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:17:57.037753 27396 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.313s
W20260709 12:17:57.353545 27230 consensus_meta.cc:287] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.000s
I20260709 12:17:57.388868 27284 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:57.423238 27397 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8.
I20260709 12:17:57.423471 27406 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:17:57.424180 27397 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:57.424238 27210 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.424667 27394 consensus_queue.cc:1059] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:57.425011 27397 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:17:57.425714 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.425622 27394 consensus_queue.cc:1059] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:57.426504 27210 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.394361 27369 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:57.426642 27371 raft_consensus.cc:3055] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:57.396767 27319 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:57.427088 27199 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:57.427254 27371 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:57.274266 27352 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
W20260709 12:17:57.388803 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 342779us
I20260709 12:17:57.430742 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.431030 24598 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:17:57.431136 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.338783 27302 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.318915 27388 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:57.274565 27390 consensus_queue.cc:1059] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:17:57.408641 27395 raft_consensus.cc:3055] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:57.385854 27191 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:57.273996 27315 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:57.395002 27203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.025s	sys 0.021s
I20260709 12:17:57.399362 23819 catalog_manager.cc:5697] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:57.277004 27134 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:57.403306 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 289389us
I20260709 12:17:57.470355 23961 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:57.070515 27359 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.328516 27378 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:57.417428 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:57.417691 27043 consensus_queue.cc:1059] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:57.423010 27284 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.387988 27322 raft_consensus.cc:697] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:57.429415 24596 raft_consensus.cc:2410] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:57.427944 27319 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.434293 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:57.434924 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:57.567371 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 132501us
I20260709 12:17:57.407989 26903 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:57.568068 23887 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.568277 26903 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.429112 26895 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:57.442624 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:57.443686 27390 raft_consensus.cc:3055] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:57.428496 27371 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.444530 27353 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.336807 27366 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.447006 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:57.448629 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:57.448974 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:57.577661 24592 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:57.458379 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:57.462522 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:57.462939 27372 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.581673 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:57.464322 27320 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.464704 27296 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.445235 27191 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:57.440980 27199 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.466871 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:57.575467 26903 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:57.484515 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 67145.4us
I20260709 12:17:57.561239 23919 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7. Ops: []
I20260709 12:17:57.432480 27226 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:17:57.607045 27260 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.608587 27199 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.609483 27315 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.613593 27313 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.625872 27361 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:17:57.629761 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.633055 24592 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:17:57.574764 27390 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:57.667085 24599 raft_consensus.cc:2410] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:17:57.666823 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:57.487627 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:57.668486 24062 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:57.669070 24063 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 8: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:17:57.467810 27203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.025s	sys 0.021s
I20260709 12:17:57.567456 24594 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:57.569208 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.435681 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:57.569790 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 229446us
I20260709 12:17:57.570036 23912 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:17:57.478039 27396 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:57.682104 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 112971us
I20260709 12:17:57.683243 24593 raft_consensus.cc:2410] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:17:57.683807 23914 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:17:57.578190 23819 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:57.579090 23886 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.463986 27091 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.486074 27378 raft_consensus.cc:697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:57.426098 27397 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.586925 27319 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:57.593888 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 172606us
I20260709 12:17:57.713647 24036 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:57.713227 23819 catalog_manager.cc:5697] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 4, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 4 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:57.478164 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.689047 27403 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:17:57.719866 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:57.594655 27191 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:57.603314 27322 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.605576 27302 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.445142 27395 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:57.639199 24070 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:17:57.563586 27129 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:57.641738 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.564306 27359 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:57.685916 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 106886us
W20260709 12:17:57.686691 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45996us
I20260709 12:17:57.683209 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:17:57.709311 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.717831 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:57.599516 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:57.570679 27388 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.720947 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:57.774839 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:57.720834 23819 catalog_manager.cc:5697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:57.775472 23990 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:17:57.775807 24592 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:57.700533 27404 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.776921 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:57.688818 26903 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:57.708379 27371 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.598176 27296 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.791545 23819 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 3, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:57.793103 24566 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:57.768640 27199 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:17:57.769658 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 86580.2us
I20260709 12:17:57.810130 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.771263 23886 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:57.773932 27406 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:57.815297 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.737422 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:57.725368 27369 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:17:57.816682 27134 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.816917 27369 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:57.817840 27369 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.824538 27284 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.825065 27284 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.827207 27284 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.779690 27416 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.831413 27272 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:57.831866 27272 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:57.829560 27178 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:57.832677 27272 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.834559 24035 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:57.701678 27320 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:57.726874 27386 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.836439 27386 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.838796 27386 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:57.840663 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:57.841650 27386 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:57.777416 27361 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.842368 27386 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:57.842572 27361 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.843250 27386 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.773432 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:57.845920 23989 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
W20260709 12:17:57.778410 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 178955us
I20260709 12:17:57.779289 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:57.731316 27379 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:57.851418 23887 leader_election.cc:400] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
I20260709 12:17:57.781522 27366 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.781895 27385 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:57.729233 27372 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:57.829433 27199 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.863493 27372 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.863654 27379 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.785483 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:57.865556 27379 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:57.865736 27199 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.865887 23993 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:17:57.851502 27416 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.858636 27173 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:17:57.789331 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.872470 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:57.873052 23915 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:17:57.805756 24036 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:57.777707 27396 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.834962 27378 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.835398 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:57.816145 27203 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:17:57.848037 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.890146 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 813) took 1192 ms. Trace:
I20260709 12:17:57.890529 24598 rpcz_store.cc:276] 0709 12:17:56.698206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.709257 (+ 11051us) service_pool.cc:224] Handling call
0709 12:17:56.709566 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:57.431483 (+721917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.889932 (+458449us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54004713d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:17:57.890095 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658639744}
I20260709 12:17:57.842072 27381 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.892104 27392 raft_consensus.cc:3055] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:57.892488 27392 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:57.893287 27392 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.897202 27381 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.898970 27364 raft_consensus.cc:3055] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:57.899374 27364 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:57.900013 27129 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.900187 27364 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.901484 27364 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.903028 27296 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.869269 27361 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.778234 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:57.911780 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:57.912360 23921 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.868374 27416 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.769150 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:57.852946 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:57.859624 23819 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 5 to 6, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 6 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:57.874826 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 69141.9us
I20260709 12:17:57.875666 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:17:57.879952 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 108749us
I20260709 12:17:57.731213 27390 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.880455 27134 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:17:57.929762 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:57.881124 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:57.865578 27372 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:57.914999 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:57.918924 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 71821.3us
I20260709 12:17:57.886638 27379 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:57.791091 26903 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.847610 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:57.930897 24600 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:57.854043 23992 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:57.953568 27388 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:57.930688 27416 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.954741 27416 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.957062 27416 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.887784 27203 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.962512 27203 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.943260 27134 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:57.963716 27134 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.964421 26903 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.940099 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:57.946156 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:57.916992 27392 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:57.958868 24595 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:57.959884 24594 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:17:57.961871 27004 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:57.972381 24070 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:57.961689 27191 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:57.930681 27296 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:57.887336 27385 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:17:57.973706 24594 pending_rounds.cc:85] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 8
I20260709 12:17:57.981094 24594 pending_rounds.cc:107] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 7.9
W20260709 12:17:57.981184 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.159421 23991 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:58.166235 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:17:58.167586 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 236369us
W20260709 12:17:57.934758 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 53726.4us
I20260709 12:17:57.954075 23921 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
W20260709 12:17:57.960783 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 113260us
I20260709 12:17:58.169906 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:17:57.928185 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.120433 23819 catalog_manager.cc:5697] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 3, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 3 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
W20260709 12:17:57.985178 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.182641 27173 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:58.183868 27173 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:58.187667 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.189179 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.176656 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:58.200775 23962 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:58.012284 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:57.981427 24594 raft_consensus.cc:2889] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:57.982749 27191 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:58.076896 27203 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.208760 27203 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:57.946053 27210 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:58.210294 27210 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:58.022459 27225 raft_consensus.cc:3055] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:17:58.028481 27272 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:58.217356 27326 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.218413 27326 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:58.219605 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.927557 27361 consensus_queue.cc:1059] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:17:57.948000 27366 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:17:57.944108 27379 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.260504 27379 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:58.030329 27390 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:58.265058 27191 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:58.265612 27191 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:58.266814 23819 catalog_manager.cc:5697] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:17:58.270977 27191 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.887542 27395 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:57.886368 27396 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.272787 27191 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:58.025581 27398 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.681s	user 0.001s	sys 0.004s
I20260709 12:17:57.985662 27404 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:58.032316 27418 log.cc:927] Time spent T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:17:58.026216 27426 log.cc:927] Time spent T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:17:58.169351 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:17:58.165901 27434 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:17:58.201748 27367 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:58.279837 27367 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:58.280350 27367 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.282559 27396 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:58.283599 27372 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:58.284001 27372 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:58.284377 27372 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:58.300203 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.133565 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.223346 24591 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:17:58.221223 27326 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:58.226785 27134 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:58.304508 27134 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:58.305688 27134 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.232029 27225 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:58.308301 27356 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:58.309470 27356 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:58.309170 27225 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.309866 27356 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:58.310763 27225 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:17:58.226123 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 56645.7us
I20260709 12:17:58.311369 27356 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.313153 27356 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:58.235575 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:58.235881 27173 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:58.236872 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 224602us
I20260709 12:17:58.237772 27230 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:17:58.237795 27388 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:58.241112 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:58.315932 23915 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
W20260709 12:17:58.242940 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.243090 27359 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:58.212230 27210 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:58.279358 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 110355us
I20260709 12:17:58.326534 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:58.327909 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:58.320438 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:58.321116 27199 consensus_queue.cc:1059] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:17:58.321355 26903 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:17:58.323130 23918 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:58.318125 27388 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.324716 23920 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:58.314783 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 79589.6us
W20260709 12:17:58.337934 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.333406 27396 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:17:58.344753 23919 raft_consensus.cc:2410] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:17:58.345211 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 46414.3us
I20260709 12:17:58.346184 27395 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:58.347054 27302 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:58.347139 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.347615 27302 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.348028 27302 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:58.348381 27430 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:17:58.349895 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.339493 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:58.351135 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.352643 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:58.339708 27388 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:58.342902 27396 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.359203 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:58.359594 24600 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:58.360108 27430 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:58.362352 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:58.363747 27133 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.364462 27133 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:58.367960 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.383790 27320 raft_consensus.cc:3055] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:58.384266 27320 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:58.385368 27320 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.387678 27371 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:58.387902 27430 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:58.388435 27371 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.357168 27396 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:58.388437 27430 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:17:58.398424 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 197901us
I20260709 12:17:58.419085 27320 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:58.420904 27372 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.423805 23960 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:58.427394 27387 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:58.427554 23919 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:58.428038 27387 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:58.428993 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.398025 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:58.439782 27372 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:58.440429 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.441015 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:58.442004 27385 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:58.443780 23962 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:58.444293 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.444566 27385 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:17:58.449016 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.453316 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:58.455076 27437 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:17:58.455312 27387 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.455996 23991 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:58.458698 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:58.460778 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.396046 27430 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.474717 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:58.479987 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:58.480769 24062 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:58.480918 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:58.483356 27004 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:58.484025 27385 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:58.487460 23991 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:58.488291 27133 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:58.502775 27388 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.504944 27396 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.510411 23962 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:58.512076 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.534150 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.535392 23912 raft_consensus.cc:2410] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:17:58.540066 23920 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:17:58.477514 27367 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:17:58.542294 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 77917.9us
I20260709 12:17:58.544515 27367 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:58.545231 27367 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:58.546250 23987 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:58.549685 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:58.550379 23991 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:17:58.550738 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:58.551455 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:58.552114 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:58.553556 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.552196 23990 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:58.548125 23962 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:58.555979 27396 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:58.556625 27319 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:58.556978 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:58.558395 27388 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:58.563010 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.567693 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:58.565070 23915 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:17:58.571794 23919 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:58.562781 27379 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.582516 27395 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.583345 27395 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.584517 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:58.585224 24065 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:58.586766 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:58.586905 27371 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:58.587493 24061 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:17:58.585908 27395 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:58.603402 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:17:58.604604 24062 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:17:58.535892 27133 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 12:17:58.623976 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 103221us
I20260709 12:17:58.572435 27302 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.616407 27230 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.647814 24591 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:17:58.653623 24061 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:17:58.654472 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:58.654672 23989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:58.675129 23989 raft_consensus.cc:606] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:58.675500 23989 raft_consensus.cc:614] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:58.654968 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:58.660037 24067 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:17:58.662493 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:58.663806 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.614598 27004 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.672147 24065 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:17:58.678993 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:58.681454 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:58.682260 24062 raft_consensus.cc:2410] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:17:58.649251 27395 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.688498 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:58.698906 27410 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.697932 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:58.700654 24566 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:58.704841 24066 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:17:58.709383 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:58.709941 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.712570 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:17:58.713290 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.715479 24061 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:58.728747 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:17:58.729717 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.729460 24063 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: [5.7-7.8]
W20260709 12:17:58.733594 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.728286 23991 raft_consensus.cc:2376] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10. Re-sending same reply.
W20260709 12:17:58.736860 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.737434 27134 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.738062 27134 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.740132 27134 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:58.741884 24594 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:17:58.729598 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:58.748337 23919 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
W20260709 12:17:58.749897 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.753490 23994 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:17:58.705716 27004 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.754649 27091 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:58.755295 27091 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:58.756392 27004 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:58.709929 27390 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.137s
I20260709 12:17:58.724347 27326 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:17:58.749526 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:58.762403 24063 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:17:58.723760 27395 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.764815 23992 raft_consensus.cc:2393] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:58.765364 27395 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:58.770547 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:58.770869 23990 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:58.702636 27230 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:58.771792 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.729341 27378 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:58.729027 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:58.776031 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:58.776062 23994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:58.782357 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.756462 27091 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.812196 23994 raft_consensus.cc:606] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:58.817790 27387 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.823242 23994 raft_consensus.cc:614] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:58.777346 27378 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.774582 27004 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:17:58.830888 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 118384us
W20260709 12:17:58.831218 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.831607 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.776540 27385 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:58.836308 27004 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:58.837392 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:58.837462 27004 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.830768 27378 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:58.838063 24591 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:17:58.838580 27387 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.847473 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.847873 27172 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.848578 27172 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.853533 27378 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:58.862429 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:58.866156 24070 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:58.869735 27378 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:17:58.870833 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.872749 24564 leader_election.cc:336] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 2.356s (SENT)
W20260709 12:17:58.878441 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.880230 27392 consensus_queue.cc:1059] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:58.882234 27302 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:58.883041 27302 raft_consensus.cc:3055] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:58.883533 27302 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:58.884747 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:58.884564 27302 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.885769 27302 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:58.776714 27210 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.111s
I20260709 12:17:58.890662 27230 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:58.892287 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:58.893010 23921 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:17:58.729914 27410 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.815200 27395 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.903318 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:58.919726 23989 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:17:58.918262 23987 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:17:58.919130 23919 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:58.932468 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:17:58.926460 27385 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:58.951665 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:58.951874 27385 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.952394 27385 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:58.954027 24070 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:17:58.955345 24070 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:17:58.957625 27410 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:58.918512 27395 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.933398 27407 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.967296 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:58.968297 24065 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:17:58.963465 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:58.940981 27133 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.962692 27326 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:58.937384 27372 consensus_queue.cc:1059] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:17:58.934511 27430 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:58.983510 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:58.984103 24065 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:17:58.985765 24591 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:58.989207 27458 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:58.989622 27458 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:58.989974 27458 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:58.996342 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:59.002584 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.006417 24069 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:59.009738 23993 raft_consensus.cc:606] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:59.010538 27326 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.003628 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.012702 24068 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.001832 27172 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:59.013578 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:58.997967 27407 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.021869 27395 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:59.037500 24591 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:17:59.037992 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:58.984738 27133 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.043501 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.044234 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:59.057384 23994 raft_consensus.cc:2393] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:17:59.057587 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.047518 27430 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:59.049367 27320 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:17:59.052071 27387 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:59.053483 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.053684 27379 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:59.054199 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.054769 24036 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:59.062777 24067 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:17:59.071652 24070 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.073562 24065 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:17:59.080600 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.081318 24063 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:59.081743 27133 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:59.082544 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:59.090691 24592 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:59.093942 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.094487 24061 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:17:59.089489 27430 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:17:59.099295 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.101204 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.118625 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 63934.2us
I20260709 12:17:59.114401 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.134825 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.135838 27379 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:17:59.136117 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:17:59.144692 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.160228 24070 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:59.160419 24067 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:17:59.160367 24065 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:17:59.165536 24068 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
W20260709 12:17:59.167826 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 66509us
I20260709 12:17:59.174988 23918 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:17:59.170215 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:59.178872 24064 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 10. Ops: []
I20260709 12:17:59.185428 27379 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:17:59.185917 27379 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.186321 27379 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:59.187273 27407 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.177408 27191 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.189010 27191 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.194032 27371 raft_consensus.cc:3055] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:59.194550 27371 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:17:59.177966 27434 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:17:59.211282 24036 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:17:59.213626 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.213822 27410 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:59.214260 27410 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:17:59.214730 27410 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:59.214385 27462 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:17:59.220949 27385 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.223323 27410 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.224622 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:59.229341 27372 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:59.230569 27366 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:59.231637 27454 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:59.233543 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.255991 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.256258 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.240583 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:59.194289 27458 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.262619 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.268155 27454 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.268494 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.269419 24068 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:17:59.223392 27225 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:59.274835 23994 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:17:59.277572 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.278342 27468 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.082s	user 0.003s	sys 0.000s
I20260709 12:17:59.280663 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:59.280949 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.281311 23918 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:59.300231 27302 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:59.301043 27302 raft_consensus.cc:697] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:59.243259 27392 consensus_queue.cc:1059] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:17:59.270447 27454 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.263602 27004 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:17:59.306587 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.304545 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:59.270901 27366 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.275365 27225 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:59.308270 27461 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:17:59.312273 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 71772.7us
I20260709 12:17:59.313951 27302 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.314352 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:59.312232 27461 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.317219 27461 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.340952 27367 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:59.345022 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.345327 27367 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.349056 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.349715 23915 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:17:59.350203 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:59.351197 27470 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:59.351444 27366 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.351257 27410 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:59.352804 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.353432 23918 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:59.356225 27471 log.cc:927] Time spent T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.144s	user 0.002s	sys 0.000s
I20260709 12:17:59.356822 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:59.353641 27225 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.359809 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:59.368484 23990 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:59.359246 27225 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.372159 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.374315 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.374904 23915 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:59.378692 27326 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:17:59.378731 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.370616 27191 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.375696 24564 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:59.369975 27372 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.388456 23992 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:59.396692 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.385407 27470 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:59.367080 27379 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.389034 27388 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:59.372694 27356 consensus_queue.cc:1059] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:17:59.404220 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:59.406291 27388 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:59.406765 27388 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:59.409713 27379 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:59.372653 27395 consensus_queue.cc:1059] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:17:59.410557 27395 consensus_queue.cc:1243] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer ef0dd15ac654478b8371c22b8909240e log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:17:59.411052 27395 raft_consensus.cc:3055] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:17:59.411369 27395 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:59.412168 27395 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.413235 27395 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:17:59.401785 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 87771.3us
I20260709 12:17:59.371779 27461 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.370831 27199 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:17:59.416199 27481 raft_consensus.cc:3055] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:59.420434 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.394840 27372 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.431957 23887 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:59.441486 23918 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:59.444597 27489 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:59.445190 27489 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:59.445645 27489 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.420861 27481 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:17:59.451917 23962 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:59.405424 27473 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.132s
W20260709 12:17:59.457257 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.462261 24070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:17:59.466466 24070 raft_consensus.cc:606] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:17:59.466802 24070 raft_consensus.cc:614] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:59.464983 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.465226 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.442653 27210 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:59.468713 24069 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:17:59.435324 27191 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:17:59.470656 24064 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:17:59.463687 27134 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.453719 27302 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.479094 24596 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:59.487270 27302 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.489516 27302 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:17:59.490721 27349 consensus_queue.cc:1059] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:17:59.491640 27349 raft_consensus.cc:3055] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:17:59.491964 27349 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:59.492759 27349 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.493791 27349 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.494649 23915 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:17:59.496789 27372 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:59.498499 27134 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.500979 27134 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:17:59.502058 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 50230.2us
I20260709 12:17:59.497898 27457 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:17:59.527064 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 81613us
I20260709 12:17:59.557930 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.558434 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.448637 27004 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:17:59.563192 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:59.512246 27385 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.512953 27367 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.501596 27134 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:59.571785 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:59.567523 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:59.567659 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.525826 27458 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.568344 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.563906 27372 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.573361 24067 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:59.567528 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.578621 27388 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.580004 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:59.580893 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:59.581845 27372 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:59.583804 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.684s (SENT) [suppressed 50 similar messages]
I20260709 12:17:59.584684 24066 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:59.585618 24062 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:17:59.576790 23993 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:59.585937 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:17:59.566099 27457 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.576066 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.579257 24061 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
W20260709 12:17:59.587772 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 51382.8us
I20260709 12:17:59.586572 23996 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:59.585633 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:17:59.588969 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 200048us
I20260709 12:17:59.589885 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:59.522840 27371 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.595006 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.595602 23991 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:59.596428 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:59.600970 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:17:59.602149 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:59.603245 23991 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:59.605170 23989 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:59.591270 27396 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:17:59.607635 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 219773us
I20260709 12:17:59.606918 23962 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:59.613992 24064 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:17:59.616254 24064 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:17:59.599524 27390 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:59.620048 23996 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:17:59.622648 27319 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:59.609778 27490 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:17:59.630504 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:59.600275 27134 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:59.608826 27486 consensus_queue.cc:1059] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:17:59.611399 27410 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:59.609185 27379 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:59.633894 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:17:59.629551 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:59.629112 27371 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.634651 24596 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:17:59.639163 27388 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.645563 27004 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:59.650530 27320 raft_consensus.cc:3055] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:17:59.650931 27320 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:59.651722 27320 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.652884 27320 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:59.653748 27470 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:17:59.654738 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:59.656267 24068 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:17:59.656608 24068 pending_rounds.cc:85] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 4
I20260709 12:17:59.656759 23915 raft_consensus.cc:1240] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:59.656809 24068 pending_rounds.cc:107] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:17:59.657492 24068 raft_consensus.cc:2889] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:59.657121 27489 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.658179 23918 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:17:59.658795 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.659049 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.659693 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.660490 23912 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:59.661582 27457 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.632404 27390 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:17:59.662166 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.663113 27210 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:17:59.663028 27390 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.663828 27210 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:59.663942 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.664255 27210 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:17:59.664675 27210 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:59.665715 23917 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:59.634032 27410 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.663142 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.636492 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:17:59.667635 23920 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:17:59.672101 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.672317 23994 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:17:59.666765 27410 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.671669 27385 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:59.676559 23914 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:17:59.673203 23917 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:17:59.673799 23962 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:59.672719 23886 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:17:59.680369 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.683284 23993 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:17:59.677739 23917 pending_rounds.cc:85] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 5
I20260709 12:17:59.687419 23917 pending_rounds.cc:107] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:17:59.687748 23917 raft_consensus.cc:2889] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:59.681097 23920 raft_consensus.cc:2376] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10. Re-sending same reply.
I20260709 12:17:59.690563 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:17:59.691226 24596 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:59.691506 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.692646 24035 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:59.693576 27385 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:59.693662 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.694249 27385 raft_consensus.cc:697] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:59.694384 23920 raft_consensus.cc:2376] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6. Re-sending same reply.
I20260709 12:17:59.694979 23913 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:17:59.695364 23913 pending_rounds.cc:85] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 4
I20260709 12:17:59.695719 23913 pending_rounds.cc:107] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:17:59.695930 23913 raft_consensus.cc:2889] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:59.697853 27489 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.695200 27385 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.713774 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.677464 27396 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:59.715320 24600 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: []
I20260709 12:17:59.715461 24566 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:17:59.731734 27482 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:17:59.731819 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.732424 27482 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.732590 23920 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.732757 23960 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:59.733343 27452 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:17:59.699328 27461 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.734465 27493 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.734556 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:59.735395 27004 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:17:59.732846 27482 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.735574 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:59.738794 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.741014 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.744565 23915 raft_consensus.cc:2410] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:17:59.745185 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 72541.3us
I20260709 12:17:59.736861 27004 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:17:59.748632 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:17:59.750592 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 79544.6us
I20260709 12:17:59.737843 27225 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:59.751531 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:59.740365 27461 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:59.735111 27493 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.743359 27457 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:17:59.763098 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.725955 27326 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:17:59.750232 27004 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:17:59.773447 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.774303 23913 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:17:59.775074 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.778832 27319 raft_consensus.cc:993] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:17:59.779265 27319 raft_consensus.cc:1081] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:17:59.755477 27225 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.784684 27225 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:59.781076 23920 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:17:59.693805 27481 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.754721 27470 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:59.752333 27495 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.783284 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.784252 23913 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:17:59.789453 23914 raft_consensus.cc:2393] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:59.767978 27458 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:59.754508 27388 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:17:59.793262 23917 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:17:59.768977 27461 raft_consensus.cc:697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:59.756309 27203 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:17:59.801786 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.781810 27457 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:59.804905 27457 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.789420 27470 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.819211 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.799937 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:17:59.791415 27490 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:17:59.812668 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:17:59.804862 27378 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.824882 27469 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:17:59.825304 27469 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:17:59.827527 23917 raft_consensus.cc:2410] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:17:59.830585 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.825213 27378 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.802526 27458 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:59.819581 27470 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:59.837163 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:17:59.820525 23919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:17:59.843777 23919 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:59.844094 23919 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.792027 27495 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.826071 27359 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:17:59.847241 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:17:59.847862 24065 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:17:59.805039 27319 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:17:59.849128 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.850219 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.851738 23917 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:17:59.852227 24061 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:59.850607 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.853996 24062 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:17:59.854519 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.855422 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.833287 27469 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:17:59.857069 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:17:59.861241 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.861624 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:17:59.865404 24063 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:17:59.927309 23914 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:59.930101 24068 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:17:59.951941 24061 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:17:59.845369 27367 consensus_queue.cc:1059] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
I20260709 12:17:59.927618 27359 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:17:59.970017 23917 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:17:59.964735 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.846661 27474 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 12:17:59.977681 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.978829 23917 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:17:59.982818 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.983649 23914 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:17:59.980785 27486 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.984247 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.984899 27486 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.985118 27210 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:17:59.985500 27497 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:17:59.985543 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.985945 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:17:59.986339 23917 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 4.
I20260709 12:17:59.987028 27486 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.983197 27385 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.987243 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.988075 27385 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.989249 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:17:59.990334 27361 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:17:59.990758 27361 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.990932 27385 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:59.991225 27361 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:17:59.998165 23917 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:17:59.982965 27500 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.006386 27500 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.008596 27500 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.010565 27493 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:17:59.978623 27490 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.013206 27004 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:17:59.987143 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.015570 23916 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:00.021011 24062 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
W20260709 12:18:00.022455 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.019766 23919 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.031960 23917 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:00.039177 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.040284 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.040726 23919 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.039140 27319 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.046528 27319 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.050297 27477 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:00.051052 27477 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.050971 27359 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.053881 27477 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.054965 27319 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.059067 27495 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:17:59.973264 27461 consensus_queue.cc:237] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.111001 27487 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:00.111606 27487 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:17:59.979718 27458 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.066952 27134 raft_consensus.cc:3055] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:00.067631 27505 raft_consensus.cc:3055] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:00.068240 27493 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.069260 27210 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:00.070269 27410 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.073022 27225 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.073767 27378 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:00.078202 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:00.079602 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.083400 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.084458 23915 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:00.117964 23918 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:00.118557 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.086771 23913 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:00.086503 27469 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.087350 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.089903 27372 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:00.121213 23920 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:00.096807 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.123035 23921 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 4.
I20260709 12:18:00.119885 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:00.124966 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.101919 24063 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:00.125192 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.126227 23916 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:00.127018 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.127672 23918 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:00.130360 23991 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:00.131569 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:00.137037 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:00.137948 23990 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:00.139173 23988 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:00.117004 27505 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:00.142510 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:00.169562 23988 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:00.115422 27134 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:00.169957 23988 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:00.116484 27326 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.145980 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:00.177165 24592 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:18:00.141788 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:00.177954 23990 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:18:00.147220 27487 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:00.149296 27499 log.cc:927] Time spent T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.344s	user 0.002s	sys 0.000s
I20260709 12:18:00.149669 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:00.140362 27482 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:00.161784 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:00.189081 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 109753us
I20260709 12:18:00.161082 27361 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.162110 27349 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:00.164409 27225 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:00.165884 27410 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:00.124334 27493 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.167773 27494 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.181348 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:00.193358 23990 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:00.193919 23992 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:00.184791 27469 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.183305 23988 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.230695 23988 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:00.230845 23993 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:00.209575 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:00.213583 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:00.214203 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.214787 23989 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:00.232038 24070 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:00.214223 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:00.232714 23994 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 5.
I20260709 12:18:00.219101 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:00.195259 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:00.233801 24596 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:18:00.234637 27191 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:00.235038 27191 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.235353 27191 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.239372 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:00.238452 27494 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:00.252938 27514 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:18:00.239542 27470 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.277205 27470 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.277715 27482 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.278512 27505 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.279938 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:00.280428 27481 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:00.280733 23990 raft_consensus.cc:2410] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:18:00.280815 27494 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:00.265394 27004 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:00.280696 23988 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:00.289289 24070 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:00.271306 27361 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:00.253113 27134 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.291407 24600 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:00.240063 24594 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:00.218390 27495 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:00.238658 27367 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:18:00.258023 27396 consensus_queue.cc:1059] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:18:00.273907 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 64896.6us
I20260709 12:18:00.275244 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:00.294895 24564 leader_election.cc:336] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.556s (SENT)
I20260709 12:18:00.305473 24564 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.305541 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.297458 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:00.187942 27326 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.209259 27349 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.303963 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.298714 27469 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.319594 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:00.332044 23993 raft_consensus.cc:606] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:00.333724 24591 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:00.328032 24566 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:00.339473 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 156391us
I20260709 12:18:00.312789 27133 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:00.309945 27487 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:00.352165 23989 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:18:00.352561 23989 pending_rounds.cc:85] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 8
I20260709 12:18:00.352778 23989 pending_rounds.cc:107] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:18:00.352995 23989 raft_consensus.cc:2889] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:00.353994 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:00.354660 24067 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:00.355630 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:00.356400 23993 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:00.356803 27379 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:00.357354 27379 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.358927 24036 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:00.359862 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:18:00.360098 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 146190us
I20260709 12:18:00.366879 24065 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:00.360503 27478 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:18:00.371534 27478 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:00.371999 27478 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:00.373024 27478 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.359943 27379 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.350482 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:00.350689 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:00.361425 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.377364 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:00.378525 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:00.378849 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.379184 24068 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:00.379657 27470 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:00.379719 27388 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:00.380324 24068 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:00.381103 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.381664 27134 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:00.381886 27490 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:00.362248 27482 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:00.383069 27490 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:00.362689 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:00.314816 27474 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:00.319322 27508 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:00.390436 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:00.391263 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 70010.8us
I20260709 12:18:00.391852 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:00.345327 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:00.330961 27319 raft_consensus.cc:3055] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:00.398883 23990 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:00.398944 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:00.398986 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:00.401628 23962 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:00.403155 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:00.383400 27482 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.340427 27452 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:00.408058 24069 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:00.408354 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:00.394042 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:00.410427 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:00.413802 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:00.417343 24065 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:00.380429 27470 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.308892 27495 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.407739 27478 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:00.402300 27319 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:00.408771 27371 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:00.338949 27203 consensus_queue.cc:1059] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:18:00.337986 27469 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.427258 24065 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:00.437108 27493 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.411000 27302 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:00.411788 27506 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:00.412333 27482 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.419448 27392 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:18:00.411634 27395 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:00.417192 27452 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.437978 27004 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:00.453781 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:00.455834 23887 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.528755 24591 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:18:00.528846 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73071.9us
I20260709 12:18:00.452322 27506 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.459411 27326 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:00.522163 23990 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:00.461097 27191 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.462237 27469 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:00.463939 27349 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:00.409998 27508 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.465339 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.466399 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.467036 27493 consensus_queue.cc:1059] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:00.446489 27410 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:00.419467 27474 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.435534 27379 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:18:00.474754 27521 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.480046 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:00.483711 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:00.486479 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:18:00.556352 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 76401.9us
I20260709 12:18:00.530678 27302 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:18:00.505733 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 165579us
I20260709 12:18:00.558684 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:00.525656 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 108577us
W20260709 12:18:00.383944 27372 consensus_queue.cc:1175] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0829ddf18f07439086398756b9c6d216" responder_term: 7 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:00.537098 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:00.538038 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:00.543620 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:00.544008 24566 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:00.544005 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:00.527854 27452 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.549052 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:00.550326 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:00.551287 27395 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:00.554247 24592 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:00.554759 23912 raft_consensus.cc:2393] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:00.528223 27004 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:00.533326 27506 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:00.440783 27487 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:00.557808 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:00.564374 27531 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:00.561131 24600 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:00.554229 27493 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:00.552299 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:00.565694 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:00.579561 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:00.534171 27489 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.543033 27470 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:18:00.585880 23917 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:18:00.546479 27500 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:18:00.590781 24070 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:00.564864 27326 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:00.562414 27490 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:00.593914 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:00.574522 27371 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:00.588999 27493 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:00.591571 27410 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:00.576232 27004 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:00.624890 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 72644.9us
W20260709 12:18:00.627972 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 69357.7us
W20260709 12:18:00.622988 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 79446.3us
I20260709 12:18:00.634979 27349 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:18:00.638036 23912 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:00.594219 27531 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.638788 27191 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.589395 27302 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.641185 27531 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.625463 27487 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:00.630803 23917 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:00.566380 27521 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:00.642755 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:00.630426 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 70917.8us
I20260709 12:18:00.648175 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.643344 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:00.634259 24594 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:00.645527 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.628098 27490 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.651120 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:00.651254 27371 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.659567 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:00.661849 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.662185 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.662602 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.662791 23919 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.663046 23918 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:00.636193 27326 raft_consensus.cc:697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:00.663318 23921 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:00.648089 27487 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.665666 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.666324 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.669196 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.669819 23913 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:00.671638 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.654503 27378 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:00.652837 27490 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:00.674890 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.676959 23921 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:00.677595 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.678951 27537 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:18:00.680841 27536 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:00.681429 27536 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:00.681888 27536 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.682685 27508 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:00.683640 27410 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.686386 27533 raft_consensus.cc:2764] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:18:00.687335 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.687666 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.688481 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.689159 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.689908 23920 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:00.690898 27524 log.cc:927] Time spent T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:18:00.692181 27528 log.cc:927] Time spent T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:18:00.693318 27457 raft_consensus.cc:3055] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:00.693439 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.693822 27457 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:00.694538 23913 raft_consensus.cc:2410] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:18:00.696851 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.701670 24600 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
W20260709 12:18:00.703441 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.704383 23912 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:00.705648 24035 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:00.663244 27500 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:00.648468 27191 consensus_queue.cc:1059] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:18:00.711807 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:00.728138 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 75458.1us
I20260709 12:18:00.728487 23921 raft_consensus.cc:2393] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:00.664697 27372 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:00.726964 23919 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:18:00.647811 27531 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:18:00.732372 23916 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:18:00.732875 23916 pending_rounds.cc:85] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 7
I20260709 12:18:00.733171 23916 pending_rounds.cc:107] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:18:00.733458 23916 raft_consensus.cc:2889] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:00.725327 23918 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:00.671057 27487 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.658978 27349 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 12:18:00.734489 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 86383.6us
I20260709 12:18:00.662685 27481 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:18:00.675999 27539 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:18:00.670035 27388 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:18:00.741214 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:00.745707 23920 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:00.727578 27533 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:00.739981 23915 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:00.751955 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.756281 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:00.753105 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:00.654858 27395 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.735991 27500 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:00.765847 23913 raft_consensus.cc:2376] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10. Re-sending same reply.
I20260709 12:18:00.777920 24564 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:00.777777 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.779001 23990 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:00.781287 23996 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:00.782568 24034 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:00.666689 27493 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.795086 27210 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:00.795346 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:00.797365 27191 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:00.797933 23912 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:00.784340 27474 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:00.802536 27396 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:00.803098 27396 raft_consensus.cc:697] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:00.786649 27326 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.804093 27396 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.811713 27500 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.817031 27469 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:00.819779 27457 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.821408 27457 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:00.831646 23912 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:00.779984 27533 raft_consensus.cc:697] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:00.839836 27458 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:00.829048 27203 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:00.836447 27493 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:00.835186 27477 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:00.817795 27469 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:00.801887 27452 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:00.967381 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 190439us
I20260709 12:18:00.972142 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:00.967163 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 197126us
W20260709 12:18:00.978550 24564 leader_election.cc:336] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.568s (SENT)
I20260709 12:18:00.858969 27203 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:00.988685 27203 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:01.009811 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:01.112540 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 102787us
I20260709 12:18:01.119374 24592 raft_consensus.cc:2393] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:18:01.120340 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 141816us
I20260709 12:18:01.138132 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:01.145958 27495 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:01.156090 27505 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.159073 27454 raft_consensus.cc:3055] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:01.159559 27454 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:01.159812 23818 catalog_manager.cc:5697] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 5, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 5 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.161715 23818 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 8, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 8 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:01.159240 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:01.008442 27371 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:01.168543 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 390822us
I20260709 12:18:01.007221 27482 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:01.178232 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 64844.2us
I20260709 12:18:01.119510 27478 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:01.170969 23987 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:01.011425 27536 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:00.961243 27533 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.198038 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:01.183073 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:01.182957 27004 consensus_meta.cc:287] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.003s
I20260709 12:18:01.190040 27454 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.006240 27487 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.197654 24034 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:01.202093 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.204813 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:01.208261 24061 raft_consensus.cc:2393] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 5: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:01.208516 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.201467 27390 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:01.213730 27487 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:01.214509 27487 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:01.216853 27482 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:01.219065 27469 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:01.202930 27004 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:01.223866 27506 consensus_meta.cc:287] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.634s	user 0.002s	sys 0.012s
I20260709 12:18:01.224409 27506 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.224915 27004 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:01.203293 27495 consensus_queue.cc:1059] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:18:01.226569 27487 raft_consensus.cc:3055] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:01.227036 27487 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:01.232775 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.228139 27487 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.242867 27495 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:01.250483 27487 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.203914 27452 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:01.233934 27454 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:01.276595 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 81003.2us
I20260709 12:18:01.280100 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:01.281699 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.203361 27134 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
W20260709 12:18:01.284188 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 103194us
I20260709 12:18:01.285200 24564 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.286664 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:01.287297 23990 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.292237 24564 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.295428 24564 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.298238 23990 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:01.278169 27543 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:01.310819 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.301216 27494 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:01.318235 27553 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:01.300793 27452 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:01.319341 27495 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:01.290701 27482 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:01.328090 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 128755us
I20260709 12:18:01.309034 27326 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:01.329671 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:01.325203 27543 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.332767 27543 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:01.337404 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.337524 24034 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.328306 27371 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:01.371019 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:01.371917 24600 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:01.339277 27410 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.003s	sys 0.039s
I20260709 12:18:01.377491 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:01.379902 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 84512.3us
W20260709 12:18:01.379691 27410 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.003s	sys 0.039s
I20260709 12:18:01.389084 24600 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:01.390900 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:01.333839 27203 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.360610 27506 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:01.403020 27547 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:01.376634 27302 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:01.380497 27371 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:01.415824 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 93269.4us
I20260709 12:18:01.410651 27536 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:01.410822 27490 consensus_meta.cc:287] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.002s
I20260709 12:18:01.419832 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.379446 27482 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:01.424088 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.417273 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:01.437003 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:01.418953 27547 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:01.417878 27302 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.451427 27547 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:01.441545 27555 log.cc:927] Time spent T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:18:01.439953 27493 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:01.445629 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:01.422405 27490 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.453858 27493 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:01.447316 27371 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:01.454347 23918 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 11: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:01.454520 27371 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.454792 27493 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.456570 27371 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:01.448887 27546 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.457232 27546 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.458442 27302 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:01.459309 27546 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:01.449631 27506 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:01.459944 27506 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.461849 27506 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:01.426437 27410 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:01.463932 27490 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:01.464567 27546 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.465070 27546 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.467197 27546 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:01.469267 27482 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:01.432284 27536 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:01.479242 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 96193.4us
I20260709 12:18:01.488265 24564 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:01.508390 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:01.509498 27536 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:01.509887 27536 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:01.510445 27536 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:01.519539 27536 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.522226 27536 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:01.509917 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.529696 27536 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:01.536656 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 2121) took 1126 ms. Trace:
I20260709 12:18:01.537221 24069 rpcz_store.cc:276] 0709 12:18:00.410529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.413517 (+  2988us) service_pool.cc:224] Handling call
0709 12:18:01.536384 (+1122867us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b540004bd54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:01.536561 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1150553984}
I20260709 12:18:01.538261 27493 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:01.538857 27493 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.541419 27493 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:01.548205 27556 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:18:01.539549 23806 connection.cc:573] client connection to 127.22.48.3:42409 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:18:01.544793 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 984873us
I20260709 12:18:01.551967 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:01.552944 27477 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:01.553575 27477 raft_consensus.cc:697] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:01.554718 27521 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:01.556921 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:01.562325 23917 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:01.562587 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:01.563544 23920 raft_consensus.cc:2393] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:01.564714 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.565449 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2272) took 1221 ms. Trace:
I20260709 12:18:01.565830 23988 rpcz_store.cc:276] 0709 12:18:00.344301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.345112 (+   811us) service_pool.cc:224] Handling call
0709 12:18:00.345394 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:00.575305 (+229911us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.575335 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:00.575371 (+    36us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:00.575400 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.565233 (+989833us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54002aa3d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:01.565273 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.565369 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":528355584}
I20260709 12:18:01.569080 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:01.568986 27319 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.569867 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:01.574227 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 657) took 1024 ms. Trace:
I20260709 12:18:01.574687 24065 rpcz_store.cc:276] 0709 12:18:00.549323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.563692 (+ 14369us) service_pool.cc:224] Handling call
0709 12:18:01.574065 (+1010373us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b54001b76d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:01.574175 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1833213312}
I20260709 12:18:01.570076 27319 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:01.575789 27473 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.576448 23962 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:01.576273 27473 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.577517 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:01.578924 27473 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:01.579595 27396 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:01.569026 23988 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:01.581013 27508 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:01.581591 24600 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:01.582183 27367 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.582777 27487 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:01.582975 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:01.583339 27487 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:01.584156 27487 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.585070 27487 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:01.582790 27367 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.587581 27367 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:01.588516 23913 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:01.589175 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:01.588752 23818 catalog_manager.cc:5697] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.590364 23818 catalog_manager.cc:5697] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:01.591635 23818 catalog_manager.cc:5697] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 7, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 7 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.593858 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.594043 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.594995 23917 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:01.596197 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:01.554768 27477 consensus_queue.cc:237] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.596985 23918 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:01.600060 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:01.601642 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.602407 23913 raft_consensus.cc:2368] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:01.602912 23989 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: [9.5-10.6]
I20260709 12:18:01.603158 27508 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:01.603775 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:01.605784 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:01.606310 23920 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:01.607604 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.608201 23990 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:01.609759 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:01.611676 27482 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.612191 27482 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.608170 23914 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:01.614614 27410 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.615098 27410 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.617189 27410 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:01.618876 27482 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:01.593549 23818 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:01.622051 27371 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.622967 27371 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.623245 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.625064 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.625190 27371 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:01.625705 23912 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:01.615001 27526 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:18:01.631844 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.634709 23914 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:01.637009 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:01.640758 23818 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 3 to 5, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 5 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:01.648337 23920 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:01.648572 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:01.650756 27478 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:01.664849 27482 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.665457 27482 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:01.651821 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 74371.1us
I20260709 12:18:01.639464 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:01.667470 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:01.668252 27482 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:01.662797 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 2115) took 1297 ms. Trace:
I20260709 12:18:01.644111 23818 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 9, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 9 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.668920 27361 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:01.669754 27508 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:01.673849 24068 rpcz_store.cc:276] 0709 12:18:00.364832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.381107 (+ 16275us) service_pool.cc:224] Handling call
0709 12:18:00.381390 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:00.382741 (+  1351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.382769 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.282855 (+900086us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b2c000dbec8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:18:01.286731 (+  3876us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.414544 (+127813us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:01.649048 (+234504us) log.cc:844] Serialized 14 byte log entry
0709 12:18:01.650482 (+  1434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.651159 (+   677us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:01.651280 (+   121us) raft_consensus.cc:1685] finished
0709 12:18:01.651470 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.662600 (+ 11130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5047,"raft.queue_time_us":2382,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":13097,"spinlock_wait_cycles":17147776,"thread_start_us":343778,"threads_started":2,"wal-append.queue_time_us":189287}
I20260709 12:18:01.670346 23988 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 5: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:01.678470 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.652799 23918 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:01.680936 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:01.683112 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.683745 24061 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:01.677157 24069 raft_consensus.cc:1240] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:01.681545 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:01.684819 23991 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:01.681587 23988 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:01.677717 23818 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 5 to 8, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 8 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:01.694108 24064 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:01.703514 24068 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:01.707084 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 206436us
I20260709 12:18:01.707647 27319 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.708215 27319 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.709439 27559 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:01.711510 27388 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:01.712112 27388 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.718024 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:01.693974 23818 catalog_manager.cc:5697] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 5, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 5 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:01.723939 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.724891 23920 raft_consensus.cc:2393] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:18:01.734508 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.738058 24068 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:01.737151 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.736807 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.740026 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:01.740721 24070 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:01.744231 24069 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:01.719110 27452 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:01.747318 27452 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:01.748390 27388 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:01.748517 27452 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:01.751012 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:01.706753 27494 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:18:01.740407 24061 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:01.755515 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.756080 23914 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:01.757699 27203 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:01.738540 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.764670 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.765466 23914 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:01.770613 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.655543 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:01.774968 23919 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:01.779579 24591 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:18:01.779980 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.786602 23914 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:01.787866 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.789148 23920 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:01.795318 24068 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:01.797559 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.798485 24062 raft_consensus.cc:2410] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:01.823307 24034 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:01.796860 23806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 247143us
W20260709 12:18:01.848273 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:01.859272 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 203824us
W20260709 12:18:01.849045 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 89199.5us
W20260709 12:18:01.851022 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.851814 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:01.862118 23920 raft_consensus.cc:2393] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:01.862747 24034 leader_election.cc:400] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:01.863062 24034 leader_election.cc:403] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:01.863013 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:01.853575 23914 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:01.864238 24066 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:01.858588 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:01.855329 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:01.855494 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.848989 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.848765 27372 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:01.863134 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:01.870440 23960 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:01.858180 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.851727 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.873108 23919 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:18:01.879653 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:01.818172 27482 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.885871 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:01.883100 23960 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:01.900245 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:01.903822 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:01.904592 24061 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:01.849298 27319 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:01.908365 24564 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:01.874941 27521 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:01.882721 27473 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:01.908527 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:01.914680 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:01.924880 23916 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:01.919855 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.906831 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:01.893548 27543 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.888726 27372 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:01.929920 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.930939 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 2112) took 1567 ms. Trace:
I20260709 12:18:01.897327 27302 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:01.935776 24067 rpcz_store.cc:276] 0709 12:18:00.363860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.383667 (+ 19807us) service_pool.cc:224] Handling call
0709 12:18:01.924217 (+1540550us) spinlock_profiling.cc:243] Waited 769 ms on lock 0x7b540021cd54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:01.930870 (+  6653us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1767786752}
I20260709 12:18:01.906363 27371 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:01.947456 23920 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:01.948593 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:01.989217 24068 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:18:01.953709 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:01.921300 27470 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.920620 27526 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:01.930301 27473 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.947507 24061 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:01.921407 27521 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:01.922039 27559 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:01.930264 27508 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.899827 27199 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:18:02.052654 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:01.938045 27478 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:01.938679 27495 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.937850 27302 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.900568 27482 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:01.907537 27410 consensus_queue.cc:1059] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:18:01.957913 27225 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:01.921686 27459 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:18:01.956288 27371 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.070354 27473 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:02.104774 27478 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:02.171594 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 271418us
I20260709 12:18:02.172310 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:01.987958 27571 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:02.065495 24035 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:01.958199 27500 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:02.102524 27361 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:02.088927 27430 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.561s	user 0.025s	sys 0.054s
I20260709 12:18:02.070127 27521 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:02.119943 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 166231us
W20260709 12:18:02.068099 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 114485us
I20260709 12:18:02.168854 27489 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:02.194310 24061 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:02.064774 27372 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:02.166741 23818 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 5 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1), VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2), VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3), VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 9 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:02.105551 27487 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:01.929982 27536 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 12:18:02.065006 27542 consensus_queue.cc:1059] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 12:18:02.110205 27302 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:02.070713 27470 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.162482 27371 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:02.187093 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:01.991585 27541 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 12:18:02.187105 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:02.296175 24067 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:18:02.172596 27410 consensus_queue.cc:1243] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer 0829ddf18f07439086398756b9c6d216 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:02.103286 27508 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.103102 27559 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:02.181102 27430 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.658s	user 0.025s	sys 0.054s
I20260709 12:18:02.176056 27478 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:02.110729 27495 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:02.195905 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 143537us
I20260709 12:18:02.213080 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:02.272296 27590 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 12:18:02.183177 27361 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:02.271313 27586 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260709 12:18:02.272024 27579 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 12:18:02.193513 27533 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:02.194392 27489 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:02.255642 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:02.256910 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:02.183917 27396 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.367596 23886 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:02.297953 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 233440us
I20260709 12:18:02.181607 27500 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:02.306051 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.202481 27372 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.334358 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:02.288424 27526 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:02.303033 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:02.384058 23993 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
W20260709 12:18:02.360971 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 173940us
I20260709 12:18:02.350322 27410 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:02.368063 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:02.371021 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:02.377154 23886 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:02.379225 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:02.389556 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:02.388007 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 85019.8us
I20260709 12:18:02.379921 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:02.391824 23962 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:02.392241 24564 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:02.389945 23991 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:18:02.389530 23992 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:18:02.366750 27533 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.366583 27568 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:02.418143 27567 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.418848 27567 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:02.424257 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 53298.4us
I20260709 12:18:02.382637 27493 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:02.383035 27597 raft_consensus.cc:3055] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:02.442770 27378 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.112s
I20260709 12:18:02.409934 27319 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:02.402619 27388 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:02.403208 27490 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:02.528967 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 151910us
I20260709 12:18:02.443048 27571 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:02.443029 27533 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:02.382481 27396 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:02.523401 27583 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.418s	user 0.001s	sys 0.001s
I20260709 12:18:02.421298 27567 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:02.522420 27597 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:02.557192 27559 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:02.403939 27526 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:02.552021 27582 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:18:02.554553 27506 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:02.555599 27585 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.378s	user 0.001s	sys 0.000s
W20260709 12:18:02.555748 27588 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:18:02.548382 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 647) took 2403 ms. Trace:
I20260709 12:18:02.576954 23991 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:02.558697 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 1056) took 1011 ms. Trace:
W20260709 12:18:02.547623 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 143504us
I20260709 12:18:02.590314 24063 rpcz_store.cc:276] 0709 12:18:00.137201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.138833 (+  1632us) service_pool.cc:224] Handling call
0709 12:18:00.156365 (+ 17532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:00.341507 (+185142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.341539 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.114225 (+772686us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b180048b020. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb332a6 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a
0709 12:18:01.519510 (+405285us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b2c000dbec8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:18:01.520077 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.796342 (+276265us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:01.796375 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.796444 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.540865 (+744421us) raft_consensus.cc:1685] finished
0709 12:18:02.540888 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.541038 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162907,"raft.queue_time_us":180457,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":5429,"spinlock_wait_cycles":14510208,"thread_start_us":275846,"threads_started":1,"wal-append.queue_time_us":438112}
I20260709 12:18:02.592473 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:02.542919 27568 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:02.556888 27597 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:02.444027 27489 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.591552 24598 rpcz_store.cc:276] 0709 12:18:01.547001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.558109 (+ 11108us) service_pool.cc:224] Handling call
0709 12:18:01.558448 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:01.841725 (+283277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.841764 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:01.875425 (+ 33661us) log.cc:844] Serialized 52 byte log entry
0709 12:18:02.296998 (+421573us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:02.297047 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.297118 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.558438 (+261320us) raft_consensus.cc:1685] finished
0709 12:18:02.558463 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.558629 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307406,"raft.queue_time_us":290425,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":16588,"thread_start_us":287151,"threads_started":1,"wal-append.queue_time_us":472294}
I20260709 12:18:02.540949 27482 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:02.617494 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 192137us
I20260709 12:18:02.619904 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:02.620012 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:02.621100 24068 raft_consensus.cc:2393] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 8: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:02.579998 27567 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.550405 27457 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:02.646332 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:02.549228 27571 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:02.653214 23991 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:02.580190 27319 consensus_queue.cc:1059] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 12:18:02.649677 27489 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:02.646358 27583 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:18:02.663698 27593 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:18:02.664748 27598 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:18:02.649578 27482 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:02.666256 27571 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:02.667106 27372 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:02.685315 23960 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.005s	sys 0.016s
W20260709 12:18:02.688596 23960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.005s	sys 0.016s
I20260709 12:18:02.688827 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2277) took 1119 ms. Trace:
W20260709 12:18:02.689018 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 757063us
I20260709 12:18:02.689880 23960 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:02.601504 27506 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.652658 27457 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:02.689340 23996 rpcz_store.cc:276] 0709 12:18:01.569281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.572184 (+  2903us) service_pool.cc:224] Handling call
0709 12:18:01.572476 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.572884 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:01.572910 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.573323 (+   413us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.672500 (+ 99177us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:01.672549 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.672625 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.688555 (+1015930us) raft_consensus.cc:1685] finished
0709 12:18:02.688582 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.688752 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":254,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":98746,"threads_started":1,"wal-append.queue_time_us":476535}
I20260709 12:18:02.704624 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2342) took 1140 ms. Trace:
I20260709 12:18:02.705024 23921 rpcz_store.cc:276] 0709 12:18:01.558986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.559166 (+   180us) service_pool.cc:224] Handling call
0709 12:18:01.559435 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.559780 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:01.559807 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.560232 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.796728 (+236496us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:01.796782 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.796840 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.699468 (+902628us) raft_consensus.cc:1685] finished
0709 12:18:02.699495 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.699647 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2333,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":236099,"threads_started":1,"wal-append.queue_time_us":627790}
I20260709 12:18:02.693619 27319 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:02.653213 27567 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:02.704782 27457 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:02.744846 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2343) took 1185 ms. Trace:
I20260709 12:18:02.707948 27495 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:02.750104 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2227) took 1155 ms. Trace:
W20260709 12:18:02.750555 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.698776 27546 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:18:02.750620 23917 rpcz_store.cc:276] 0709 12:18:01.597958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.607827 (+  9869us) service_pool.cc:224] Handling call
0709 12:18:01.608185 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.608592 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.608618 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.609130 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.777848 (+168718us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:01.782758 (+  4910us) log.cc:844] Serialized 14 byte log entry
0709 12:18:01.784434 (+  1676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.785640 (+  1206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.749839 (+964199us) raft_consensus.cc:1685] finished
0709 12:18:02.749865 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.750038 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1870,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":615,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":178,"thread_start_us":168246,"threads_started":1,"wal-append.queue_time_us":564701}
I20260709 12:18:02.746135 23915 rpcz_store.cc:276] 0709 12:18:01.559386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.560666 (+  1280us) service_pool.cc:224] Handling call
0709 12:18:01.560936 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.561258 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:01.561540 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 12:18:01.696618 (+135078us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.697143 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.697273 (+   130us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:01.697306 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.697379 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.744621 (+1047242us) raft_consensus.cc:1685] finished
0709 12:18:02.744640 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.744786 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10351,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1134,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":162,"spinlock_wait_cycles":14592,"thread_start_us":134452,"threads_started":1,"wal-append.queue_time_us":377681}
W20260709 12:18:02.753499 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 127149us
I20260709 12:18:02.733969 27508 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:02.755398 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 161479us
I20260709 12:18:02.758224 23962 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:02.760582 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:02.747362 27500 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:02.755736 27628 raft_consensus.cc:3055] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:02.752605 27319 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:02.783434 27591 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:18:02.778471 27225 consensus_meta.cc:287] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 12:18:02.774252 27628 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:02.777904 27396 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:02.778164 27319 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.799162 27225 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:02.825608 27506 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:02.827040 27594 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:18:02.832413 27567 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:02.836933 27361 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:02.837507 27302 consensus_meta.cc:287] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.000s
I20260709 12:18:02.844987 24596 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
W20260709 12:18:02.797534 27606 log.cc:927] Time spent T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:18:02.784328 27526 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:02.830196 27371 consensus_meta.cc:287] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.000s
I20260709 12:18:02.862882 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2228) took 1163 ms. Trace:
I20260709 12:18:02.803999 27367 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:02.844180 27319 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:02.863499 23918 rpcz_store.cc:276] 0709 12:18:01.699276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.699416 (+   140us) service_pool.cc:224] Handling call
0709 12:18:01.699821 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.700234 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.700274 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.700837 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.921737 (+220900us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:01.921776 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.921851 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.862586 (+940735us) raft_consensus.cc:1685] finished
0709 12:18:02.862614 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.862800 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1650,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"thread_start_us":220482,"threads_started":1,"wal-append.queue_time_us":835515}
W20260709 12:18:02.865538 27473 consensus_meta.cc:287] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.684s	user 0.006s	sys 0.005s
W20260709 12:18:02.874409 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 117710us
I20260709 12:18:02.876860 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:02.881289 24600 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:02.837931 27302 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.887714 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:02.890657 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 106091us
W20260709 12:18:02.891492 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.868753 27367 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:02.869223 27371 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.896347 27367 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:02.895057 27508 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:18:02.886597 27628 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.903617 27628 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.907835 27371 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:02.908109 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 867) took 1271 ms. Trace:
I20260709 12:18:02.910943 23962 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:02.908455 24592 rpcz_store.cc:276] 0709 12:18:01.708475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.711064 (+  2589us) service_pool.cc:224] Handling call
0709 12:18:01.711651 (+   587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.712175 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.712229 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.712941 (+   712us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.898414 (+185473us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:01.898712 (+   298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.899141 (+   429us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:02.907880 (+1008739us) raft_consensus.cc:1685] finished
0709 12:18:02.907908 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:02.908033 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":34316,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":184292,"threads_started":1,"wal-append.queue_time_us":1193343}
I20260709 12:18:02.889883 27473 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.928648 23961 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:02.915293 27618 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:02.915550 27359 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:02.930457 23962 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:02.915352 27633 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 12:18:02.935211 27543 consensus_meta.cc:287] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.990s	user 0.011s	sys 0.004s
W20260709 12:18:02.938802 27629 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:18:02.916663 27506 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:02.942970 27521 consensus_meta.cc:287] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.000s
I20260709 12:18:02.959105 23962 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:02.963892 27361 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:02.970439 27473 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:02.978099 27632 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:02.983225 27302 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:03.008692 27632 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:03.009260 27632 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:03.015096 27643 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:03.017076 27482 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:03.018168 27482 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.019730 27607 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.020238 27607 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.027057 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.027379 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.027763 24062 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:03.028714 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.028986 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.029131 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.003881 27533 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.979656 27473 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:03.030059 24068 raft_consensus.cc:3055] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:03.030498 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.031286 23991 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:03.030475 24068 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:18:03.032033 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 196853us
I20260709 12:18:03.032739 24036 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:02.973666 27521 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:02.985826 27319 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:02.987807 27576 log.cc:927] Time spent T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.447s	user 0.003s	sys 0.000s
I20260709 12:18:03.029326 24063 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:03.030762 27473 raft_consensus.cc:697] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:03.006158 27478 consensus_meta.cc:287] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.002s
I20260709 12:18:03.046855 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:03.047221 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:03.000509 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:03.035298 24069 raft_consensus.cc:2393] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:18:03.022336 27584 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.734s	user 0.003s	sys 0.000s
I20260709 12:18:03.040796 27617 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:03.022393 27607 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.041127 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.043246 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.032768 24068 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.054544 23995 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:03.055063 24068 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:02.946938 27543 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:03.070349 24592 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:03.070839 23996 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:18:03.051846 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 51430.5us
I20260709 12:18:03.073702 24600 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:03.047833 27542 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.976876 27457 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.076284 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:03.076758 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.079330 23918 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:03.079663 23918 pending_rounds.cc:85] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 5
I20260709 12:18:03.079977 23918 pending_rounds.cc:107] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:18:03.080272 23918 raft_consensus.cc:2889] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:03.056720 27490 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:03.041850 27533 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:03.057299 27326 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:03.088529 23918 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:02.944926 27359 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.085462 23912 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:03.052209 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:03.057703 27633 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:18:03.084024 24036 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:03.094795 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.097465 23912 raft_consensus.cc:2393] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:03.051601 27478 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.100278 23918 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:03.100457 24068 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:18:03.100857 24068 pending_rounds.cc:85] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 4
I20260709 12:18:03.101071 24068 pending_rounds.cc:107] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:18:03.101320 24068 raft_consensus.cc:2889] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:03.102034 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 49932.2us
I20260709 12:18:03.104230 24036 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:03.108435 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2276) took 1539 ms. Trace:
I20260709 12:18:03.087611 27490 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.109664 23987 rpcz_store.cc:276] 0709 12:18:01.569001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.570377 (+  1376us) service_pool.cc:224] Handling call
0709 12:18:01.570631 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.570941 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.570967 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:01.571379 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.774898 (+203519us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:01.775045 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.775238 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:03.021550 (+1246312us) spinlock_profiling.cc:243] Waited 3.51 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:03.098029 (+ 76479us) raft_consensus.cc:1685] finished
0709 12:18:03.098051 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.108361 (+ 10310us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":657,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":8087040,"thread_start_us":202704,"threads_started":1,"wal-append.queue_time_us":547551}
I20260709 12:18:03.116153 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.116472 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:03.116842 23918 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.120317 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.114377 27538 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:18:03.118314 27490 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:03.124085 27641 log.cc:927] Time spent T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:18:03.124581 27632 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.125123 27638 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.125550 27638 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.125910 27638 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.108878 27536 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:03.127365 27457 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.129137 27372 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:03.130232 24063 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:03.121253 23912 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.136108 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.098066 27543 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:03.139766 27538 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:03.149039 27605 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:03.148999 27538 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.150414 27521 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.150494 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:03.150818 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:03.151572 27538 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.140630 27610 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:18:03.151779 27609 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:18:03.089301 27607 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:18:03.141467 27367 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.086726 27542 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.154985 27367 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.156057 27542 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.143642 27359 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.157429 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:03.158420 27616 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:03.144793 27319 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.160147 24068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59384
I20260709 12:18:03.138877 27473 consensus_queue.cc:237] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.147012 27632 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.161013 24068 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Received request to transfer leadership
I20260709 12:18:03.162382 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.166724 23920 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:18:03.162451 24596 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:03.167204 24062 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:03.168015 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.168542 24062 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:03.169260 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:03.164366 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.165010 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.170253 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.171571 23912 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:03.171097 24064 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:18:03.170820 24070 raft_consensus.cc:2393] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:03.152597 27543 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.158910 27616 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:03.138172 27372 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:03.190619 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.220278 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.220712 23914 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.098526 27326 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:03.235621 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 50724.3us
I20260709 12:18:03.233035 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:03.238427 23962 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:03.245425 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:03.219712 27359 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:03.227643 27372 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:03.269892 23918 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:03.243402 27459 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:03.250243 27461 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.284055 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:03.285146 27567 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:03.285652 27567 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.286072 27567 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.293534 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:03.296906 27566 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:03.227515 27319 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:18:03.316486 27326 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.276675 27607 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.317585 27607 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.297981 27461 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.319952 27461 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.320299 27607 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.283689 27459 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.297430 27566 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.322765 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:03.276430 27613 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:03.360747 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:03.361145 27604 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.361898 27604 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.365743 27604 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:03.366632 23915 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:03.368649 27371 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:03.369127 27371 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:03.369642 23914 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:03.339289 27543 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.273537 27359 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.342571 27616 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.329981 27459 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:03.345220 27478 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.345896 27566 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.346413 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:03.361443 24066 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.340896 27490 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.375013 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:03.388581 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.403625 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:03.407142 23962 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:03.410305 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:03.419299 24069 raft_consensus.cc:2368] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10.
I20260709 12:18:03.420010 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:03.386257 27493 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.434415 27493 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.436412 27493 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.436925 27493 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:03.437060 27609 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:03.438637 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:03.437665 27609 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.442600 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.443126 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.443434 23916 raft_consensus.cc:2410] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 12 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 12:18:03.443754 23917 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:18:03.437402 27493 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.444216 23918 raft_consensus.cc:1240] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:03.445912 27493 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.431136 23962 leader_election.cc:400] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10.
I20260709 12:18:03.415906 27478 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:18:03.432617 27578 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.892s	user 0.000s	sys 0.001s
I20260709 12:18:03.433450 27359 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.433357 27607 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:03.422878 24067 raft_consensus.cc:2368] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8.
I20260709 12:18:03.446743 27609 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.446894 27638 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:03.457626 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 160685us
I20260709 12:18:03.370235 27371 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:03.446902 27477 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:18:03.448177 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:03.450415 24069 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:03.453100 23962 leader_election.cc:403] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:03.466384 24067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59384
I20260709 12:18:03.452869 27559 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.416292 27319 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:03.467013 24067 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Received request to transfer leadership
I20260709 12:18:03.467115 23962 leader_election.cc:400] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8.
I20260709 12:18:03.478106 23962 leader_election.cc:403] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:18:03.455612 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.468233 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.468428 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.458175 27611 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:03.452685 27567 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.488606 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:03.491364 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.492076 23992 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
W20260709 12:18:03.495576 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.471993 27359 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.496057 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.458292 27478 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.498471 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.477295 27473 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.502846 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.470417 27613 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:18:03.490499 27508 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:03.464263 27607 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.493575 27203 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:03.478681 27225 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:18:03.491684 27493 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:03.489286 27349 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:18:03.501297 27609 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:03.537093 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.504678 27371 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:03.476737 27559 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:03.567651 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.569235 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.569646 23987 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:03.549222 27589 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 1.013s	user 0.000s	sys 0.001s
I20260709 12:18:03.571250 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.505411 27604 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:18:03.579618 23993 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:03.540809 27203 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:03.573740 24063 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:03.549827 27461 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:03.537110 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.574609 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.576095 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.551892 27319 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:03.583509 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:03.497756 27326 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:03.489482 27611 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.590497 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:03.533785 27473 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.608763 23987 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:18:03.610587 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:03.613426 27663 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:18:03.609994 23818 catalog_manager.cc:5697] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 4, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 4 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:03.615763 27613 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.636132 24066 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:03.636798 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.577105 27609 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.642643 23990 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:03.565605 27493 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.643115 27638 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.642666 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.652366 23913 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:03.641309 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.655963 23987 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:03.657989 27203 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.658447 27613 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.659116 27662 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:03.593812 27490 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.664409 23989 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:18:03.670365 23919 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:03.680183 27478 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:03.683156 27459 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.686537 27372 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.690088 23992 raft_consensus.cc:2393] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:18:03.694384 27665 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:18:03.693913 23818 catalog_manager.cc:5697] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 8, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 8 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:03.696219 23818 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:03.698688 27559 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.699237 27628 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.699889 27628 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.701478 27607 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.704739 27628 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.697733 23818 catalog_manager.cc:5697] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:03.697878 27372 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:03.708011 23818 catalog_manager.cc:5697] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 3 to 6, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 6 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:03.709798 23818 catalog_manager.cc:5697] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 6, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 6 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:03.711632 27473 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.706938 27459 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.711107 23818 catalog_manager.cc:5697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 3 to 6, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 6 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:03.713462 27613 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:03.713949 23819 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39282 (request call id 309) took 26411 ms (client timeout 15000 ms). Trace:
I20260709 12:18:03.714485 23818 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 5 to 7, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 7 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:03.724051 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 115494us
I20260709 12:18:03.725183 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:03.727510 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:03.700476 27609 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:03.680068 27611 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:03.731390 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.734448 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 659) took 2113 ms. Trace:
I20260709 12:18:03.650498 27319 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.735966 23919 raft_consensus.cc:2368] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10.
I20260709 12:18:03.734934 24065 rpcz_store.cc:276] 0709 12:18:01.621142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:01.621288 (+   146us) service_pool.cc:224] Handling call
0709 12:18:01.621637 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:01.622397 (+   760us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:01.622429 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:01.645631 (+ 23202us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b2c000dbec8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:18:01.659262 (+ 13631us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b2c000dbec8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:18:01.659771 (+   509us) log.cc:844] Serialized 52 byte log entry
0709 12:18:01.795560 (+135789us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:02.301793 (+506233us) log.cc:844] Serialized 14 byte log entry
0709 12:18:02.714532 (+412739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:02.714627 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:03.548533 (+833906us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:03.734163 (+185630us) raft_consensus.cc:1685] finished
0709 12:18:03.734183 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.734389 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28361,"prepare.queue_time_us":477739,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":128,"raft.queue_time_us":312352,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":188,"spinlock_wait_cycles":102747520,"thread_start_us":1015110,"threads_started":3,"wal-append.queue_time_us":556800}
I20260709 12:18:03.742240 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.743534 23919 raft_consensus.cc:2368] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8.
I20260709 12:18:03.744125 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.744567 23919 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:03.731355 27490 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.741015 27613 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:03.752753 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:03.737377 27567 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:03.752663 27666 log.cc:927] Time spent T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 12:18:03.755141 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:03.752174 27674 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.756596 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.752743 27669 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.756881 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.759353 23919 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:03.750937 27490 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:03.760084 23921 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:03.763592 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:03.760052 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:03.755359 27616 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:03.717199 23819 rpcz_store.cc:269] 0709 12:17:37.302920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.303250 (+   330us) service_pool.cc:224] Handling call
0709 12:18:03.713856 (+26410606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:58.601275 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:58.602000 (+   725us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:58.602056 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:17:58.602090 (+    34us) tablet.cc:662] Decoding operations
0709 12:17:58.770436 (+168346us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:58.770512 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:58.770536 (+    24us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:17:58.935871 (+165335us) tablet.cc:701] Row locks acquired
0709 12:17:58.935918 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:17:58.936123 (+   205us) write_op.cc:270] Start()
0709 12:17:58.936289 (+   166us) write_op.cc:276] Timestamp: P: 1783599478936058 usec, L: 0
0709 12:17:58.936322 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:17:58.998254 (+ 61932us) log.cc:844] Serialized 8436 byte log entry
0709 12:17:59.447227 (+448973us) op_driver.cc:464] REPLICATION: finished
0709 12:17:59.735618 (+288391us) write_op.cc:301] APPLY: starting
0709 12:17:59.735727 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:59.778492 (+ 42765us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:59.778624 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:59.964695 (+186071us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b54002e4354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c4f32a 00007f75c0bd4f14 00007f75c0bd4ec3 00007f75c0bd4e38 00007f75c0bd4df3 00007f75c0bd40dc 00007f75c0bfde16 00007f75c0be5cbb 00007f75c0bd039d 00007f75c0bd3d75
0709 12:18:00.045971 (+ 81276us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:00.046472 (+   501us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:18:00.046545 (+    73us) write_op.cc:312] APPLY: finished
0709 12:18:00.047210 (+   665us) log.cc:844] Serialized 145 byte log entry
0709 12:18:00.047466 (+   256us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:00.047717 (+   251us) write_op.cc:454] Released schema lock
0709 12:18:00.047815 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:00.048260 (+   445us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:00.048288 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":755849,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":267181,"apply.run_cpu_time_us":10641,"apply.run_wall_time_us":312631,"num_ops":21,"prepare.queue_time_us":175364,"prepare.run_cpu_time_us":21880,"prepare.run_wall_time_us":503277,"raft.queue_time_us":126215,"raft.run_cpu_time_us":21048,"raft.run_wall_time_us":556954,"replication_time_us":487537,"spinlock_wait_cycles":5985792,"thread_start_us":399756,"threads_started":4,"wal-append.queue_time_us":183796,"wal-append.run_cpu_time_us":36359,"wal-append.run_wall_time_us":1904047}]]}
I20260709 12:18:03.772951 23913 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:03.773887 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.776569 23960 leader_election.cc:400] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10.
I20260709 12:18:03.777777 23960 leader_election.cc:400] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8.
I20260709 12:18:03.769294 27675 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.779271 27493 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.779167 27675 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.781605 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:03.761790 27674 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.765311 27669 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:03.771591 27474 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:03.781927 27675 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.785079 27674 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.764636 27567 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:03.786746 27668 log.cc:927] Time spent T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:18:03.766203 27490 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.795408 23921 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:03.798395 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.803064 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:03.807077 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.807888 23921 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:18:03.786247 27461 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.785405 27669 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.821857 27508 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8.
I20260709 12:18:03.832585 27482 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:03.829833 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 333085us
I20260709 12:18:03.840273 27319 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.815778 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 742) took 1615 ms. Trace:
I20260709 12:18:03.842108 24595 rpcz_store.cc:276] 0709 12:18:02.200522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.200764 (+   242us) service_pool.cc:224] Handling call
0709 12:18:02.201070 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:02.385680 (+184610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.385714 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:02.385760 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:02.385817 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.815401 (+1429584us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400585554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:03.815474 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:03.815698 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":424056704}
I20260709 12:18:03.844553 27359 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10.
I20260709 12:18:03.825201 27470 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.791085 27632 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:18:03.827293 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.804034 27493 raft_consensus.cc:2764] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:18:03.846920 23919 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:03.913136 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.847982 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.848451 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:03.850548 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.915021 23987 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
W20260709 12:18:03.852442 27647 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.499s	user 0.003s	sys 0.000s
W20260709 12:18:03.859390 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.864960 23960 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:03.922562 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 83038.5us
W20260709 12:18:03.921393 27538 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.008s	sys 0.017s
W20260709 12:18:03.923537 27538 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.008s	sys 0.017s
I20260709 12:18:03.923748 27410 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:03.924306 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:03.865676 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 97374.2us
I20260709 12:18:03.924952 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.925679 24066 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:03.926753 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.885226 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.904785 23993 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:03.907552 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:03.929092 23990 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:03.914440 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:03.919211 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:03.930495 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 65623us
I20260709 12:18:03.920056 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.931845 24063 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:03.924350 27410 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.934332 23919 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:03.931308 23960 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:03.936305 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.937373 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.937892 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:03.938459 24065 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:03.941027 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.941376 23919 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: [6.8-8.10]
I20260709 12:18:03.944985 23991 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:03.946810 24063 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:03.937444 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:03.952389 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:03.955349 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:03.956202 27571 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:03.956599 27571 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.957086 27571 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:03.957706 27566 consensus_meta.cc:287] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 12:18:03.958145 27566 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:03.960084 27656 log.cc:927] Time spent T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.557s	user 0.000s	sys 0.002s
I20260709 12:18:03.960287 27566 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:03.961030 23917 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:03.963639 27203 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:03.964876 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:03.934451 27619 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:18:03.967706 27681 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:03.968804 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:03.969799 27680 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.970316 27680 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.970698 27680 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.954663 27326 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:18:03.976748 27326 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:03.977121 27326 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:03.978900 27410 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:03.956488 27302 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260709 12:18:03.980495 27660 log.cc:927] Time spent T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.438s	user 0.001s	sys 0.000s
I20260709 12:18:03.983322 27571 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:03.984460 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:03.984555 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:03.937552 27359 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:03.941304 27319 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:03.996635 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:04.000310 27681 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.001001 24065 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:03.988476 27632 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:04.008754 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:04.022485 23992 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.004784 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:04.025344 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:03.997596 27487 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:03.977955 27326 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.003217 27633 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.013440 27526 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:04.034188 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:04.035046 24064 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:03.993737 27640 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:03.999607 27359 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:04.003758 27319 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:04.047389 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 1971) took 1758 ms. Trace:
I20260709 12:18:04.030602 27470 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:04.031665 27454 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:18:04.041477 23915 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:04.051875 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.053666 23988 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:18:04.047775 24061 rpcz_store.cc:276] 0709 12:18:02.289247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.289591 (+   344us) service_pool.cc:224] Handling call
0709 12:18:02.290059 (+   468us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:02.361019 (+ 70960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:02.361084 (+    65us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:03.158142 (+797058us) spinlock_profiling.cc:243] Waited 7.09 ms on lock 0x7b2c000dbec8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:18:03.158726 (+   584us) log.cc:844] Serialized 52 byte log entry
0709 12:18:03.252848 (+ 94122us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:03.282203 (+ 29355us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.351556 (+ 69353us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.351785 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.351853 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:03.959548 (+607695us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:04.047203 (+ 87655us) raft_consensus.cc:1685] finished
0709 12:18:04.047225 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:04.047339 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86914,"prepare.queue_time_us":138924,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":84,"raft.queue_time_us":182751,"raft.run_cpu_time_us":466,"raft.run_wall_time_us":70631,"spinlock_wait_cycles":21450880,"thread_start_us":153234,"threads_started":2,"wal-append.queue_time_us":244000}
I20260709 12:18:04.056646 23988 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:04.035669 27526 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:04.045369 27490 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.063143 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.052671 27326 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:04.067507 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.029213 27632 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:04.036392 27225 consensus_queue.cc:1175] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0829ddf18f07439086398756b9c6d216" responder_term: 9 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: [6.8-8.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:04.068341 23987 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:04.036216 27633 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.059240 27470 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:04.075766 23913 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.046705 27640 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.086690 23913 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:04.088987 27640 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:04.111207 23992 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:04.093488 27633 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.098658 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.099211 23988 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:04.091692 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.102567 27632 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:04.093983 27571 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.105515 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.091044 27359 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.082664 27319 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:04.108556 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 556093us
I20260709 12:18:04.089855 27526 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.120153 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:04.115782 27371 consensus_meta.cc:287] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 12:18:04.122246 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:04.129041 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:04.133118 24070 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:04.124253 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:04.134580 27682 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.223s	user 0.000s	sys 0.004s
I20260709 12:18:04.134935 23992 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:04.115895 27477 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:04.126228 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 134819us
I20260709 12:18:04.124205 27680 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.140376 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:04.207211 24062 raft_consensus.cc:2393] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 6: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:04.140612 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:04.142168 24070 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:04.118530 27659 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:04.149806 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:04.127351 27610 raft_consensus.cc:993] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
W20260709 12:18:04.208489 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 67943.3us
I20260709 12:18:04.214366 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:04.215607 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:04.215986 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:04.216199 24068 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:04.216565 24063 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:04.216887 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:04.217847 24067 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.219909 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:04.181629 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 59442us
I20260709 12:18:04.211755 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:04.220961 23992 raft_consensus.cc:2368] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7.
I20260709 12:18:04.126663 27490 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.136873 27526 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.130623 27559 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:04.223435 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:04.225090 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:04.225811 24566 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:04.228613 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 78934.4us
I20260709 12:18:04.225835 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:04.226786 27690 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.232172 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:04.223049 27470 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.234294 27610 raft_consensus.cc:1081] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:04.219682 27489 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.213171 27477 raft_consensus.cc:697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:04.238459 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:04.222684 27302 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:04.227360 27674 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:04.240541 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:04.242054 23887 leader_election.cc:400] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7.
I20260709 12:18:04.242713 24062 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:04.242405 23887 leader_election.cc:403] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:18:04.246613 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:04.247748 23914 raft_consensus.cc:2368] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7.
I20260709 12:18:04.240527 27659 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:04.249192 27659 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.236229 27371 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:04.252197 27536 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:04.236423 27390 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:04.239274 27688 log.cc:927] Time spent T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:18:04.253682 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:04.251411 24036 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:04.271740 24067 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:04.227483 27662 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:18:04.255270 27625 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:04.255403 27371 raft_consensus.cc:697] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:04.255615 27639 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:04.255782 24597 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:04.244904 27490 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:04.233024 27627 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:04.259889 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:04.237361 27372 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:04.253832 27410 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:04.294750 27410 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.295325 27410 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:04.244793 27674 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.257560 27489 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7.
I20260709 12:18:04.254192 24068 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:04.279287 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:04.280803 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:04.282612 27640 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:18:04.283684 27625 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.284904 27631 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:04.250686 27302 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.290939 27617 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:04.296905 27639 raft_consensus.cc:697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:04.299079 27674 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:04.379143 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 98459.4us
I20260709 12:18:04.303123 27610 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:04.383159 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 82402.1us
I20260709 12:18:04.383279 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.383826 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:04.301376 27633 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.389827 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.343820 27625 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.390686 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.342587 27631 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:04.299540 27372 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.342430 27691 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:04.404716 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:04.387662 27687 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:18:04.305718 27611 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:18:04.306849 27613 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 12:18:04.413448 23920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:18:04.416394 23920 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:04.416563 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:04.415024 27680 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.416842 23920 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.412899 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:04.458570 23990 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.299132 27627 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.410792 27609 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:04.465587 23806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 85557.8us
I20260709 12:18:04.419093 27302 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:04.392060 27371 consensus_queue.cc:237] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.477576 24066 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:04.422468 27639 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.427316 23917 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:18:04.428807 24061 raft_consensus.cc:2410] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:04.430294 27372 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:04.431121 27566 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:04.432991 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:04.491657 23987 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:04.434576 27653 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 1.081s	user 0.008s	sys 0.003s
I20260709 12:18:04.434373 27611 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:04.497026 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 751) took 1369 ms. Trace:
I20260709 12:18:04.497476 24594 rpcz_store.cc:276] 0709 12:18:03.127428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.127989 (+   561us) service_pool.cc:224] Handling call
0709 12:18:03.128341 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:03.128711 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:03.128739 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:03.129188 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 12:18:03.263019 (+133831us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:03.263072 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:03.263171 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:04.415532 (+1152361us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:04.496614 (+ 81082us) raft_consensus.cc:1685] finished
0709 12:18:04.496644 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:04.496949 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3803,"raft.queue_time_us":7817,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":22411,"spinlock_wait_cycles":21144320,"thread_start_us":133537,"threads_started":1,"wal-append.queue_time_us":223585}
I20260709 12:18:04.439260 27536 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:04.426010 27690 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:04.441917 27674 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.499594 27536 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:04.408682 27631 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:04.501386 24064 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:04.500896 27536 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.448149 23918 raft_consensus.cc:2376] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11. Re-sending same reply.
I20260709 12:18:04.452121 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.464847 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.503310 23913 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:04.473305 27627 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:04.473788 27609 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:04.483032 23990 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:04.507632 27609 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.508832 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:04.510083 27680 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:04.510735 27680 raft_consensus.cc:697] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:04.511812 27680 consensus_queue.cc:237] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:04.515192 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.518057 27631 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.519994 27536 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:04.485551 23920 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.446583 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:04.502614 23916 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:18:04.521934 27225 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:04.522372 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 75871.6us
I20260709 12:18:04.522575 27225 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.524613 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:04.525638 27505 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:04.526117 27225 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:04.488458 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 98162.8us
I20260709 12:18:04.526777 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.527112 27505 consensus_queue.cc:1059] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:04.527505 27627 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:04.528245 27505 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.528541 27627 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:04.528831 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:04.528831 27505 raft_consensus.cc:3055] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:04.529579 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:04.530809 27505 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:04.531430 27371 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:04.530260 23960 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:04.530920 24566 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:04.530464 23987 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:04.343238 27477 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.535254 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:04.537153 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.542557 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.538246 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.539278 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:04.528961 27627 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:04.541177 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.532804 27367 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:04.552928 27521 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:04.553198 23993 raft_consensus.cc:2368] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:04.487332 27632 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:04.553473 27505 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.554411 27390 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:04.554204 27632 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.554714 27505 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.554926 27390 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.555620 27627 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.556393 27632 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:04.557117 27390 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.404155 27633 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.558087 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.532426 27225 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:04.552100 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.558885 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:04.491168 27566 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:04.567081 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:04.567632 23990 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:04.568169 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.543282 23992 raft_consensus.cc:2368] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9.
I20260709 12:18:04.545253 23962 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:04.573479 24062 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:59384
I20260709 12:18:04.574021 23917 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:04.412900 27691 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.574059 24062 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Received request to transfer leadership
I20260709 12:18:04.553345 27367 raft_consensus.cc:697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:04.563542 27627 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.576701 23962 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:04.577167 23990 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:04.578198 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.579223 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.577989 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.564090 27371 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.581255 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:04.581208 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:04.586017 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.587704 27521 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:04.588124 27521 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.588467 23995 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: [9.5-11.6]
I20260709 12:18:04.591871 27367 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:04.594023 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.573010 27319 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:04.598001 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:04.604267 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.605777 24036 leader_election.cc:400] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:04.586972 27493 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:04.588476 27521 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:04.606353 24036 leader_election.cc:403] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:04.614890 24036 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:04.616871 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.618017 23917 raft_consensus.cc:2410] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:04.605433 27659 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:04.606204 27319 raft_consensus.cc:697] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:04.600980 27410 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.595887 27371 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.627038 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:04.626502 27449 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:04.627460 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:04.637830 23917 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:18:04.620832 27536 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
W20260709 12:18:04.623481 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 46863.4us
I20260709 12:18:04.619589 27631 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:04.646803 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:04.616350 27493 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:04.628005 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:04.651670 24070 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:18:04.601584 27566 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.650863 27449 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.667392 27566 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:04.624300 27702 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:04.669821 27613 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:04.681473 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:04.679376 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:04.687983 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:04.688592 24596 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
W20260709 12:18:04.691039 27704 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:18:04.673651 27493 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.695505 27410 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:04.703053 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:04.705575 27691 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.675559 27625 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.711192 24600 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
W20260709 12:18:04.715262 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 87324.9us
I20260709 12:18:04.716629 24036 leader_election.cc:400] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9.
I20260709 12:18:04.717060 24036 leader_election.cc:403] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:04.704618 27633 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.679683 27613 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.732195 24068 raft_consensus.cc:2393] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:04.724694 27410 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:04.723690 27372 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9.
I20260709 12:18:04.744156 24591 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:04.753408 23991 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:04.704169 27319 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:04.740893 27703 log.cc:927] Time spent T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:18:04.760632 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.733698 27702 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:04.749029 27679 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:04.778688 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 126739us
W20260709 12:18:04.780511 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 129336us
I20260709 12:18:04.781661 23962 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:04.784271 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:04.784719 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.788946 27659 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:04.789505 27659 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.792263 23961 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:04.777055 27609 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:04.801820 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:04.802127 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:04.793162 27713 log.cc:927] Time spent T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:18:04.791178 27371 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:04.803368 27659 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:04.803687 27607 consensus_queue.cc:1059] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:04.804584 27607 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:04.804934 27607 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:04.805691 27607 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.807412 27607 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:04.818624 27710 log.cc:927] Time spent T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:18:04.819496 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:04.820099 27715 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:04.820554 24597 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:04.821707 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.824952 23991 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:04.825956 27203 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:04.826889 27613 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.826638 27203 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.828191 27625 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:04.829171 27203 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:04.830009 27477 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:04.833362 27521 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.834440 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:04.783051 27679 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.787734 27633 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:04.837384 23991 raft_consensus.cc:2393] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:04.838973 23917 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:04.793493 27508 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.838986 27203 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:04.843416 27615 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:04.843684 27203 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.845304 23961 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:04.850438 27521 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.835192 27609 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.855835 27691 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:04.861850 27679 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:04.861703 27691 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.842123 27508 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:04.857542 27633 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:04.863782 27633 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:04.864274 27633 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.864544 27508 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.855271 27553 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:04.866515 27609 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:04.866689 27553 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:04.878671 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:04.880546 27597 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:04.880712 27203 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:04.883069 23918 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2376) took 1424 ms (client timeout 1636 ms). Trace:
W20260709 12:18:04.883514 23918 rpcz_store.cc:269] 0709 12:18:03.458554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.984193 (+525639us) service_pool.cc:224] Handling call
0709 12:18:04.882895 (+898702us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b54002eca54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:04.883006 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1065023360}
I20260709 12:18:04.892321 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.893635 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.895404 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.896082 23918 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:04.896727 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.904466 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:04.905284 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 109752us
I20260709 12:18:04.908257 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:04.908821 23921 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:04.913594 27553 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:04.913822 27449 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:04.905097 24599 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:04.900094 27691 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:04.918087 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:04.920423 23918 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:18:04.924594 27631 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:04.925117 27631 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:04.991124 23921 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:04.992436 24034 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:04.994138 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 48894.8us
I20260709 12:18:04.996112 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:04.998334 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:05.002910 24034 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:05.003880 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 81942.7us
I20260709 12:18:04.927525 27633 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.015076 27633 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:05.020184 27694 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.812s	user 0.006s	sys 0.000s
W20260709 12:18:05.027020 27727 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:18:04.926267 27631 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.035682 27631 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:04.998483 27619 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:05.045785 27619 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:05.059262 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:05.069661 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 63747.3us
I20260709 12:18:05.060106 24069 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
W20260709 12:18:05.071139 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 68309.3us
I20260709 12:18:05.071410 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:05.072217 24034 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:05.073558 24065 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:18:05.073930 24065 pending_rounds.cc:85] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 8
I20260709 12:18:05.074216 24065 pending_rounds.cc:107] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:18:05.074308 27610 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:05.074604 24065 raft_consensus.cc:2889] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:05.070420 23960 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:05.075294 27611 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.075788 27611 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:05.080489 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.080693 23886 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:05.080866 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:05.083063 27567 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:05.083484 27567 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:05.083864 27567 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:05.084467 27709 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.477s	user 0.001s	sys 0.000s
I20260709 12:18:05.085733 27610 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:05.087536 27610 consensus_queue.cc:1059] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:05.046204 27619 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.088646 27597 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:05.089012 27597 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:05.089790 27597 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:05.091253 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.092197 23962 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:05.080920 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.093302 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.094496 23960 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:05.072881 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:05.095306 24069 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:05.098112 23988 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:18:05.098507 23988 pending_rounds.cc:85] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 4
I20260709 12:18:05.098783 23988 pending_rounds.cc:107] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:18:05.099071 23988 raft_consensus.cc:2889] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:05.112145 23988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:05.112907 23988 raft_consensus.cc:606] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:05.113330 23988 raft_consensus.cc:614] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:05.103914 27716 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:05.102331 27615 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:05.104475 27729 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:05.126098 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 280854us
I20260709 12:18:05.127878 23912 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:05.104946 27609 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:18:05.134873 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:05.122675 27729 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.141371 23961 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:05.128744 27716 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:05.147809 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:05.150419 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:05.151114 24597 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:05.141619 27526 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:05.142052 27729 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:05.156636 24035 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:05.146138 27627 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:05.168188 24035 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:05.169180 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:05.173828 27716 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.149494 27702 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:05.181993 23912 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:05.159987 27615 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:05.170773 27477 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:05.152621 27638 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:18:05.186568 27679 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:05.180876 27627 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.200652 27615 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:05.203274 27625 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:05.204602 27679 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.187820 27702 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:05.233297 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 65192.7us
I20260709 12:18:05.235189 24035 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:05.236778 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:05.237424 23988 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.237850 23996 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:05.239423 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:05.226356 27679 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:05.243531 23994 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:05.273973 23994 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:18:05.285256 27613 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:05.237134 27526 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:05.289263 24069 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:05.280745 27742 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:05.298416 23988 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:05.301057 24069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:05.301887 24069 raft_consensus.cc:606] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:05.298801 27526 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.309433 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:05.316308 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:05.316929 24070 raft_consensus.cc:2368] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14.
W20260709 12:18:05.313009 27739 log.cc:927] Time spent T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:18:05.312556 27526 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:05.325115 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:05.330686 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:05.341336 24070 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:05.333105 27567 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.332410 27729 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.344336 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:05.342864 27702 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:05.344966 23994 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:05.296686 27615 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.342265 24068 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:05.346652 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:05.353824 24062 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
W20260709 12:18:05.353948 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73310.3us
I20260709 12:18:05.354298 24062 pending_rounds.cc:85] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 5
I20260709 12:18:05.354475 24069 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:05.355057 27702 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:05.355491 27702 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:05.355890 27702 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.354661 24062 pending_rounds.cc:107] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:18:05.366842 24062 raft_consensus.cc:2889] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:05.370473 23920 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:05.350229 27619 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.381462 27487 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:05.382954 27487 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.385942 27487 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:05.400851 24067 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:18:05.401413 24067 pending_rounds.cc:85] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 6
I20260709 12:18:05.401710 24067 pending_rounds.cc:107] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:18:05.401976 24067 raft_consensus.cc:2889] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:05.407433 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2001) took 1183 ms. Trace:
I20260709 12:18:05.410369 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:05.412072 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 2161) took 1283 ms. Trace:
I20260709 12:18:05.412395 24065 rpcz_store.cc:276] 0709 12:18:04.128287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.129106 (+   819us) service_pool.cc:224] Handling call
0709 12:18:04.129382 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.075135 (+945753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.411887 (+336752us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b54001b76d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:05.411995 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170603776}
I20260709 12:18:05.407770 24066 rpcz_store.cc:276] 0709 12:18:04.224663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.224806 (+   143us) service_pool.cc:224] Handling call
0709 12:18:05.407289 (+1182483us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540010f254. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:05.407389 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565086080}
W20260709 12:18:05.418895 23914 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2375) took 1956 ms (client timeout 2245 ms). Trace:
I20260709 12:18:05.419875 23961 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:05.371670 27543 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 12:18:05.419312 23914 rpcz_store.cc:269] 0709 12:18:03.454129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.105272 (+651143us) service_pool.cc:224] Handling call
0709 12:18:05.410549 (+1305277us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400321254. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:05.410653 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":301985664}
I20260709 12:18:05.372062 27470 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 12:18:05.423439 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 57685.5us
I20260709 12:18:05.424958 23887 leader_election.cc:400] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14.
I20260709 12:18:05.425267 23887 leader_election.cc:403] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:05.404883 27725 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:05.429098 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:05.440330 24066 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:05.428474 27319 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:05.447685 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:05.447876 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:05.448379 23987 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:05.436681 27725 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.451411 27729 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:05.417047 27711 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:18:05.452423 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:05.454349 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:05.454905 24065 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:05.455368 27679 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.451603 27725 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:05.429347 27493 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14.
I20260709 12:18:05.463614 24069 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:05.445688 27750 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:05.471777 27611 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:05.473001 27619 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:05.467613 27607 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:05.473747 27607 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:05.467746 27597 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.476740 24065 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:18:05.474151 27607 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.493489 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:05.496064 23993 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:05.496991 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:05.444725 27567 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:05.497156 23962 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:05.515823 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:05.526746 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:05.506011 27711 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:18:05.533746 27741 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:05.527840 27449 consensus_queue.cc:1059] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:18:05.539482 27741 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.445598 27638 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 12:18:05.543565 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:05.521212 27691 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:05.520826 27624 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.546546 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:05.541517 27615 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:05.553105 23988 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:05.554157 27741 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:05.554924 27624 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.559352 27624 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:05.542512 27679 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:05.566308 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:05.575105 27702 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.568033 27615 raft_consensus.cc:697] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:05.589308 27679 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:05.590363 27679 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.593133 27679 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:05.578759 27597 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:05.597369 27597 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.608253 27597 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:05.612434 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2003) took 1378 ms. Trace:
I20260709 12:18:05.612998 24061 rpcz_store.cc:276] 0709 12:18:04.240158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.240295 (+   137us) service_pool.cc:224] Handling call
0709 12:18:05.612148 (+1371853us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5400213ed4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:05.612353 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":430117760}
I20260709 12:18:05.620980 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:05.588806 27615 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.626566 27607 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:05.630671 27702 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:05.631739 27607 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:05.635310 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:05.600474 24566 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:05.642585 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:05.643716 27731 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:05.633603 27613 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.645479 27613 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:05.645939 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:05.647250 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:05.647575 27613 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:05.647921 24066 raft_consensus.cc:2368] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:05.648339 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:05.648010 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:05.649510 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:05.649714 27613 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:05.650076 27613 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:05.650446 27613 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:05.653539 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:05.654572 24061 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:05.656177 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:05.656445 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:05.656756 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:05.657322 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:05.657837 24599 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.659962 24068 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:05.660568 23921 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:05.660880 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:05.660004 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:05.658495 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:05.662385 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:05.658547 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:05.664148 23919 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:05.665357 24064 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:05.672806 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:05.672465 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:05.793577 24061 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:05.845882 24070 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:05.847415 23987 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:05.666745 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 66377.5us
I20260709 12:18:05.670925 24069 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:05.681677 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:05.768188 23961 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:05.848923 23915 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
W20260709 12:18:05.850740 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 82675.9us
I20260709 12:18:05.851233 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:05.848759 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:05.691478 27624 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:05.855536 24566 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:05.856127 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:05.858726 27609 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:05.856600 27726 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:05.860608 27627 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:05.863260 23987 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:05.865334 23991 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:18:05.857371 27607 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:05.866710 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:05.771479 27567 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:05.867120 27745 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:05.855594 27372 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:18:05.868964 27627 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:05.785610 27761 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:18:05.880975 23996 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:05.882894 23988 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:05.900211 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.001717 23987 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
W20260709 12:18:05.932948 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 58826.4us
I20260709 12:18:05.702652 27597 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.766026 27674 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:05.873132 27624 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:06.026650 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:06.027184 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:06.030681 23913 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:05.923756 27626 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:06.032179 27750 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.044939 27626 raft_consensus.cc:3055] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:06.045400 27626 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:06.045286 27750 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.046463 27626 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.047505 27626 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:06.049963 23818 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43626 (request call id 196) took 17535 ms (client timeout 15000 ms). Trace:
I20260709 12:18:05.926460 27680 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:06.057994 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:06.059499 23913 raft_consensus.cc:2368] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:18:06.060606 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:06.061357 23913 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:06.050397 23818 rpcz_store.cc:269] 0709 12:17:48.515217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.515432 (+   215us) service_pool.cc:224] Handling call
0709 12:17:48.697418 (+181986us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b5400180510. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2e0b2 00007f75c6aa7759 00007f75c6a3fa76 00007f75c6a10d58 00007f75c6b0f04e 00007f75c4fd02a4 00007f75c4fd0232 00007f75c4fd0161 00007f75c4fd00dc
0709 12:18:06.049890 (+17352472us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:03.953313 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:04.062756 (+109443us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:04.063854 (+  1098us) write_op.cc:435] Acquired schema lock
0709 12:18:04.065725 (+  1871us) tablet.cc:662] Decoding operations
0709 12:18:04.103677 (+ 37952us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:04.103758 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:04.103787 (+    29us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:18:04.105116 (+  1329us) tablet.cc:701] Row locks acquired
0709 12:18:04.105136 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:18:04.105285 (+   149us) write_op.cc:270] Start()
0709 12:18:04.105398 (+   113us) write_op.cc:276] Timestamp: P: 1783599484105236 usec, L: 0
0709 12:18:04.105416 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:18:04.106074 (+   658us) log.cc:844] Serialized 7439 byte log entry
0709 12:18:04.450673 (+344599us) op_driver.cc:464] REPLICATION: finished
0709 12:18:04.677732 (+227059us) write_op.cc:301] APPLY: starting
0709 12:18:04.679831 (+  2099us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:04.701846 (+ 22015us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:04.728655 (+ 26809us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:04.804470 (+ 75815us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:04.804751 (+   281us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 12:18:04.804797 (+    46us) write_op.cc:312] APPLY: finished
0709 12:18:04.805143 (+   346us) log.cc:844] Serialized 132 byte log entry
0709 12:18:04.805320 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:04.805481 (+   161us) write_op.cc:454] Released schema lock
0709 12:18:04.805532 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:04.805904 (+   372us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:04.805931 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":214,"mutex_wait_us":2501489,"reported_tablets":33,"spinlock_wait_cycles":11024768,"child_traces":[["op",{"apply.queue_time_us":189889,"apply.run_cpu_time_us":5404,"apply.run_wall_time_us":143461,"num_ops":19,"prepare.queue_time_us":75086,"prepare.run_cpu_time_us":66521,"prepare.run_wall_time_us":312231,"raft.queue_time_us":200581,"raft.run_cpu_time_us":42016,"raft.run_wall_time_us":133549,"replication_time_us":345118,"thread_start_us":447002,"threads_started":4,"wal-append.queue_time_us":137654,"wal-append.run_cpu_time_us":43936,"wal-append.run_wall_time_us":1563104}]]}
I20260709 12:18:06.058530 27750 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:06.065995 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:06.067791 23915 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:05.923758 27567 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.071820 24599 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:06.024606 27203 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:18:06.034663 27597 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.082559 23913 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:18:06.062638 27680 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.080905 27750 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:06.109736 23915 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:06.110837 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:06.115597 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:06.116582 23919 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:06.126585 23919 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:06.102329 27449 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:06.136134 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:06.156441 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:06.157280 23920 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:06.159271 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:06.101691 27750 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.163511 23921 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:06.172132 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:06.172866 24591 raft_consensus.cc:2368] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:06.127219 27613 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.164412 27487 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:06.187466 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:06.137897 27449 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.234203 27553 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.246941 23916 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:06.236438 23918 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:18:06.235797 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:06.184923 27203 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:06.175391 27745 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:18:06.258571 24069 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:06.259918 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:06.261920 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:06.264632 24591 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:06.227033 27567 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:06.268224 27702 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:06.255686 27566 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:06.276053 27627 consensus_queue.cc:1059] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:06.277336 27764 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:18:06.225901 27487 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.256630 27553 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.266883 27597 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:06.269119 27607 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:18:06.267010 27203 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:06.301539 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 144166us
I20260709 12:18:06.302858 23960 leader_election.cc:400] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7.
I20260709 12:18:06.303505 23960 leader_election.cc:403] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:06.320914 23912 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:06.283744 27566 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.311138 27711 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7.
I20260709 12:18:06.330331 23917 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:18:06.345907 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.347517 27494 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:06.348064 27494 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.353117 27679 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.353434 27553 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:06.354038 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.353888 27679 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.356838 27679 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:06.357596 27609 raft_consensus.cc:3055] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:06.358007 27609 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:06.360107 27487 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:06.360919 27613 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:06.361665 27449 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:06.366636 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.370743 27750 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:06.374109 24591 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.375056 27624 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.377420 27566 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:06.350229 27494 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:06.358788 27609 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.388121 24599 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:06.391479 27203 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:06.395766 27702 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:06.396848 27702 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:06.401298 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 136598us
I20260709 12:18:06.405943 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:06.403142 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:06.409540 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.423781 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.425489 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:06.425143 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.404062 27731 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.449247 24070 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:06.423658 27505 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:06.462966 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:06.424238 27750 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:18:06.472111 23886 leader_election.cc:400] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:06.472546 23886 leader_election.cc:403] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:06.473142 23887 leader_election.cc:400] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:06.442067 27567 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:06.479314 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:06.434975 27487 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:18:06.440562 27679 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:18:06.482815 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:06.487712 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.465998 27725 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:18:06.490906 24070 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:18:06.460917 27553 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 12:18:06.501096 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.524315 24035 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:06.526868 27607 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.526113 24035 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:06.441417 27731 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.532711 27731 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:06.479038 27473 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:18:06.483144 27567 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.536211 27567 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:06.536870 27680 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:06.488336 27712 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 12:18:06.538894 27769 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:18:06.539034 27609 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.520915 27771 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.540470 27615 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:06.541014 27771 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.500697 27770 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:06.543143 27771 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:06.546663 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:06.547322 24599 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:06.550935 23987 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:06.554970 23961 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:06.560839 23996 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:06.563469 24070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:06.564038 24070 raft_consensus.cc:606] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:06.564356 24070 raft_consensus.cc:614] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:06.567296 24566 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:06.569284 24599 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:18:06.569777 24599 pending_rounds.cc:85] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 9
I20260709 12:18:06.570089 24599 pending_rounds.cc:107] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:18:06.570400 24599 raft_consensus.cc:2889] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:06.574944 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:06.575600 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:06.575899 24599 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 6.
I20260709 12:18:06.558266 27553 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:06.560916 27372 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:06.577992 27638 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:06.585530 27454 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.583634 27559 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:06.577039 27449 consensus_queue.cc:1059] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:18:06.611126 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 171182us
I20260709 12:18:06.611534 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:06.612098 23919 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
W20260709 12:18:06.609249 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 107420us
I20260709 12:18:06.614027 23886 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:06.615145 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:06.615866 27680 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:06.616665 27680 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:06.616534 23886 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:06.617116 27680 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.617561 27680 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.617985 27566 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:06.618499 27566 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:06.619485 27566 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.625761 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.628831 24564 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:06.629081 27680 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.629724 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:06.602994 27638 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.634879 24069 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:18:06.602768 27372 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:06.643282 24069 pending_rounds.cc:85] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 6
I20260709 12:18:06.645201 24069 pending_rounds.cc:107] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:18:06.645561 24069 raft_consensus.cc:2889] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:06.645634 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:06.646512 24599 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.643296 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.668304 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.666404 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:06.670514 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 57154.7us
I20260709 12:18:06.672816 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.673719 23996 raft_consensus.cc:2410] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 12:18:06.678386 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 97933.5us
I20260709 12:18:06.678876 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.682263 24599 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:06.683872 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:06.594637 27553 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.687952 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.684700 27567 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:06.691421 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.644860 27638 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.641426 27680 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:06.695784 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:06.696131 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 68771us
I20260709 12:18:06.697134 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.697558 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:06.674371 27454 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:06.694497 27679 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:06.699811 24034 leader_election.cc:400] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:18:06.698127 27674 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:06.708416 27674 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:06.690984 27487 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:06.709312 27674 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.711334 27449 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:18:06.712944 27775 log.cc:927] Time spent T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:18:06.707267 27679 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:06.716948 27679 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:06.718680 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:06.718828 27553 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:06.709756 27487 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.723469 27487 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:06.701750 24034 leader_election.cc:403] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:18:06.730191 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:06.731323 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:06.675338 27750 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.699158 27454 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:06.782222 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 50973.9us
I20260709 12:18:06.782434 24591 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:18:06.704321 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:06.704527 27780 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.094s	user 0.003s	sys 0.004s
I20260709 12:18:06.705174 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:06.706218 27773 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:06.780177 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 48014.5us
I20260709 12:18:06.780694 27627 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:06.685514 27615 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 12:18:06.786566 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 89769.2us
I20260709 12:18:06.781296 27609 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:18:06.783268 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:06.786792 27627 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:06.788511 27627 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:06.789117 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:06.789938 27553 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:06.790330 27553 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.790668 27553 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:06.793319 27792 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:06.794777 27792 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:06.786249 27790 log.cc:927] Time spent T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:18:06.786835 27750 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.785663 27454 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:06.806558 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 64147.4us
I20260709 12:18:06.826327 27712 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:06.830691 27796 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.831436 27796 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:06.834131 27796 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:06.836601 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:06.838232 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:06.839231 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:06.839411 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:06.857527 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:06.858819 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:06.859730 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:06.856575 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 73378.8us
I20260709 12:18:06.861404 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:06.817515 27773 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:06.865197 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:06.874291 27800 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:06.878258 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:06.886339 23867 auto_rebalancer.cc:893] Removing replace marker failed: Replica a46beb8868d749fdbaa732dd1ef6b89b is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:06.887835 23867 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for fe5bb4f2e9f04fbb9241a5e24d5ae777 already in progress
W20260709 12:18:06.888198 23867 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for fe5bb4f2e9f04fbb9241a5e24d5ae777 already in progress
W20260709 12:18:06.885382 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 56965.8us
W20260709 12:18:06.903976 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.906761 27800 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:06.852031 27473 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.928429 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:06.927770 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 236609us
W20260709 12:18:06.932126 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 128552us
I20260709 12:18:06.939306 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:06.940145 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 53196.5us
I20260709 12:18:06.941045 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:06.941303 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:06.943030 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:06.943886 27559 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:06.946460 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.947791 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:06.968364 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 103237us
I20260709 12:18:06.799127 27372 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:07.020622 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 65986.6us
W20260709 12:18:07.021395 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 80412us
I20260709 12:18:06.864725 27567 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:07.097815 27777 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 12:18:07.115012 27814 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:07.020157 27473 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:07.116837 27567 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:07.020051 27802 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:06.878368 27773 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:07.150077 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 180736us
W20260709 12:18:07.152004 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 210752us
W20260709 12:18:07.153759 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 206041us
I20260709 12:18:07.155294 27771 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:07.163919 27790 log.cc:927] Time spent T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:18:07.260380 27638 consensus_meta.cc:287] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.000s
I20260709 12:18:07.260977 27638 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:07.160751 27750 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:07.276594 27773 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:07.284458 27367 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:07.163578 27553 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:07.285141 27367 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:07.286782 27553 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:07.289018 27367 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:07.293103 27772 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:07.294088 27597 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:07.296301 27478 raft_consensus.cc:993] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:07.296808 27478 raft_consensus.cc:1081] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:07.293622 27772 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:07.296236 27702 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:07.273100 27627 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:07.301769 27473 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:07.224495 27795 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:07.323439 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.324806 27808 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.325047 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 298801us
I20260709 12:18:07.325861 27817 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.322178 27702 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:07.340180 27817 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:07.340785 27702 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:07.335163 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 182205us
I20260709 12:18:07.345007 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:07.336452 27809 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.419149 27809 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:07.420051 27817 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:07.421420 27809 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:07.421766 27627 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:07.422381 27638 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:07.346217 27808 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:07.423213 27624 raft_consensus.cc:3055] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:07.423695 27624 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:07.424551 27808 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:07.424706 27624 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:07.425428 27702 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:07.425915 27624 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:07.435300 27454 consensus_meta.cc:287] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.615s	user 0.009s	sys 0.000s
I20260709 12:18:07.435717 27454 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:07.437755 27454 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:07.438498 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:07.438984 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.439013 27808 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:07.439708 27808 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:07.440172 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.440827 24591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37704
I20260709 12:18:07.441339 24591 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:07.441673 24591 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:07.443774 24063 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:07.661479 23912 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.016s	sys 0.007s
W20260709 12:18:08.125010 23912 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.016s	sys 0.033s
I20260709 12:18:07.632794 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:07.708663 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.127513 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:08.128883 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.639814 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:07.450997 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:08.130986 23921 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
W20260709 12:18:07.444983 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 290480us
W20260709 12:18:07.661675 24033 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.018s
W20260709 12:18:07.674032 24564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.008s	sys 0.060s
W20260709 12:18:08.132555 24033 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.021s	sys 0.032s
W20260709 12:18:08.132926 24564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.014s	sys 0.074s
I20260709 12:18:07.990695 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56870 (request call id 593) took 1296 ms. Trace:
I20260709 12:18:08.146034 23914 rpcz_store.cc:276] 0709 12:18:06.694174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.695224 (+  1050us) service_pool.cc:224] Handling call
0709 12:18:07.990425 (+1295201us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400179b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:07.990618 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2689283968}
I20260709 12:18:07.972478 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2346) took 1372 ms. Trace:
I20260709 12:18:08.147678 23988 rpcz_store.cc:276] 0709 12:18:06.600550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.601066 (+   516us) service_pool.cc:224] Handling call
0709 12:18:06.601419 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.324350 (+722931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.324395 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:07.324450 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:07.324495 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.972025 (+647530us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b5400311d54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:07.972231 (+   206us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.972401 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661961984}
I20260709 12:18:08.137200 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:07.444931 24600 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:18:07.444185 24066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:07.494870 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:08.143391 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 804316us
I20260709 12:18:08.149945 24066 raft_consensus.cc:606] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:08.150225 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:07.553610 24591 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.152635 24591 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:07.638217 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:07.890407 27789 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 12:18:08.153641 24064 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
W20260709 12:18:07.673677 23885 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.018s	sys 0.062s
W20260709 12:18:07.930809 27803 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:18:08.159766 24594 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 11: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:18:07.923578 27827 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.089s	user 0.000s	sys 0.007s
W20260709 12:18:07.940166 27615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.007s	sys 0.019s
I20260709 12:18:08.164222 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:07.923375 27781 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:07.929989 27525 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.168097 23987 raft_consensus.cc:2410] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:18:08.167869 23885 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.022s	sys 0.078s
I20260709 12:18:07.917817 27784 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:07.984529 27726 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:07.923148 27717 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.070019 27772 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:07.963706 27829 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.218605 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.218720 27829 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.219365 23987 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:08.220028 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.221031 27829 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:07.840481 27808 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.174832 27633 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.222623 27808 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.222779 27633 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.223121 27808 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.224808 27633 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.225049 27808 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:07.841053 27711 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:08.225850 27832 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:08.226236 27711 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.226696 27784 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.226579 27832 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.228374 27711 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.144984 27626 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.228806 27784 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.229319 27832 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.229112 27626 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.229456 27525 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.231773 27626 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:08.041576 27830 log.cc:927] Time spent T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.306s	user 0.001s	sys 0.000s
I20260709 12:18:08.144969 27826 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.154958 27814 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:08.167516 27615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.012s	sys 0.020s
I20260709 12:18:08.187424 27559 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:08.191742 27772 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:08.173441 27624 consensus_meta.cc:287] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.744s	user 0.009s	sys 0.001s
I20260709 12:18:08.203722 27831 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.250627 27831 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.178431 27781 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.253085 27781 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.253152 27831 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.204854 27717 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.255014 24598 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:08.256196 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2293) took 1230 ms. Trace:
I20260709 12:18:08.173272 27731 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.262725 27731 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:08.263585 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 113453us
I20260709 12:18:08.264902 27731 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.264835 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:08.207696 27726 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.209360 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.268569 27781 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.213949 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.269416 23991 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:08.269191 27781 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.270495 27771 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:08.271457 27781 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.271864 27771 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:08.272003 27781 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:08.276288 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:08.276108 27781 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.276862 27680 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.277351 27680 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.278446 27781 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.250602 27772 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.249596 27826 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.281599 23988 raft_consensus.cc:2410] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:18:08.281519 27750 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.282200 23994 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:08.282099 27750 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.255713 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:08.282249 27674 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.283146 23987 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:08.284113 27750 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.243286 27525 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.206461 27597 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.302445 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.306298 24600 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:08.296322 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:08.256630 23917 rpcz_store.cc:276] 0709 12:18:07.025977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.026140 (+   163us) service_pool.cc:224] Handling call
0709 12:18:07.026567 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.148997 (+122430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.149027 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:07.149525 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:18:07.162353 (+ 12828us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:07.236042 (+ 73689us) log.cc:844] Serialized 14 byte log entry
0709 12:18:07.316841 (+ 80799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.316938 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:07.828418 (+511480us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b18004263a0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb332a6 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c5b7baa1 00007f75c5b72b37 00007f75c5b729ca 00007f75c5c6a26f
0709 12:18:07.836335 (+  7917us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b4800002dd8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c5b7baa1 00007f75c5b72b37 00007f75c5b729ca 00007f75c5c6a26f 00007f75c5c69f37 00007f75c5c7e55c 00007f75c5c7e508 00007f75c5c7e488 00007f75c5c7e443 00007f75c5c7d6ec 00007f75c4ba7a96
0709 12:18:08.255932 (+419597us) raft_consensus.cc:1685] finished
0709 12:18:08.255962 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.256126 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":404350,"prepare.queue_time_us":73502,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":395957,"raft.run_cpu_time_us":13162,"raft.run_wall_time_us":567111,"spinlock_wait_cycles":61442176,"thread_start_us":134390,"threads_started":2,"wal-append.queue_time_us":474355}
I20260709 12:18:08.291414 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.309327 24594 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 5.
I20260709 12:18:08.329491 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.332494 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:08.334695 23987 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:08.284632 27750 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:08.344995 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:08.353088 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:08.354212 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:08.355319 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:08.356280 27802 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:08.356993 27802 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:08.357676 27802 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:08.358819 27725 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.359403 27725 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.362439 27731 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.363005 27731 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.365166 27731 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.365685 27731 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.336041 27822 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:08.285032 27597 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.369495 27597 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.335654 27836 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.287940 27726 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.301326 27785 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.351760 23961 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:08.318178 27567 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.255698 27717 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.331543 27771 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.366180 27731 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.335598 27702 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.350899 27801 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.351100 27566 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:08.283718 27674 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.351972 27821 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.371512 27802 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:08.397529 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 45846.2us
W20260709 12:18:08.389921 27834 log.cc:927] Time spent T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:18:08.371691 27725 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:08.404126 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 449162us
I20260709 12:18:08.374138 27750 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.402580 27717 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:08.374601 27836 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.390964 27567 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.388332 27785 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.436502 27717 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.401757 27702 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.395660 27771 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.403674 27801 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.405285 27821 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.448320 27717 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:08.453840 27840 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:18:08.453822 27559 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.460019 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2053) took 1609 ms. Trace:
I20260709 12:18:08.468641 24069 rpcz_store.cc:276] 0709 12:18:06.850799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.852655 (+  1856us) service_pool.cc:224] Handling call
0709 12:18:06.852975 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:06.853940 (+   965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:06.853964 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:06.854371 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 12:18:07.692475 (+838104us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b180048eb60. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:18:08.145211 (+452736us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:08.145251 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.145392 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:08.459704 (+314312us) raft_consensus.cc:1685] finished
0709 12:18:08.459725 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.459957 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":438259,"raft.queue_time_us":669,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":440192,"spinlock_wait_cycles":24343296,"thread_start_us":452524,"threads_started":1,"wal-append.queue_time_us":1547565}
I20260709 12:18:08.461095 27750 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.466841 27680 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.476073 27788 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.488521 27788 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.474784 27559 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.493148 27826 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.494017 27567 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.495518 27674 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.496845 27731 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.498785 27771 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.500512 27785 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.502319 27702 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.504408 27801 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.510668 27814 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.511340 27814 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:08.516323 27772 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.521898 27821 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.564715 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2292) took 1538 ms. Trace:
I20260709 12:18:08.565820 23912 rpcz_store.cc:276] 0709 12:18:07.025676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.026805 (+  1129us) service_pool.cc:224] Handling call
0709 12:18:07.027119 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.154253 (+127134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.154346 (+    93us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:07.155482 (+  1136us) log.cc:844] Serialized 26 byte log entry
0709 12:18:08.125552 (+970070us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:08.162206 (+ 36654us) log.cc:844] Serialized 14 byte log entry
0709 12:18:08.266483 (+104277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.266584 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:08.563611 (+297027us) raft_consensus.cc:1685] finished
0709 12:18:08.563700 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.564291 (+   591us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":208268,"prepare.queue_time_us":36930,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":399833,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":10305,"thread_start_us":1095719,"threads_started":2,"wal-append.queue_time_us":1109827}
I20260709 12:18:08.570932 23817 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 7 to 8, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 8 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:08.577407 23817 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:08.583732 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 176586us
I20260709 12:18:08.583495 23817 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 7, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 7 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:08.587662 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:08.591663 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:08.593901 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:08.591423 23817 catalog_manager.cc:5697] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:08.597608 23817 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
W20260709 12:18:08.610808 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 439432us
W20260709 12:18:08.615564 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.618579 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:08.633401 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:08.634819 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.640650 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.602581 23817 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:08.683040 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.678342 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.698644 27726 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:08.698947 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.699779 27726 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:08.700361 27726 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:08.700944 27627 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:08.702023 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.701891 27627 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.702627 27826 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.703743 27826 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.705674 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.706741 24591 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:08.708043 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.709653 23991 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:08.710638 27835 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.711120 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.711920 27731 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:08.712092 24598 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:08.691133 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:08.714931 27454 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:08.715797 27454 raft_consensus.cc:697] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:08.717640 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:08.713682 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.718662 24595 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:08.719355 27768 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.720364 27768 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.722950 27849 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.724031 27845 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.723977 27849 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.725065 27559 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.725374 27784 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:08.725231 27845 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.725881 27784 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.726446 27772 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.691118 27831 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.711658 27835 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.726521 27712 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:08.730026 27784 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:08.717724 27454 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.746409 27702 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.747339 27835 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.747541 27702 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.748118 27835 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.748931 27835 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:08.750379 24035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.010s
W20260709 12:18:08.750825 24035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.010s
I20260709 12:18:08.752094 27772 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.752918 27597 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.754675 27831 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.757736 27831 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.759128 27849 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.759790 27849 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.759430 23817 catalog_manager.cc:5697] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:08.760561 27849 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.762940 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.764358 27826 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.765756 27836 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.768386 27845 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.759800 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.770942 27627 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.771492 23996 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
W20260709 12:18:08.759812 27808 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.010s	sys 0.084s
I20260709 12:18:08.773180 27788 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.775822 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.777009 24593 raft_consensus.cc:2410] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:18:08.778728 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:08.779740 23912 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:08.781587 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:08.782452 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 427043us
I20260709 12:18:08.753873 27597 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.783926 23961 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:08.784989 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 53460.4us
I20260709 12:18:08.785918 27597 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.788751 27772 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.783977 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:08.800186 27744 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:08.800861 27744 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.801352 27744 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:08.800133 27626 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 7 to 9, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:08.801695 27821 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:08.788981 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.698697 27833 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.804001 27833 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.807577 27833 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.794745 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.794632 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.795411 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.809358 24596 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:08.795835 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:08.797866 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.812443 27784 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.815122 27829 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.794919 27768 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.761737 23817 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:08.819541 23996 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 7 to 9, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:08.823258 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:08.826947 27831 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.839200 27829 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.839562 27831 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.847179 27831 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.847296 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.778739 27849 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.847620 27814 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.848908 24596 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 5.
I20260709 12:18:08.858953 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:08.859357 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:08.862439 24594 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:08.869295 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.876000 27856 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.875926 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.878876 27829 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:08.880879 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.882962 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:08.883834 24598 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:08.887379 27835 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.889806 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:08.877344 27856 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.865775 27702 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.911585 27847 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.911620 27597 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.912779 27808 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:08.912521 27847 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.912528 27597 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.917807 27808 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.919220 27717 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.919587 27597 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.920017 27847 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.920259 27597 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:08.920574 27847 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.920989 27597 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.921520 27717 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.921242 27847 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:08.922580 23994 raft_consensus.cc:2368] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7.
I20260709 12:18:08.912549 27856 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.923640 27847 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:08.924695 24063 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:08.926005 24566 leader_election.cc:400] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7.
I20260709 12:18:08.926334 24566 leader_election.cc:403] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:08.914570 27859 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:08.927485 27597 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.947639 23915 raft_consensus.cc:2393] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:08.931257 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:08.998800 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.953121 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:08.920708 27808 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.934988 23921 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:09.054636 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:08.934770 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:08.881008 27745 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:08.949194 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:08.932010 24564 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.995s (SENT) [suppressed 7 similar messages]
I20260709 12:18:08.959931 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:08.939808 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:08.958518 27454 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.163678 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:09.165689 24070 raft_consensus.cc:3055] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:09.165977 24070 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:09.166923 24070 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.168013 24070 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:09.173861 23960 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:09.178622 27633 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:09.179124 27633 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:09.179504 27633 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.180994 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:09.183523 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.186750 27768 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:09.186470 27745 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.187294 27768 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.187734 27768 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.188933 27745 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.188827 27633 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.178596 24070 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:09.192788 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.162215 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:08.942855 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.198346 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.198973 24070 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:09.199414 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.199930 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.200701 24070 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:09.200754 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.201642 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:09.201960 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:09.201942 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.163648 24035 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:09.164513 27808 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:09.205839 27808 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:09.205978 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.206209 24035 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:09.206517 27597 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:09.206868 24063 raft_consensus.cc:2410] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:09.206948 27597 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.025928 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.194574 27633 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.204396 23996 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:09.204459 23993 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:09.162966 27626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43052 (request call id 0) took 2786 ms. Trace:
I20260709 12:18:08.931527 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:09.147234 27814 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.207434 27597 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.206231 27808 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:18:09.214792 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.215224 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 293513us
I20260709 12:18:09.218071 27744 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:08.942636 23817 catalog_manager.cc:5697] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 4 to 5, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 5 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.219719 27852 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.243105 23991 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:09.241290 24064 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:18:09.044389 27717 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:09.166196 27784 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:08.943573 27726 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.244947 23917 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:09.246289 24066 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:09.255976 27717 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.256630 23817 catalog_manager.cc:5697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 5, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 5 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:09.257879 23987 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:09.258638 23992 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:09.261412 27454 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7.
I20260709 12:18:09.263465 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.265086 27788 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:09.266182 24591 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:09.263689 23817 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 2 to 5, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 5 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.275534 27808 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.276441 24061 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:09.278658 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.282420 27852 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.244686 27859 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.289425 27835 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:09.291352 23994 raft_consensus.cc:2368] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:09.323074 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.362674 24069 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:09.367089 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:09.532734 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.393532 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.567358 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:09.382031 24067 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:09.403524 23817 catalog_manager.cc:5697] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.368829 27852 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.574420 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.462972 27820 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:09.575543 27820 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.576223 27835 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.576714 27835 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.577800 27820 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:09.579684 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.519479 27801 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:09.494931 27674 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:09.393559 27768 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.581957 27801 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.582110 27674 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.582368 23817 catalog_manager.cc:5697] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 1 to 5, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 5 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:09.583614 27768 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.584179 27801 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.584316 27674 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.584630 23817 catalog_manager.cc:5697] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 7 to 8, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 8 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:09.585956 27744 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.573073 27717 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.586163 23817 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 4 to 6, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 6 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:09.587015 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.391446 27788 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.403002 27808 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.588316 27702 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:09.589051 27702 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.589429 27788 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.590221 23914 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.591450 27702 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.597112 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.597931 24063 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:09.468372 27814 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:09.605100 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.605800 23917 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:09.606662 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.607806 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.609038 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:09.611096 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 752834us
I20260709 12:18:09.612488 27814 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.613116 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.622421 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.622603 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:09.623250 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.623577 24594 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.626091 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:09.631258 27597 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.614903 27859 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.676743 23914 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:09.678368 27814 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.679183 27784 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:09.679777 27784 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.680228 27597 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.681689 24062 raft_consensus.cc:2368] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9.
I20260709 12:18:09.681865 27784 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:09.681758 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.683179 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.683794 23919 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:18:09.685228 23913 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: [6.8-9.10]
I20260709 12:18:09.685407 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:09.686889 23914 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.691071 27829 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:09.691653 27829 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.693578 27829 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.694738 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.695092 23886 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:09.695870 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.696436 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.696969 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.698197 24594 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:09.694501 23914 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
W20260709 12:18:09.701259 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.702126 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:09.686537 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 51843.8us
I20260709 12:18:09.704221 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.704962 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.706955 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.708575 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:09.709030 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 72627.8us
I20260709 12:18:09.703503 27859 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:09.713258 27788 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:18:09.712991 27859 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.720590 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:09.722689 23913 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:09.723519 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.719859 23919 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:09.221251 27626 rpcz_store.cc:276] 0709 12:18:06.371703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.371904 (+   201us) service_pool.cc:224] Handling call
0709 12:18:06.378067 (+  6163us) log.cc:844] Serialized 487 byte log entry
0709 12:18:06.803882 (+425815us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b180011caa0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:07.290987 (+487105us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b180011caa0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb65522 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:07.727155 (+436168us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b5400572c20. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0bcb142 00007f75c0babeaa 00007f75c0bb2d53 00007f75c0bb2cd9 00007f75c0bb2c69 00007f75c0bb2c31 00007f75c0bb1dfd 0000000000388634 0000000000388479 00007f75bdb65475
0709 12:18:09.151034 (+1423879us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6852,"raft.run_cpu_time_us":25707,"raft.run_wall_time_us":1623567,"spinlock_wait_cycles":73950592,"thread_start_us":108701,"threads_started":1,"wal-append.queue_time_us":146913,"wal-append.run_cpu_time_us":2459,"wal-append.run_wall_time_us":1298792}
I20260709 12:18:09.726184 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:09.708537 27597 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:18:09.728261 24594 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.713127 27745 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:09.730193 24063 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:18:09.731770 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.732582 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.733188 27785 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:09.736515 24566 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:09.735723 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.736603 27785 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:09.737452 27785 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.737190 27745 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.738572 27454 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:09.739012 27454 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.739344 27454 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.745491 27785 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.724659 27702 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:09.746677 23914 raft_consensus.cc:2410] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:18:09.746701 27702 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:09.748044 27702 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.750197 27745 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.751914 27859 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:09.752652 27785 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.753328 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.753598 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.754482 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.754617 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.755059 23913 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:09.755112 23919 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:09.756026 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.756036 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.756775 23919 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:09.757099 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.757543 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.758117 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.758808 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.759980 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.760026 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.760711 23919 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:09.758718 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.761091 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.761824 23913 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:09.761924 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.762773 23919 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:09.763593 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.764622 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.765511 23919 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:09.766528 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.766559 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.762156 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.770555 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.772970 24594 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:09.774494 24035 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:09.775748 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:09.775728 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.776484 23919 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.777916 24066 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:09.779063 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.780444 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.781358 27814 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:09.781929 27814 raft_consensus.cc:697] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:09.782805 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.783212 27814 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.785140 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.785280 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:09.785840 24063 raft_consensus.cc:2393] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:09.786474 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.791189 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.786715 24066 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:09.791769 24065 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:09.792658 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.792621 24066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:09.793813 24066 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:09.786630 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.794762 24066 raft_consensus.cc:614] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:09.792676 23917 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:09.794726 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.794028 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:09.801584 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 112388us
I20260709 12:18:09.805810 23805 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 10cd478aa7e9411bba254e94713f91de with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:09.809374 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.807006 23918 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:09.811558 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:09.812276 24068 raft_consensus.cc:2393] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:09.813447 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.797322 27785 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:09.815707 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.816488 24065 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:09.819453 24564 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:09.820286 27626 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:09.820700 27626 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.821322 27626 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.820695 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:09.830916 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:09.835542 24034 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:09.836529 27808 consensus_queue.cc:1059] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:09.837234 27859 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:09.838454 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:09.831871 24068 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:09.850488 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.851066 24068 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:18:09.851325 23915 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:09.851905 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:09.852986 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:09.853506 24068 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.854008 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:09.850512 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.854490 27454 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.843012 27825 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:09.857162 27825 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:09.843956 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:09.845001 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.858067 27825 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.859357 27825 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.859488 23920 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:09.859447 24070 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:09.847967 27726 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.856693 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.864121 23917 raft_consensus.cc:2393] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:09.864077 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:09.856735 24062 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:09.886158 23919 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:09.887420 27872 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:09.892221 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:09.893381 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:09.894111 27726 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:09.894392 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 66412.1us
I20260709 12:18:09.894687 27726 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.897197 27726 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.901902 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.902542 23912 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:09.902586 27872 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:09.903147 24566 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:09.904237 27788 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:09.904397 27454 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.904683 27788 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:09.905150 27788 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.905164 27871 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:09.906008 24064 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:09.910761 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.911033 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:09.911474 23916 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:09.911736 23913 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:09.912951 23987 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:09.890134 27674 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:09.917485 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:09.917625 27674 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.918095 23994 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:18:09.919727 27674 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:09.921648 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:09.922960 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:09.923873 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:09.924885 27801 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:09.925062 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:09.925552 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:09.926450 27820 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:09.926640 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:09.926863 27820 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:09.927241 27820 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.926472 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:09.927645 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:09.929314 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:09.929641 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:09.930404 27852 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:09.930595 27801 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:09.931200 27801 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:09.931401 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:09.931772 27801 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:09.932721 27829 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:09.933147 27829 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:09.933533 27829 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:09.937459 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 116822us
I20260709 12:18:09.938748 24564 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:09.941267 27835 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:09.942111 27454 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:09.942551 24069 raft_consensus.cc:2393] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:09.885088 27785 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:09.946959 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.948405 27785 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:09.950235 23987 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:09.953579 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:09.954310 24592 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:09.964757 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:09.972343 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.974361 24591 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:09.974797 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:09.974920 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:09.976665 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:09.978744 23993 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: []
W20260709 12:18:09.984143 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 147245us
I20260709 12:18:09.990761 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:09.990901 27597 raft_consensus.cc:3055] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:09.981825 27872 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:18:09.991605 24592 raft_consensus.cc:2368] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:09.991663 27597 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:09.996901 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:09.997455 24066 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:09.973524 27836 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:10.000882 24063 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:10.000969 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 165534us
W20260709 12:18:10.004801 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 78625.1us
I20260709 12:18:10.004935 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:10.006791 23918 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:10.004801 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.010032 24592 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:10.015216 27871 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.015779 27871 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.019464 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.022626 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:10.024686 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:10.025838 24599 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:10.026708 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:10.028847 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.029768 27626 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.031813 27626 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.032517 24594 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:18:10.039019 23960 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:09.993574 27454 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:10.044651 24068 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:10.044188 23913 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:09.995077 27875 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.049081 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:10.047037 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:10.051127 23887 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:10.053216 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 48807.4us
I20260709 12:18:09.992895 27597 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.057032 27597 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.054711 27784 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.063378 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:10.055027 23886 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:10.069711 27884 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:10.069850 27674 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:10.059729 27852 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:10.060731 27771 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:10.062531 27784 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:10.054857 27808 consensus_queue.cc:1059] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:18:10.056088 27801 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.077641 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:10.082584 23915 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.083294 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:10.085067 24596 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:10.072942 27674 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.088281 27835 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:10.091384 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:10.067399 27875 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.093833 24593 raft_consensus.cc:2393] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:10.095203 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:10.095593 27820 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.096536 24036 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:10.076867 27771 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.082898 27784 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.103538 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:10.105254 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 52424.5us
I20260709 12:18:10.109242 27801 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.102536 27859 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:10.110414 27859 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:10.110916 27859 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.084738 27829 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.116779 27829 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.091176 27674 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.120858 23887 leader_election.cc:400] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9.
I20260709 12:18:10.122898 23887 leader_election.cc:403] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:10.124881 27852 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9.
I20260709 12:18:10.125766 27785 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:18:10.122025 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 67036.7us
I20260709 12:18:10.129010 24593 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:10.098218 27881 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:10.097530 27875 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:10.102955 27771 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.102576 27454 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.117633 27879 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.149154 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.151036 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:10.092067 27702 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:10.137356 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:10.158252 23993 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.104976 27808 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:10.104826 27871 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:10.157598 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:10.160928 23886 leader_election.cc:400] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:10.161315 23886 leader_election.cc:403] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:10.118135 27876 raft_consensus.cc:2764] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:18:10.164544 24066 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:10.129535 27820 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.169490 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:10.175866 23918 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:10.171370 27852 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.157804 27702 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:10.179256 27702 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.180929 27702 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:10.184767 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54011.2us
W20260709 12:18:10.197096 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.198244 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:10.199050 23913 raft_consensus.cc:2376] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11. Re-sending same reply.
I20260709 12:18:10.158946 27881 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:10.201968 23993 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:10.203805 24566 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:10.205618 23915 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:10.210210 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:10.208978 27785 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:18:10.210989 27788 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.213197 27788 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.214614 24598 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:10.219367 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 122002us
I20260709 12:18:10.225000 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.230157 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:10.206326 27881 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:10.242381 27890 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.244442 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:10.209333 27879 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:10.253017 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:10.249745 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:10.250574 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 175664us
I20260709 12:18:10.253229 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:10.253823 24061 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:10.254112 24068 raft_consensus.cc:2368] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:10.206562 27820 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:18:10.256407 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:10.257197 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:10.254846 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:10.259802 23912 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.256619 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:10.257690 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:10.229944 27626 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:10.260872 23960 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:10.262599 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:10.264741 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:10.230079 27829 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:18:10.252954 27835 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:10.274416 27808 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:10.246830 27884 consensus_queue.cc:1059] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:18:10.222417 27889 consensus_queue.cc:1059] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:18:10.281754 27891 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:10.268329 27726 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:10.283658 27726 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:10.284157 27726 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.259867 27801 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:10.283833 27771 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.280006 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:10.293884 23961 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:10.294246 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:10.294924 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:10.266171 27879 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:10.268828 27626 raft_consensus.cc:697] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:10.287336 27835 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:10.288350 27852 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:10.332975 23912 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:10.311472 27875 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:10.323271 27745 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:10.334832 27886 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.313977 27835 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:10.264461 27890 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.342064 27879 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.346941 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:10.347815 27785 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:10.349869 27626 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.355151 24036 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:10.361631 23913 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:10.365911 27726 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.346419 27893 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:10.387940 24598 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:10.406318 27893 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:10.406759 27876 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:10.407302 27893 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.381739 27820 raft_consensus.cc:3055] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:10.410647 27820 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:10.410945 27890 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:10.411837 24593 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:10.374060 27771 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.368235 27725 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:10.378751 27883 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:10.419486 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 64418.1us
I20260709 12:18:10.399662 27785 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:10.421141 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 133190us
I20260709 12:18:10.399370 27835 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:10.435293 24036 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:10.435932 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 167882us
I20260709 12:18:10.420142 27597 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:10.381343 27891 raft_consensus.cc:3055] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:10.399600 27745 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:10.411798 27820 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.366211 27674 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:10.421523 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 158860us
W20260709 12:18:10.446946 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 153162us
I20260709 12:18:10.461948 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:10.461948 24034 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:10.498917 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:10.450130 27597 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:10.428930 27808 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:18:10.449453 27891 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:10.413621 27886 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.442719 27890 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:18:10.437075 27859 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.508049 27897 consensus_queue.cc:1059] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:18:10.512104 27899 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:10.524231 23913 raft_consensus.cc:1240] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:10.506394 27902 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:10.509229 27597 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.523474 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:10.515635 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 82512.4us
W20260709 12:18:10.516199 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 45650.8us
I20260709 12:18:10.527969 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:10.528669 23961 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:10.529488 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.509701 27876 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:10.510298 27702 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:10.433933 27883 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.539067 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.539434 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:10.532658 23887 leader_election.cc:400] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:10.495728 27725 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.535524 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.521801 27820 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.513837 27894 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:10.550717 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.551970 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.556357 24069 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:10.549317 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.557596 23913 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:10.558144 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.558660 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.556559 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.559378 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.559166 24069 raft_consensus.cc:2410] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:10.560010 24067 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:10.534513 27702 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.601754 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.535476 27902 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:10.532050 27889 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:10.603106 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 56862.7us
I20260709 12:18:10.529493 27768 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:18:10.603372 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:10.603988 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 64643.8us
I20260709 12:18:10.739899 24034 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:10.740711 27875 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:10.741586 24034 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:10.742319 27875 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.743552 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:10.744673 27875 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:10.745040 27875 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.745393 27875 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:10.691808 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.690797 27784 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.604483 27899 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 12:18:10.604354 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.752292 23993 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:10.700438 27876 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:10.753685 27876 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.754906 27886 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:10.690706 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 48281.7us
I20260709 12:18:10.756702 27473 consensus_queue.cc:1059] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:10.757673 27914 raft_consensus.cc:3055] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:10.758023 27914 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:10.758934 27914 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.759649 27674 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:10.760243 27902 raft_consensus.cc:697] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:10.703742 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 93124.2us
I20260709 12:18:10.761639 27875 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.762483 27889 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.763049 27889 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.761437 27902 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.765774 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:10.766212 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:10.766634 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.753077 27883 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.769322 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:10.770358 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 241738us
I20260709 12:18:10.609669 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.614624 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:10.773929 23918 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:10.775101 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.775708 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:10.768052 23962 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:10.777282 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:10.778340 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.779235 23994 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:10.788555 27917 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:10.789067 27917 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.785322 27744 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.789768 27894 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:10.790465 27894 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:10.789848 27744 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:10.791147 27744 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.791342 27894 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.792697 27894 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.789412 27917 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:10.745731 27835 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.801321 23962 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:10.690580 27909 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:10.614723 27808 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:10.783833 27702 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:10.603821 27726 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.801302 23887 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:10.811866 23962 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:10.786906 27814 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:10.817062 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.813591 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.819113 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:10.612078 27900 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.210s
I20260709 12:18:10.824898 24070 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:10.824239 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:10.827417 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 377669us
I20260709 12:18:10.834877 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:10.807732 27909 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:10.829186 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.834131 27726 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:10.616830 27881 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.842461 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.607400 27891 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.850095 27638 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:10.852461 27914 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.854334 27814 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.854872 27908 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.552778 27785 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.855623 27904 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:10.832264 27875 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:10.856724 27921 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:10.888702 24593 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:10.856509 27473 consensus_queue.cc:1059] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:10.899102 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:10.860016 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.879709 27814 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:10.900379 27814 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.900563 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.900874 27725 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.845768 27876 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.901643 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.861550 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.903056 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.904042 27876 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:10.904111 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.905586 23989 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:10.862960 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.863714 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.906855 23988 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:10.885082 27904 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:10.908319 27904 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:10.874982 23918 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
W20260709 12:18:10.877291 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 50743us
W20260709 12:18:10.911552 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 84157.5us
W20260709 12:18:10.881978 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 70163.5us
I20260709 12:18:10.879009 27883 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:10.862285 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.893780 27921 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:10.894837 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:10.895252 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.899098 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:10.872123 27726 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:10.911713 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:10.880815 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:10.915899 27909 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:10.916395 27597 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.893394 27881 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.559643 27745 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.937580 23960 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:10.938616 23994 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:10.938400 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:10.940122 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:10.930850 27726 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.942721 27909 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:10.947194 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 131439us
I20260709 12:18:10.948479 23887 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:10.951674 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:10.952044 23994 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:10.954227 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:10.930609 27917 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.958806 27597 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:10.959780 27917 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:10.960494 27702 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.921548 27921 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:10.931195 27744 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.964798 27744 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:10.979774 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:10.946663 27908 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:10.965981 27889 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:10.920675 27883 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.016269 24063 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:18:11.016631 24063 pending_rounds.cc:85] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 9
I20260709 12:18:11.017676 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.020671 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:11.007936 27801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.006s	sys 0.000s
I20260709 12:18:11.013495 27852 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:11.017346 24063 pending_rounds.cc:107] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:18:11.023341 24063 raft_consensus.cc:2889] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:11.025461 27859 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:11.030845 27702 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:11.035724 27784 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.035981 27726 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.037686 23996 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 7: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:11.039067 27835 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:11.038990 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 90581.3us
I20260709 12:18:11.047623 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.053586 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:11.053886 27597 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:11.055301 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 236251us
I20260709 12:18:11.056816 24063 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:11.052836 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.058346 23994 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:11.013057 27717 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:11.059867 27726 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:11.067837 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.075889 27883 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.075322 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:11.096088 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.096859 23987 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.097394 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.097554 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.077229 27814 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.099689 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.100960 27872 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.101122 27814 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:11.101516 27872 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.103909 27872 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.055301 27825 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:18:11.108017 23993 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:11.047698 27801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.000s
I20260709 12:18:11.054571 27597 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.109766 27908 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:11.110827 23987 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:11.110888 27908 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:11.111763 27597 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:11.114876 27891 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.117574 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.118866 24599 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:11.119921 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 71298.4us
I20260709 12:18:11.103209 27904 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.129807 24036 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.131045 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:11.131646 24061 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:11.134604 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.137192 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:11.138357 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:11.112233 27908 raft_consensus.cc:3055] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:11.141847 23962 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:11.150095 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.148298 24036 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.151849 23991 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:11.152405 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:11.153630 27872 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:11.154048 27872 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.154415 27872 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:11.154938 27898 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:11.156605 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 109063us
I20260709 12:18:11.157812 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.129410 27717 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:11.084152 27820 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260709 12:18:11.168416 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 93174.1us
I20260709 12:18:11.171187 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:11.171775 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.173027 23887 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.175779 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.172714 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:11.179693 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:11.182204 23996 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:11.186436 24566 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.187407 27911 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:11.188822 27911 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:11.194017 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.126205 27829 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:18:11.132344 27825 consensus_queue.cc:1059] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:18:11.144951 27926 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:11.214075 24564 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.148540 27908 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:11.216167 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.155750 27768 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:11.134222 27852 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:18:11.230185 24036 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.231786 24036 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.230741 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.178571 27814 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:11.136459 27921 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:11.236287 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 60619.7us
I20260709 12:18:11.209193 27884 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:11.237942 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.211894 27909 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:11.243013 24564 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.215616 27898 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:11.234444 27835 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.262209 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.264256 24067 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:11.265177 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 48396.8us
I20260709 12:18:11.223619 27894 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.262692 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.234836 27597 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:11.249132 27875 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:11.241276 27836 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.275236 24564 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.290083 23887 leader_election.cc:400] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:11.301720 23887 leader_election.cc:403] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:11.291779 27932 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:11.293561 27923 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:11.237742 27768 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.250042 27926 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.244436 27886 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:11.262996 27898 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:11.302943 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.291414 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:11.264281 27899 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:11.288681 27825 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:11.310609 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 48470.4us
I20260709 12:18:11.314566 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.318334 27922 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:11.318938 27925 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:11.319380 27925 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:11.319532 27909 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:11.319796 27925 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.320013 27914 raft_consensus.cc:3055] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:11.320250 27909 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:11.322367 27931 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:11.322813 27931 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:11.323151 27931 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:11.304373 27717 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.318210 27905 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:11.307492 27852 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
W20260709 12:18:11.336194 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.335050 23918 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:11.341952 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.320418 27914 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:11.339788 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:11.343808 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 52488.7us
I20260709 12:18:11.345302 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:11.345557 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:11.344516 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:11.346176 23918 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:11.346740 23913 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:11.347779 27926 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:11.326252 27921 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:11.348205 27926 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:11.348637 27926 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:11.353013 24066 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:11.353591 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:11.356280 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:11.356873 24069 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.315765 27898 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:11.326310 27848 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.029s	sys 0.075s
W20260709 12:18:11.326697 27928 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:18:11.366398 23915 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:11.326814 27879 raft_consensus.cc:3055] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:11.340736 27889 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:11.373452 24564 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.356477 27785 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:11.377769 23918 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:11.384616 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:11.380187 23917 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11. Ops: [9.5-10.6]
W20260709 12:18:11.369702 27848 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.029s	sys 0.076s
W20260709 12:18:11.408373 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 93905.5us
I20260709 12:18:11.409442 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.326395 27886 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.413318 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.414237 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.415230 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.416327 23994 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:11.420162 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.420750 23919 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:11.384168 27454 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:18:11.421729 27872 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.430562 27872 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.437487 24061 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:11.376573 27879 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:11.438620 27768 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.439396 27879 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.440585 27879 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.444341 27744 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:11.449347 23919 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:11.453562 24069 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:11.376134 27904 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.467602 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.468201 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:11.455116 24068 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:11.418946 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:11.455881 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.457322 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.375012 27702 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:11.458982 24065 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:11.479151 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 241259us
I20260709 12:18:11.461565 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:11.463019 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 53689.7us
I20260709 12:18:11.407790 27881 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:11.464687 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.462134 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.479162 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:11.471534 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.466629 27808 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:18:11.473286 27931 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.474908 23992 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:18:11.461839 23920 raft_consensus.cc:2955] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 7 to 9, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:11.487798 24034 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:11.484073 23962 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:11.486169 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:11.470686 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 51848.6us
I20260709 12:18:11.489054 23921 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:11.490164 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.490633 23921 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:11.492448 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:11.493077 23992 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:11.493513 24036 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.475960 27898 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.481408 27905 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:11.480888 27876 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.517096 27942 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:11.517544 27942 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:11.518455 27942 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.519729 27942 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:11.495704 27597 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:11.526418 27905 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:11.528647 27905 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.528885 24066 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:11.529978 27898 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:11.414480 27914 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.531137 27914 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.531608 24036 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:11.497599 27875 consensus_queue.cc:1059] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:18:11.494583 27923 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:11.498000 27919 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:11.534768 27915 consensus_queue.cc:1175] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71a48f59ff764d249519c6a53ec57f02" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 7 } }
I20260709 12:18:11.535115 27919 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:11.535317 27875 raft_consensus.cc:3055] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:11.535748 27875 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:11.536047 27919 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.464303 27925 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.537158 27926 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.537642 23996 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:11.461866 27889 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:18:11.501451 24067 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:11.482551 27768 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:11.503777 27944 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:11.567705 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 83749.2us
I20260709 12:18:11.568665 23962 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.504284 27886 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.506718 27814 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.511008 27931 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:11.511771 27908 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.512642 23990 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:11.492005 27702 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:11.540669 27925 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:11.540652 27923 raft_consensus.cc:697] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:11.584838 27908 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:11.585412 27768 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:11.585147 27923 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.536649 27875 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.542768 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.587684 23919 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:11.569628 27725 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:11.548033 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.548563 27905 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.549481 23915 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:11.550156 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.552886 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.500409 23992 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:11.495110 27848 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:18:11.591872 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.559762 23921 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
W20260709 12:18:11.566262 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 69880.2us
I20260709 12:18:11.579681 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.596383 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.545823 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:11.588346 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.596421 23962 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:11.604496 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:11.602592 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:11.578238 27836 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:11.605954 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 113596us
I20260709 12:18:11.605401 23990 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:11.604552 23992 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:11.608629 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:11.610662 27899 consensus_queue.cc:1059] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:11.611073 27852 consensus_queue.cc:1059] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:11.612993 27900 raft_consensus.cc:3055] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:11.613492 27900 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:11.615741 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:11.618937 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.602231 27944 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:11.605166 27931 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:11.600312 27898 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:11.593526 27725 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:11.620388 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.614364 27909 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:11.605947 27744 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:11.585093 27702 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.626803 23919 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:11.621054 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:11.628132 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.614969 27836 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.629514 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.645857 27785 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.648366 27785 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.629850 27597 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:11.643693 23987 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:11.653687 27597 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:11.654388 27917 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:11.626046 27725 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.649614 27951 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:11.655000 27884 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:11.650475 27898 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:11.655547 27884 raft_consensus.cc:697] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:11.655741 27898 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:11.656505 27884 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.661792 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:11.621191 27717 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:11.662542 24593 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:11.632278 27875 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:11.651230 27836 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.661855 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:11.670256 27911 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:11.670979 27883 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:11.671540 27883 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.673620 27883 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:11.675014 27825 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:11.675107 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:11.676096 24069 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:11.619632 27814 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:11.677214 27814 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:11.677707 27814 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:11.652201 24036 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:11.663954 23886 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:11.684648 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.688043 24063 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:11.689095 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:11.621476 27889 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.698477 23992 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:11.701475 24595 raft_consensus.cc:1240] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:11.702811 23993 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:11.709295 27898 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.711439 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:11.715096 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:11.715852 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 51972.9us
I20260709 12:18:11.721257 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.717554 27898 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:11.721627 24564 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:11.723127 27820 consensus_queue.cc:1059] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:11.728322 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.691704 27785 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:11.722067 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:11.701864 27951 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:11.735136 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.718792 27886 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:11.731534 27852 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:11.721992 27926 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:11.751188 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.717396 27883 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:18:11.714649 27900 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.749655 27911 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:11.762976 27900 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.763469 27911 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:11.764362 27911 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.752353 27852 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.766570 27852 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.722047 27674 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:18:11.751607 27785 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:11.760969 27725 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.748463 27801 consensus_queue.cc:1059] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
W20260709 12:18:11.800209 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 121820us
W20260709 12:18:11.801678 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 50735.6us
W20260709 12:18:11.767163 27899 consensus_queue.cc:1175] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" responder_term: 6 status { last_received { term: 6 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 6 index: 5 } }
I20260709 12:18:11.752482 27886 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.799566 27872 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.834319 23921 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:11.835366 23920 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:11.842430 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.843139 23914 raft_consensus.cc:2368] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13.
I20260709 12:18:11.843801 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:11.842257 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:11.813493 27905 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.880056 23914 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:11.887574 27725 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.889302 27881 raft_consensus.cc:3055] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:11.889699 27881 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:11.897842 27785 raft_consensus.cc:3055] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:11.898257 27785 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:11.834299 27872 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.813637 27820 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:11.911844 27785 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.916450 27454 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:11.916985 27454 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:11.917239 27886 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:11.907927 27908 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.918154 27454 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.918931 27908 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.919678 27872 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:11.920010 27454 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.921512 27908 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:11.922137 27965 raft_consensus.cc:3055] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:11.924813 27965 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:11.925745 27965 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.927392 27965 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:11.939316 27966 consensus_queue.cc:1059] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:18:11.942827 27961 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.171s	user 0.000s	sys 0.003s
I20260709 12:18:11.944674 27963 raft_consensus.cc:3055] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:11.945147 27963 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:11.946725 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 224331us
I20260709 12:18:11.947781 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:11.912992 27881 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.949908 27917 consensus_queue.cc:1059] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:11.950402 27820 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.950958 27917 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:11.951592 27917 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:11.952515 27820 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:11.952663 27917 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.945951 27963 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:11.955068 27963 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:11.955268 27898 raft_consensus.cc:3055] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:11.955796 27898 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:11.956871 27898 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:11.961200 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.986833 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:11.987931 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:11.902964 27814 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:11.992990 24062 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:18:11.996529 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.994616 24068 raft_consensus.cc:2393] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:11.960706 27951 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:11.997962 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:11.963223 27898 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:12.004841 24593 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:12.005275 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:11.996085 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:12.006858 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:11.998983 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:12.007814 24065 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.003419 24061 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:12.008596 24061 pending_rounds.cc:85] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 5
I20260709 12:18:12.008905 24061 pending_rounds.cc:107] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:18:12.009192 24061 raft_consensus.cc:2889] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:12.004166 24064 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:12.013504 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:12.012610 23886 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:12.016492 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:12.017992 24068 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:11.992844 27859 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:12.022153 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:18:12.024816 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 215189us
I20260709 12:18:12.025895 23914 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:12.026906 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 215610us
I20260709 12:18:12.027921 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:12.031611 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.038842 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:12.041028 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:12.041597 23996 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:12.042223 27890 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:12.042626 27890 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:12.042974 27890 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:12.045457 24061 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:12.051002 27955 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.296s	user 0.000s	sys 0.004s
I20260709 12:18:12.053046 24036 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.053970 27814 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:12.054626 27814 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:12.054314 27951 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:12.060631 23817 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39296 (request call id 307) took 24784 ms (client timeout 15000 ms). Trace:
I20260709 12:18:12.065776 24069 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:12.066964 23914 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:12.067524 23915 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:12.068102 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:12.068799 23919 raft_consensus.cc:2393] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:12.069319 24596 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:12.073378 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:12.077446 24068 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:12.047803 24061 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:12.082396 24062 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:12.018527 27674 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:12.034114 27889 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:12.104955 23960 leader_election.cc:400] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13.
I20260709 12:18:12.105809 23960 leader_election.cc:403] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:18:12.112803 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 81249.4us
I20260709 12:18:12.115329 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:12.117858 27969 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.118605 27725 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:12.120294 27725 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:12.123219 23962 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:12.126447 27814 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.127067 27941 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.127118 27814 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.131078 27935 consensus_queue.cc:1059] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:12.133826 27745 raft_consensus.cc:3055] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:12.134311 27745 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:12.025694 27852 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.134536 27725 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:12.135362 27745 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.136408 27852 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:12.136672 27745 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.137815 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:12.028093 27859 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.141294 27893 consensus_queue.cc:1059] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:12.141747 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:12.142202 27638 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:12.142844 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:12.143235 27859 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:12.143968 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:12.145392 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:12.146509 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:12.147234 27931 consensus_queue.cc:1059] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:12.147655 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:12.149066 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:12.091948 27674 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:12.150528 27674 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.151687 27674 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:12.162052 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:12.162776 24595 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.164649 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:18:12.165400 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.169059 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:12.169854 24068 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:12.147553 27925 consensus_queue.cc:1059] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:18:12.173626 27925 consensus_queue.cc:1243] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer a46beb8868d749fdbaa732dd1ef6b89b log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:12.173687 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:12.174245 27925 raft_consensus.cc:3055] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:12.174655 27925 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:12.175441 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:12.175472 27925 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.177484 27925 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.179445 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:12.180014 23989 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:12.180966 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:12.183353 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:12.185071 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.185285 24035 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:12.188409 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.188742 23993 raft_consensus.cc:2393] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:12.190986 27702 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:12.191753 27875 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:12.193367 27893 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:12.198767 23996 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:18:12.201417 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:12.204134 23915 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:12.194051 27925 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:12.205523 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.200220 24564 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:12.061045 23817 rpcz_store.cc:269] 0709 12:17:47.276001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.276139 (+   138us) service_pool.cc:224] Handling call
0709 12:18:12.060515 (+24784376us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:09.819291 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:09.820147 (+   856us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:09.820195 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:18:09.820231 (+    36us) tablet.cc:662] Decoding operations
0709 12:18:09.894546 (+ 74315us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:09.894640 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:09.894667 (+    27us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:18:09.895896 (+  1229us) tablet.cc:701] Row locks acquired
0709 12:18:09.895953 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:18:09.896138 (+   185us) write_op.cc:270] Start()
0709 12:18:09.896280 (+   142us) write_op.cc:276] Timestamp: P: 1783599489896068 usec, L: 0
0709 12:18:09.896297 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:18:10.045102 (+148805us) log.cc:844] Serialized 5851 byte log entry
0709 12:18:10.523044 (+477942us) op_driver.cc:464] REPLICATION: finished
0709 12:18:10.795636 (+272592us) write_op.cc:301] APPLY: starting
0709 12:18:10.795871 (+   235us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:10.796316 (+   445us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:10.796465 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:10.851368 (+ 54903us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:10.851779 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 12:18:10.851836 (+    57us) write_op.cc:312] APPLY: finished
0709 12:18:10.852303 (+   467us) log.cc:844] Serialized 107 byte log entry
0709 12:18:10.852510 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:10.852682 (+   172us) write_op.cc:454] Released schema lock
0709 12:18:10.852754 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:10.853211 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:10.853237 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12509,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":269060,"apply.run_cpu_time_us":4985,"apply.run_wall_time_us":57540,"num_ops":15,"prepare.queue_time_us":127929,"prepare.run_cpu_time_us":88010,"prepare.run_wall_time_us":434133,"raft.queue_time_us":163356,"raft.run_cpu_time_us":6583,"raft.run_wall_time_us":93450,"replication_time_us":626578,"spinlock_wait_cycles":60800,"thread_start_us":385617,"threads_started":4,"wal-append.queue_time_us":207251,"wal-append.run_cpu_time_us":16397,"wal-append.run_wall_time_us":1601385}]]}
I20260709 12:18:12.208261 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:12.209507 24034 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.210988 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:12.215603 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:12.223163 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:12.221057 24065 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:12.227876 24068 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:12.213112 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:12.165889 27852 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:18:12.219614 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:12.208334 27922 raft_consensus.cc:3055] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:12.208024 27859 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:12.237169 24061 raft_consensus.cc:2393] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:12.187588 27951 consensus_queue.cc:1059] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:18:12.219982 27889 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:12.223517 27875 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:12.243709 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.280696 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:12.223394 27788 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:12.288729 23993 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:12.238847 27893 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.247007 27951 raft_consensus.cc:3055] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:12.246830 27768 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:12.235383 27932 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:12.202725 27915 consensus_queue.cc:1059] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:18:12.249444 27941 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:12.239161 27922 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:12.295926 27922 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.293216 27893 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.297245 27922 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:12.298893 27893 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:12.234182 27917 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:12.254922 27958 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:12.300577 27958 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:12.300977 27958 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:12.291700 27951 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:12.303118 27951 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.304467 27951 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.304525 27890 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.305785 23912 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:12.255013 27965 raft_consensus.cc:3055] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:12.259166 27966 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:12.261190 27969 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:12.261271 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:12.244856 27814 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:12.264456 27944 raft_consensus.cc:3055] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:12.270891 24061 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:12.275117 27638 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13.
I20260709 12:18:12.313858 27944 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:12.314441 27925 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:12.314832 27944 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.242228 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:12.291574 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:12.261897 27744 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:12.307428 27965 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:12.311419 27881 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:12.317914 24066 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:12.319501 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73471.3us
W20260709 12:18:12.319749 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 58537.2us
I20260709 12:18:12.322484 24035 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.332201 23920 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:12.332605 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.325959 24065 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:12.333905 23917 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:12.336215 24065 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:12.337090 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.338500 24063 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:12.339617 24065 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:18:12.339960 24065 pending_rounds.cc:85] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 9
I20260709 12:18:12.340178 24065 pending_rounds.cc:107] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:18:12.346108 24036 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:12.348376 24065 raft_consensus.cc:2889] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:12.355660 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:12.356333 24593 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:12.360106 27944 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:12.324918 27886 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:12.325204 27932 raft_consensus.cc:697] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:12.371713 24566 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:12.384207 23996 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:18:12.388314 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 110102us
I20260709 12:18:12.403206 23962 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:12.393029 27852 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:12.393699 27879 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:12.327075 27814 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:18:12.400614 27717 raft_consensus.cc:3055] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:12.401975 24595 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:12.363721 27908 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:12.403525 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 52706.1us
I20260709 12:18:12.348501 27904 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:12.410719 23886 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:12.356616 27917 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:12.392347 27958 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.363523 27889 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:12.410892 27904 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:12.417210 27904 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.348040 27919 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:12.368748 27970 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.412432 27884 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:12.440263 27884 raft_consensus.cc:697] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:12.442385 27932 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.406358 27454 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:12.405148 27852 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:12.409243 27717 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:12.408349 27872 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:18:12.462889 27872 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:12.462491 27717 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.463272 27872 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:12.463917 27717 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:12.464183 27872 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.465413 27872 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:12.441519 27884 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.369167 27976 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:18:12.435441 27965 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.467608 27965 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:12.470971 27890 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:12.485167 27852 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.429368 27919 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:12.529243 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 101121us
I20260709 12:18:12.426708 27898 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:18:12.467618 27958 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:12.552486 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.553264 24593 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:12.529785 27835 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:12.557380 27985 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:18:12.557042 27835 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.559269 27835 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:12.533058 27919 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:12.534581 27904 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:12.444686 27970 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.571113 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:12.554114 27852 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:12.574119 27835 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:12.585249 27970 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:12.595459 27835 consensus_queue.cc:1243] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer 71a48f59ff764d249519c6a53ec57f02 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:18:12.631665 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 223724us
I20260709 12:18:12.684504 24068 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:12.685070 24068 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:12.696703 27881 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:12.698715 27908 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:12.696774 27835 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.700017 27835 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:12.706952 27919 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.714876 24068 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.702067 27835 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:12.779894 27835 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:12.780629 27835 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.784210 27835 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:12.721486 27919 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:12.867646 27905 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:12.868430 27905 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.888482 27872 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:12.889274 27872 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:12.890328 27944 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:18:13.166512 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.147964 27835 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:12.890905 27944 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:13.228721 24070 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.014s	sys 0.014s
W20260709 12:18:13.229450 24070 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.014s	sys 0.015s
I20260709 12:18:13.210397 27785 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:13.225265 27835 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:13.314687 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 123547us
I20260709 12:18:13.262445 27905 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.334266 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 622) took 1195 ms. Trace:
I20260709 12:18:13.335036 23919 rpcz_store.cc:276] 0709 12:18:12.138862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.139003 (+   141us) service_pool.cc:224] Handling call
0709 12:18:12.143137 (+  4134us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:12.182670 (+ 39533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.182710 (+    40us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:12.208256 (+ 25546us) log.cc:844] Serialized 78 byte log entry
0709 12:18:12.407584 (+199328us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:13.323860 (+916276us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.333787 (+  9927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.333901 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:13.333952 (+    51us) raft_consensus.cc:1685] finished
0709 12:18:13.333967 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.334182 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26689,"prepare.queue_time_us":916132,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":42518,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":9941,"thread_start_us":144483,"threads_started":1,"wal-append.queue_time_us":235471}
I20260709 12:18:13.341763 27999 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.290999 27971 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:13.342691 27999 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.346725 27872 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.349279 27971 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.371579 28003 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.375558 27944 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.408221 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:13.381880 28003 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.414958 28010 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.415555 28010 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.422346 27999 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.412575 27835 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.425019 28003 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.426211 27971 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.417987 28010 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:13.427498 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 109928us
I20260709 12:18:13.452118 28013 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.452732 28013 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.455174 28013 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.456930 27969 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:13.457396 27969 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:13.458020 23960 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.168s	user 0.015s	sys 0.016s
W20260709 12:18:13.458410 23960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.017s	sys 0.016s
I20260709 12:18:13.458626 27969 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:13.462908 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 1.17318e+06us
W20260709 12:18:13.527417 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.527932 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.529421 28016 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.530036 28016 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.532048 28016 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.532506 28016 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.533020 28016 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.535647 28016 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.536139 28016 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:13.536633 28016 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.539016 28016 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.539901 28016 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.540364 28016 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.542358 28013 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:13.542312 28016 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.542938 28013 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.546885 28013 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:13.581453 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 1.1782e+06us
I20260709 12:18:13.582242 23962 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:13.620131 28015 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.620790 28015 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.622923 28015 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.623376 28015 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.623868 28015 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.625869 28015 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.626569 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:13.627789 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:13.628340 24065 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:13.629158 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:13.629702 24065 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:13.630119 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:13.631657 28009 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:13.632337 28009 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.631917 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:13.632786 28009 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.633375 24065 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:13.640477 27999 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.641256 27999 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.637611 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:13.642867 24566 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:13.643827 27999 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.644402 27999 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:13.644717 27999 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.645258 27999 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.646466 28011 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.647094 28012 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.647009 28011 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.647647 28012 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.649673 28012 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.650008 28012 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.651854 28009 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.651886 28012 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.654910 28011 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:13.643744 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.657204 28009 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.659402 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:13.660154 24065 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.657289 28006 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.660440 28007 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.663483 28006 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.659740 28009 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.663762 28007 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.662408 28013 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.664983 28013 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.666062 28007 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.658349 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.666832 24599 raft_consensus.cc:2368] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:13.667079 28013 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.661880 28012 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.668205 28009 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.669039 28006 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.671408 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:13.671785 28009 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.672052 24064 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:13.674839 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:13.675593 24064 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:13.676697 24035 leader_election.cc:400] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:13.676826 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:13.677207 24035 leader_election.cc:403] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:13.677482 24066 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:13.679198 28012 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.683143 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:13.684329 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:13.685108 28006 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:13.685482 28006 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.685858 28006 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:13.689690 28013 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:13.687119 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.693524 28013 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.693902 24592 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:13.693972 28013 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:13.696064 28016 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.696620 28016 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.687264 24065 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:13.690594 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.704140 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:13.705901 28016 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.706415 28016 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.688485 27999 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.706874 28016 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.709040 27999 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.709182 28016 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.703073 28015 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.710500 28015 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.712391 28015 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.709731 28016 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.712970 28012 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:13.713032 28016 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.719632 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.722977 28016 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.724465 28016 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:13.725700 28016 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.726928 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:13.727880 27999 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:13.728741 24067 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.734040 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.734921 28006 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.737839 28006 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.739912 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:13.740619 24066 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:13.729817 27999 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:13.743929 27999 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.745558 24067 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:13.753436 24066 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:13.761498 27975 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.728798 28016 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.762072 27975 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.762879 28016 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.764242 27975 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.765504 28016 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.768110 28016 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.768707 28016 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.769263 28016 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.769840 28018 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.770507 28018 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.770789 28013 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.772125 24593 raft_consensus.cc:2368] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13.
I20260709 12:18:13.773458 28018 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.776530 28013 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.781082 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2139) took 1472 ms. Trace:
I20260709 12:18:13.781441 24061 rpcz_store.cc:276] 0709 12:18:12.316293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.316463 (+   170us) service_pool.cc:224] Handling call
0709 12:18:12.341167 (+ 24704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.358526 (+ 17359us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:12.358552 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.359007 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:18:13.672460 (+1313453us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b1800403060. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75c07fa4bc 00007f75bdb4848b 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1
0709 12:18:13.672608 (+   148us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:13.672642 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.672706 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:13.776707 (+104001us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b1800403060. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:13.780836 (+  4129us) raft_consensus.cc:1685] finished
0709 12:18:13.780860 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.781004 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16974,"raft.queue_time_us":17175,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":21125,"spinlock_wait_cycles":52068992,"thread_start_us":43212,"threads_started":1,"wal-append.queue_time_us":29464}
I20260709 12:18:13.785786 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:13.786621 24061 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:13.787863 28018 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.788486 28018 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.791025 27859 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.791698 27859 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.795589 27859 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.795523 28018 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.796327 28018 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.796825 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.795616 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2353) took 1649 ms. Trace:
I20260709 12:18:13.800072 23914 rpcz_store.cc:276] 0709 12:18:12.146421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.146535 (+   114us) service_pool.cc:224] Handling call
0709 12:18:12.146832 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.210855 (+ 64023us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.210884 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.221784 (+ 10900us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.317247 (+ 95463us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:12.354423 (+ 37176us) log.cc:844] Serialized 14 byte log entry
0709 12:18:12.389519 (+ 35096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.389598 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:13.791459 (+1401861us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b1800448d80. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:13.794019 (+  2560us) raft_consensus.cc:1685] finished
0709 12:18:13.795337 (+  1318us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.795540 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1009666,"prepare.queue_time_us":39156,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":107171,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8153,"spinlock_wait_cycles":38082304,"thread_start_us":86362,"threads_started":1,"wal-append.queue_time_us":128643}
I20260709 12:18:13.787429 28016 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.809677 28013 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.796818 28018 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.814102 28021 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.814787 28021 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.813083 28016 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.817343 28016 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.817821 28021 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.818434 28021 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.818486 27859 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.819133 27859 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.819466 28016 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.820225 28016 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.820885 28016 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.821431 27859 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.822839 28016 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.823292 28016 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.823745 28016 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.827714 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:13.828557 24595 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 14: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:13.832080 24061 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:13.822029 27859 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.836144 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.836787 24595 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:13.836800 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.839270 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.840329 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.840844 24595 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:13.841553 24592 raft_consensus.cc:2368] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:13.816768 28013 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.844707 28013 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.842727 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.846926 24595 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:13.848497 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:13.849053 24062 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:13.846944 28016 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.852146 28018 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.853256 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.853983 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.853863 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.840123 28021 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.854967 24599 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:13.857686 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.858343 24594 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 5.
I20260709 12:18:13.861814 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.862380 24594 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:13.863035 27702 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.863580 27702 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.864529 28021 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.865646 27702 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.866212 27702 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.867892 27702 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.871958 27717 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:13.842222 27859 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.880035 27859 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.880827 27702 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.882444 27829 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.883024 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:13.884079 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.884716 27900 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:13.885198 27900 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.885598 27900 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.883031 27829 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.888152 27829 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.893959 27900 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.896903 23886 leader_election.cc:400] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:13.897905 23886 leader_election.cc:403] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:13.900444 23886 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:13.901193 28022 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:13.902462 28021 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:13.902863 28021 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.903203 28021 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:13.907485 23914 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:13.909020 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.909446 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.909623 24598 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:13.910151 24596 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:18:13.911590 24036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.026s	sys 0.025s
W20260709 12:18:13.911960 24036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.026s	sys 0.025s
I20260709 12:18:13.912637 24035 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:13.913712 27859 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.914218 27859 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.918565 28010 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:13.915087 28004 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:13.919139 28004 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.919104 28010 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.918565 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:13.920676 23914 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:13.921384 28010 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.916985 28012 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.917599 27881 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.925711 28012 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.925835 27881 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.927090 28022 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:13.927783 28012 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.928069 27881 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.917887 28014 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.929206 28014 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:13.931128 24063 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2113) took 1945 ms (client timeout 2100 ms). Trace:
I20260709 12:18:13.931351 28014 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:13.931516 24063 rpcz_store.cc:269] 0709 12:18:11.986049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.994640 (+  8591us) service_pool.cc:224] Handling call
0709 12:18:13.930949 (+1936309us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400274054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:13.931051 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645321984}
I20260709 12:18:13.918013 24035 leader_election.cc:400] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13.
I20260709 12:18:13.932615 24035 leader_election.cc:403] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:13.932924 24069 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:13.933499 27898 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13.
I20260709 12:18:13.919701 28004 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:13.934541 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2136) took 1884 ms. Trace:
I20260709 12:18:13.934835 23886 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:13.899608 27900 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.934893 24069 rpcz_store.cc:276] 0709 12:18:12.050576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.071695 (+ 21119us) service_pool.cc:224] Handling call
0709 12:18:13.932594 (+1860899us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.933295 (+   701us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.934384 (+  1089us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b5400274050. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:13.934492 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4277330816}
I20260709 12:18:13.935850 27963 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:13.936223 27963 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.936591 27963 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:13.937767 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 473725us
I20260709 12:18:13.925856 27859 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:13.940133 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.940505 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.942525 27744 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.943022 27744 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.944976 27744 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.945381 27744 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.945724 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 363506us
I20260709 12:18:13.946823 23962 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:13.947780 27768 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.948307 27745 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.948688 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:13.948820 27745 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.949312 23987 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:13.949047 27963 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.950604 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:13.951092 27963 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.952008 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:13.952128 23886 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:13.952659 23988 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
W20260709 12:18:13.952896 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 370196us
I20260709 12:18:13.953457 27992 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.953580 27900 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:13.954383 27900 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:13.954061 27992 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.954811 27900 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:13.956210 27992 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.956738 27992 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.957227 27992 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.958380 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:13.958540 27915 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.958946 27726 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.959177 27915 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.959445 27726 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.960373 27914 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.960475 27893 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:13.960984 27893 raft_consensus.cc:697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:13.960918 27914 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.961329 27726 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.958958 24593 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.962417 27638 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:13.961997 27893 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.962965 27914 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.963140 27725 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:13.963687 27725 raft_consensus.cc:697] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:13.964504 27725 consensus_queue.cc:237] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.958413 27901 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:13.966588 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:13.966871 27901 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.968932 27901 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.969964 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:13.970711 23916 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:13.961194 27915 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.974198 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:13.974926 23990 raft_consensus.cc:2393] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:13.948323 27768 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.977947 27768 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:13.978597 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:13.979028 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:13.979588 24591 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:13.962942 27638 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.981540 27944 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.981685 24593 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:13.982175 27638 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:13.982048 27944 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.983588 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:13.984305 24591 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:13.984583 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:13.984804 28002 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.985321 28002 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.987303 28002 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:13.973425 27969 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:13.991528 24591 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:13.993826 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:13.915361 24566 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:13.995054 27905 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:13.995795 27905 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:13.996584 27905 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.997023 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:13.997836 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:13.998085 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:13.998453 23921 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:13.998510 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:13.999109 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:13.998629 23916 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:14.000360 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.000674 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.000959 23912 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:14.001390 23918 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:14.002022 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:13.994984 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 79688us
I20260709 12:18:14.006314 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:14.007035 27881 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:14.007622 27881 raft_consensus.cc:697] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:14.008313 27975 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:14.008530 27881 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.009057 27975 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.009769 24068 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.011426 27975 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.012043 27975 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.012566 27975 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:13.985342 23990 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:14.015501 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.017431 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:14.017634 27745 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.018801 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.018905 27975 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.019676 23918 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:14.020763 27909 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:14.021288 27909 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:14.022194 27909 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:13.961937 27726 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:18:14.027148 27915 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:14.027611 27915 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:14.028373 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 61850.4us
I20260709 12:18:14.021099 27963 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:14.028625 27915 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.029753 27938 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:14.029917 27915 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:14.030262 27938 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.030807 27938 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.034634 27944 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:14.039533 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.039783 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.039892 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.040298 23992 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:14.041213 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.041944 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.043152 27992 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.044665 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:14.045941 27881 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:14.046411 27881 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:14.046604 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:14.047266 27881 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.053452 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:14.056039 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.058014 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.058172 23815 catalog_manager.cc:5697] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:13.946847 28004 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.068953 28004 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:14.069542 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.071092 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:13.945847 27744 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.075053 23988 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:14.076894 23993 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:14.077044 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.079376 23987 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
I20260709 12:18:14.084426 28021 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.075021 27900 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.110472 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.125721 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.127023 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.127899 24069 raft_consensus.cc:2368] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
I20260709 12:18:14.086127 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.125579 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.087512 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.106930 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.088181 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.130569 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.130952 23990 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:14.089624 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.090783 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.091657 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.132133 23992 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:14.092519 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.133015 23994 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:14.093202 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.094049 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.134799 23913 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
W20260709 12:18:14.137225 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 190471us
I20260709 12:18:14.095101 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:14.096017 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.091766 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:14.139025 23912 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:14.140269 28022 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:14.140838 28022 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.143287 28022 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.144752 23912 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:14.098683 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.099388 24063 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:14.145498 28022 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:14.093204 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.101063 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.101866 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.146149 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.121196 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.146740 23988 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:14.147373 24063 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:14.104571 24593 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:14.147579 24062 raft_consensus.cc:2393] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:14.122169 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.148633 24066 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 13: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:14.146132 28022 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.149545 23914 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:14.151425 28022 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.124496 24068 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:18:14.146464 23917 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:14.152544 28022 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.121750 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.152999 28022 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.153910 24067 raft_consensus.cc:2368] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:14.155627 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.156466 24061 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 13: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:14.130314 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.157397 24064 raft_consensus.cc:2368] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
I20260709 12:18:14.157788 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:14.158645 23915 raft_consensus.cc:2393] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 6: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:14.158588 24596 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:14.155627 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.158170 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.160694 24069 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:14.155054 23918 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:14.155689 27919 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:14.165006 23886 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:14.166134 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.166797 24070 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
W20260709 12:18:14.167393 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 60579.8us
I20260709 12:18:14.168185 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.168398 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.160228 23993 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 15.
I20260709 12:18:14.168404 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.154874 24068 pending_rounds.cc:85] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 10
I20260709 12:18:14.170434 24068 pending_rounds.cc:107] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:18:14.172334 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.172564 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.173142 23993 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:14.174795 27744 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.174970 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.175665 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.176736 24566 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.173117 24591 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:14.178422 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.176502 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.170722 24068 raft_consensus.cc:2889] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:14.179217 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.128963 27969 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.184307 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.179241 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:14.182142 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.182088 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.180568 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.179841 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.179930 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:14.186347 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.187645 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 776) took 1503 ms. Trace:
I20260709 12:18:14.187808 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:14.176786 27963 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:14.178776 27875 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:14.312353 27963 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:14.172014 27725 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.216652 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.315317 24064 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
W20260709 12:18:14.314767 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 134907us
I20260709 12:18:14.315877 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.316525 24065 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:18:14.317567 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.180714 27881 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:14.318260 23918 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
W20260709 12:18:14.317765 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 138040us
I20260709 12:18:14.277530 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.319787 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.173524 27992 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:14.322227 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.315615 24068 rpcz_store.cc:276] 0709 12:18:12.683664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.683855 (+   191us) service_pool.cc:224] Handling call
0709 12:18:12.684325 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:13.890830 (+1206505us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b180009e820. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c8d646 00007f75c0bc758e 00007f75c0c48f9e 00007f75c0c4a7de 00007f75c0c54b49 00007f75c0c55416 00007f75c0c51d8f 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4
0709 12:18:14.009381 (+118551us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b58004cb5d0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0bae0aa 00007f75c0c30447 00007f75c0c48fe7 00007f75c0c4a7de 00007f75c0c54b49 00007f75c0c55416 00007f75c0c51d8f 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4
0709 12:18:14.181959 (+172578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.187012 (+  5053us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2964758016}
I20260709 12:18:14.322973 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:14.333513 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 154378us
W20260709 12:18:14.203545 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.175719 28011 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.324486 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.325747 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.169858 27905 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.111s
I20260709 12:18:14.339624 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.340255 23991 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:14.263731 28014 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.313484 27963 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.328464 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.317365 24566 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.327383 23914 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:14.330583 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.154937 28022 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.157229 27900 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.175884 27951 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.317632 23815 catalog_manager.cc:5697] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 2 to 4, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 4 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.254036 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.188433 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:14.368861 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 51561.9us
I20260709 12:18:14.369200 23994 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:14.369298 24069 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:14.333869 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.182313 27829 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:14.313329 27725 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:14.217203 27917 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 12:18:14.178916 28002 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.338733 23921 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:18:14.327368 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.178975 27889 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.178905 27911 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:14.341432 24599 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:14.182523 27924 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.168022 27944 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.164s
I20260709 12:18:14.388360 27924 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.291424 27785 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.389372 27785 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.375943 27814 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:14.390563 27924 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.391356 27785 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.253326 24596 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:14.187281 27859 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:14.345175 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.291718 27744 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:14.325349 28007 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:14.348062 23961 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:14.395493 27924 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:14.395794 27744 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:14.396274 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 48281.7us
I20260709 12:18:14.396955 27924 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:14.397815 27744 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.198710 27909 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:14.400019 27909 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.402010 27909 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.326818 27875 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:14.349205 23960 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.351771 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.352917 24067 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
W20260709 12:18:14.404354 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 55245.9us
I20260709 12:18:14.404913 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:14.405107 27717 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:14.405282 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:14.405546 27717 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.405897 27717 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:14.406410 23960 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.407969 27922 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:14.408371 27922 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:14.408749 27922 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:14.363215 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 195018us
I20260709 12:18:14.341306 27768 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:14.410854 27768 raft_consensus.cc:697] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:14.410936 24564 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.411793 27768 consensus_queue.cc:237] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:14.412410 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.835s (SENT) [suppressed 13 similar messages]
I20260709 12:18:14.412671 28007 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:14.413110 28007 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:14.370227 23990 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:14.380838 27898 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:14.364646 27938 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.365798 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:14.372841 23815 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 3 to 4, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 4 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:14.414752 24065 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:14.327569 27969 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.415643 27938 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.349905 28014 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.416862 27969 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.378041 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.417855 24064 raft_consensus.cc:2410] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:18:14.379207 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.338577 27992 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.418434 28014 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:14.344077 28011 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.418960 23993 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:14.419252 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.420006 27992 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:14.377266 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49972us
I20260709 12:18:14.420799 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.421834 24036 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.422461 28010 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:14.422857 28010 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.423200 28010 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:14.423780 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.424382 23914 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:14.427351 24061 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:14.428102 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:14.428730 23919 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:14.367681 27925 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:18:14.385515 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.386371 28002 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.367774 27901 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:18:14.429692 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.390964 27814 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.373008 28021 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.430392 23918 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:14.217422 28028 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.431195 28002 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:14.431104 28028 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.431728 27993 consensus_queue.cc:1059] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:14.432493 27993 consensus_queue.cc:1243] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer 71a48f59ff764d249519c6a53ec57f02 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:18:14.381157 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.392633 23912 raft_consensus.cc:1240] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:14.394356 27859 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:14.395093 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:14.395423 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.433266 28028 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.433979 28028 raft_consensus.cc:3055] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:14.371948 27829 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:14.434448 27829 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.349850 24068 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:14.435460 27859 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:14.356225 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.438388 28013 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:14.438957 28002 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:14.439083 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.439564 28002 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.440042 23992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0740227aa014467da8e8269927b1cfda"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:14.440604 23992 raft_consensus.cc:606] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:14.440914 23992 raft_consensus.cc:614] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:14.441784 28002 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.414050 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.372519 27905 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:14.429842 23988 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:14.444108 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.449142 23915 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:14.449270 23988 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:14.385349 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.433175 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.442649 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.442624 23990 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:14.435386 28009 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:14.420285 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.457269 23996 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:14.406543 27915 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:14.444280 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.457793 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:14.403146 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.384156 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:14.458570 24593 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:14.445478 24035 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:14.446055 23886 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:14.446213 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.459733 23918 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:14.447705 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:14.451548 23991 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:14.451704 23994 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:14.432816 27814 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.461925 23989 raft_consensus.cc:2393] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 14: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:14.445514 23960 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.454398 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:14.444931 23987 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:14.465760 24595 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:14.461577 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.473438 24594 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:14.411806 27725 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.450172 28028 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:14.420312 28011 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:14.450793 27905 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.372918 27951 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.477142 23990 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:14.456642 28009 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:14.456730 28014 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:14.451072 27901 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.480476 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.394009 27889 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.487545 24595 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:14.470767 28021 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:14.481530 24036 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.502161 23886 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:14.502401 27901 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.476442 28007 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.504040 27909 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:14.504571 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.504822 28007 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.490443 28028 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.506199 28028 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:14.506785 24068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:14.507351 24068 raft_consensus.cc:606] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:14.507664 24068 raft_consensus.cc:614] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:14.470466 27898 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:18:14.467326 24017 debug-util.cc:398] Leaking SignalData structure 0x7b080010a180 after lost signal to thread 22723
I20260709 12:18:14.508661 27898 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.509106 27898 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:14.509497 24017 debug-util.cc:398] Leaking SignalData structure 0x7b08000824a0 after lost signal to thread 23853
I20260709 12:18:14.480821 27814 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:14.510635 27814 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.504524 27909 raft_consensus.cc:697] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:14.514166 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.516733 24594 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:14.518739 24017 debug-util.cc:398] Leaking SignalData structure 0x7b0800082300 after lost signal to thread 23945
W20260709 12:18:14.519200 24017 debug-util.cc:398] Leaking SignalData structure 0x7b08002db1e0 after lost signal to thread 23946
W20260709 12:18:14.520666 24017 debug-util.cc:398] Leaking SignalData structure 0x7b08003a7c20 after lost signal to thread 24020
W20260709 12:18:14.521044 24017 debug-util.cc:398] Leaking SignalData structure 0x7b08002deb80 after lost signal to thread 24021
W20260709 12:18:14.523602 24017 debug-util.cc:398] Leaking SignalData structure 0x7b080030e6c0 after lost signal to thread 24094
I20260709 12:18:14.512964 27814 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:14.483191 27905 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:14.599215 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 85144.6us
I20260709 12:18:14.601495 24036 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.509970 27922 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.532049 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
W20260709 12:18:14.606624 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 50242.6us
I20260709 12:18:14.480912 28002 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:14.593816 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 122514us
I20260709 12:18:14.489429 27875 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:18:14.569087 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.490751 28014 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:14.548168 24017 debug-util.cc:398] Leaking SignalData structure 0x7b0800396540 after lost signal to thread 24095
I20260709 12:18:14.596158 28004 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:14.491576 28009 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:14.504639 27901 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.524566 28011 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.513566 28021 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:14.622504 24017 debug-util.cc:398] Leaking SignalData structure 0x7b08002bca60 after lost signal to thread 24624
I20260709 12:18:14.647162 23988 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:14.647324 24017 debug-util.cc:398] Leaking SignalData structure 0x7b0800225ea0 after lost signal to thread 24625
I20260709 12:18:14.648317 23993 raft_consensus.cc:606] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:14.599519 27969 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.602448 27917 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.649298 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.653204 23960 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.654013 23960 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.654870 27638 consensus_queue.cc:1059] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:14.655195 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.594587 27702 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:18:14.611001 27944 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:18:14.650619 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 238206us
I20260709 12:18:14.653956 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.673386 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.650103 23993 raft_consensus.cc:614] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:14.602905 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 221789us
I20260709 12:18:14.674746 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:14.613734 27875 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.616986 28014 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.646842 27963 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.655958 27638 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:14.676009 23887 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.625097 28004 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:14.681200 28004 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:14.682400 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 81019.5us
I20260709 12:18:14.684202 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.664923 27915 raft_consensus.cc:3055] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:14.648196 27919 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.669517 27893 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:14.663429 28021 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:14.693542 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.668941 27944 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.667769 27992 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:14.680066 27785 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:14.697216 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.610584 27909 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.678681 28026 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:14.700968 23996 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:14.743399 23996 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:14.663257 28022 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:14.682251 27965 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:14.709154 27893 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.666823 27975 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:14.791441 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 107351us
I20260709 12:18:14.717767 27785 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.794484 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.715444 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.715672 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.687719 28016 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:14.723157 27900 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:14.717968 23995 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:14.665165 27969 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.693101 27963 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.695513 27915 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:14.702078 27919 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.664994 27917 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.804891 28054 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:14.812275 28054 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.678484 27875 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:14.813545 27898 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.748618 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.814555 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.815307 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.815707 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.816569 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.776168 27965 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.750221 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.817224 27965 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:14.818061 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.819303 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.820123 24065 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:14.820902 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.751631 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.753280 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.822618 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.823122 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.823549 28047 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:14.823940 24066 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:14.824021 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:14.765836 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.717492 27971 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:14.825451 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.825855 27971 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 14 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:14.826719 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.826894 27971 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.717293 27944 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:14.776134 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.717041 27992 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.725344 27814 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
W20260709 12:18:14.796284 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 121617us
I20260709 12:18:14.796541 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.838905 23915 raft_consensus.cc:2368] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13.
I20260709 12:18:14.839705 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.797204 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.797600 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.798686 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.842373 23920 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:14.843264 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.843312 24034 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:14.685187 27638 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:14.798875 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.800009 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.844091 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:14.844641 23921 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:14.845870 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.799324 27785 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:14.801746 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.794780 27975 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:14.699909 28010 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.854463 28058 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.854966 28058 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.855297 28010 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:14.808532 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.856738 28058 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:14.856679 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 48220us
I20260709 12:18:14.857414 28058 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:14.858003 28058 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:14.858171 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:14.846122 27992 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:14.809614 28026 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:14.858462 28058 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.858651 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.810452 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.858974 28058 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.859320 23917 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:14.860198 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.861202 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.861740 23917 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:14.813022 28054 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:14.816326 27717 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.813567 27917 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:14.816759 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.824892 28047 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:14.868518 23912 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:14.754640 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.738358 28002 raft_consensus.cc:697] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:14.827359 23916 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:14.831640 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.833787 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:14.846669 27889 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:14.836033 24069 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
I20260709 12:18:14.790736 27893 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:14.841320 23919 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:14.840371 23915 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:14.797606 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.849298 24063 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:14.885097 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.852497 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.886049 23921 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:14.887012 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:14.887091 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.887645 23912 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:14.888154 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.885686 23915 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:14.889302 23913 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:14.889389 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.889876 24594 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:14.801280 27829 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:14.848515 27638 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:14.863188 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.891530 23914 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:14.892526 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.801520 27900 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:14.805253 27951 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:14.895149 23989 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:14.896291 23913 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:14.865752 23887 leader_election.cc:400] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
I20260709 12:18:14.783334 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:14.897868 23913 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:14.881765 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.862587 27975 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:14.898427 23887 leader_election.cc:403] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:14.858918 28026 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:14.839771 27859 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:14.908519 24069 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:18:14.913671 28016 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:14.913331 27744 consensus_queue.cc:1059] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:18:14.914601 28051 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:18:14.869752 28047 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:14.876387 27922 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:14.884243 28008 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:14.921626 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:14.901896 27900 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:14.944880 24070 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:14.932940 28047 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:14.999953 23919 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:18:15.000645 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 122155us
I20260709 12:18:15.001590 23962 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:14.937131 28008 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.881145 27915 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.025367 27768 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:15.032398 27717 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:15.082796 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 81327us
I20260709 12:18:15.085697 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:15.096365 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:15.020141 28008 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:15.104454 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:15.104743 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:15.108145 28048 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:15.107544 23919 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:15.110002 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:15.107524 27717 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:15.196372 27905 consensus_meta.cc:287] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.583s	user 0.006s	sys 0.006s
I20260709 12:18:15.196870 27905 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.119217 27768 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:15.197916 24598 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:15.198570 24598 raft_consensus.cc:2368] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:15.119040 23962 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:18:15.208611 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 89693.8us
I20260709 12:18:15.209661 23962 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:15.210433 23912 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:15.215749 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:15.216995 23996 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:15.284087 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 446071us
I20260709 12:18:15.286990 24564 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:15.298367 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:15.299805 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:15.000422 28002 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.260368 27889 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.281216 27768 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:15.282495 27963 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:15.282305 27898 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:15.352703 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:15.378589 23990 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:15.380759 23912 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:15.337222 27993 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:15.396593 28010 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:15.397087 28010 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:18:15.400393 28043 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.736s	user 0.000s	sys 0.006s
I20260709 12:18:15.354880 27768 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:15.415551 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 549878us
I20260709 12:18:15.416733 27889 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:15.417135 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 573843us
W20260709 12:18:15.417783 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 130930us
I20260709 12:18:15.419119 27889 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:15.418972 28062 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:15.388655 27971 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:15.417331 27965 consensus_meta.cc:287] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.600s	user 0.039s	sys 0.028s
W20260709 12:18:15.422583 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 213024us
W20260709 12:18:15.426955 28009 consensus_meta.cc:287] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.764s	user 0.030s	sys 0.018s
I20260709 12:18:15.422128 23887 leader_election.cc:400] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:15.435487 23887 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:15.428210 24066 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.003s	sys 0.005s
W20260709 12:18:15.437700 24066 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.003s	sys 0.005s
W20260709 12:18:15.430051 23960 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.022s
W20260709 12:18:15.438452 23960 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.006s	sys 0.022s
W20260709 12:18:15.438815 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 561763us
W20260709 12:18:15.419921 28011 consensus_meta.cc:287] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.756s	user 0.014s	sys 0.015s
I20260709 12:18:15.445024 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:15.454123 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:15.447037 23914 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:15.451151 28016 consensus_meta.cc:287] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 12:18:15.458809 28066 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:15.451655 28009 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.459363 28066 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.461426 28066 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:15.462003 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.427630 27859 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:15.465461 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:15.467870 28058 consensus_meta.cc:287] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.608s	user 0.016s	sys 0.011s
I20260709 12:18:15.468328 28058 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.428627 27969 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:15.470664 27829 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:15.469643 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:15.420933 27768 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:15.474301 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:15.482878 23887 leader_election.cc:400] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
I20260709 12:18:15.483335 23887 leader_election.cc:403] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:15.420701 27905 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:15.397991 28010 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.498250 23919 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:15.505040 24596 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:18:15.480293 28014 consensus_meta.cc:287] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.009s
I20260709 12:18:15.452826 27963 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:15.482081 28011 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:15.490927 27992 consensus_meta.cc:287] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.632s	user 0.004s	sys 0.009s
I20260709 12:18:15.472772 28016 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
W20260709 12:18:15.488664 27909 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.007s	sys 0.004s
I20260709 12:18:15.482244 28022 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:15.519385 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:15.484416 28061 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:15.437340 27965 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.492142 27969 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:15.556751 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 71365.1us
I20260709 12:18:15.561223 24067 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:15.562855 23917 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:18:15.523662 27909 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.008s	sys 0.005s
I20260709 12:18:15.574033 23996 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
W20260709 12:18:15.559762 27785 consensus_meta.cc:287] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.695s	user 0.029s	sys 0.014s
I20260709 12:18:15.528241 28022 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.556615 28010 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:15.616185 23918 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:15.620029 23996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:15.560797 27859 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:15.621327 28046 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.011s	sys 0.064s
W20260709 12:18:15.621845 28046 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.011s	sys 0.065s
I20260709 12:18:15.621260 27859 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.624014 27859 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:15.560009 27963 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
W20260709 12:18:15.625775 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 66374.2us
I20260709 12:18:15.561509 28011 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:15.627753 23960 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:15.620589 23996 raft_consensus.cc:606] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:15.517212 28014 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:15.628749 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 109489us
I20260709 12:18:15.527875 27992 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.598089 28058 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:15.594950 28016 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:15.633394 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:15.632536 23961 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.000s	sys 0.014s
I20260709 12:18:15.616003 28022 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:15.637570 28016 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:15.637959 23961 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.001s	sys 0.014s
I20260709 12:18:15.637760 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:15.645270 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:15.644925 27963 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:15.646960 27963 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.647331 27963 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:15.650539 28074 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:18:15.652523 28085 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:15.653007 28085 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.653383 28085 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:15.633394 28028 consensus_meta.cc:287] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 1.127s	user 0.025s	sys 0.004s
I20260709 12:18:15.661675 23995 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:15.655414 24065 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:15.662149 27717 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:15.659430 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.662747 27717 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:15.663739 27717 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.664599 28066 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:15.665073 28066 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:15.668556 28066 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:15.661499 27935 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:15.636588 27875 consensus_meta.cc:287] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.823s	user 0.012s	sys 0.001s
W20260709 12:18:15.645315 28013 consensus_meta.cc:287] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 1.206s	user 0.022s	sys 0.011s
I20260709 12:18:15.559492 28061 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.671576 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:15.666347 28057 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:15.660989 28008 consensus_meta.cc:287] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.541s	user 0.003s	sys 0.012s
I20260709 12:18:15.674098 23991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 2185) took 1347 ms. Trace:
W20260709 12:18:15.675437 28054 consensus_meta.cc:287] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.800s	user 0.008s	sys 0.005s
I20260709 12:18:15.618460 27785 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:15.676658 28004 consensus_meta.cc:287] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.979s	user 0.010s	sys 0.000s
I20260709 12:18:15.680840 23996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac75053172041f285deb68d4418ed57"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:15.638325 28016 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:15.695206 23989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2431) took 1003 ms. Trace:
I20260709 12:18:15.771986 23996 raft_consensus.cc:606] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:15.773862 23991 rpcz_store.cc:276] 0709 12:18:14.326221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.404673 (+ 78452us) service_pool.cc:224] Handling call
0709 12:18:15.673894 (+1269221us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b54002576d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:15.674015 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90659584}
W20260709 12:18:15.688773 27638 consensus_meta.cc:287] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.773s	user 0.003s	sys 0.005s
W20260709 12:18:15.680070 28047 consensus_meta.cc:287] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.658s	user 0.007s	sys 0.007s
I20260709 12:18:15.635550 28011 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.776598 23989 rpcz_store.cc:276] 0709 12:18:14.691898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.692038 (+   140us) service_pool.cc:224] Handling call
0709 12:18:14.692347 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:14.904521 (+212174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.694839 (+790318us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400257bd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:15.695105 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465817344}
W20260709 12:18:15.692962 27900 consensus_meta.cc:287] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.702s	user 0.006s	sys 0.008s
W20260709 12:18:15.684038 27919 consensus_meta.cc:287] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.846s	user 0.028s	sys 0.021s
I20260709 12:18:15.689175 27971 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.796638 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:15.802553 23994 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:15.786762 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:15.788033 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:15.779740 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 208509us
I20260709 12:18:15.799381 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:15.772327 28013 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:15.702594 27922 raft_consensus.cc:3055] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:15.804940 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:15.805274 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:15.805586 23921 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:15.805532 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:15.803785 23993 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:15.708174 28057 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:15.807749 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:15.774930 28004 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.684249 27909 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.124s
I20260709 12:18:15.683405 27875 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.694778 27768 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.775970 28008 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.779166 28054 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:15.863920 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 57666.1us
I20260709 12:18:15.933785 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:15.934825 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:15.938869 23996 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:15.808736 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:15.873140 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:15.864076 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 56089.7us
W20260709 12:18:15.862946 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 52636.8us
I20260709 12:18:15.868762 24599 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:18:15.949841 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:15.946259 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:15.952078 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:15.962895 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:15.920300 27944 consensus_meta.cc:287] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 1.071s	user 0.021s	sys 0.012s
I20260709 12:18:15.796195 28088 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:15.965051 24064 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:15.965030 23991 raft_consensus.cc:1240] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:18:15.808845 27725 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.968555 24061 raft_consensus.cc:2393] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:18:15.952148 27975 consensus_meta.cc:287] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.030s	user 0.011s	sys 0.007s
I20260709 12:18:15.939280 28057 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:15.863075 27951 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.862862 27745 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:15.805254 27919 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.798377 27638 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.887770 27965 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:15.807406 28058 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:15.966877 23808 maintenance_manager.cc:419] P b335f82e70ec42589bee8577eecf648f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033344
I20260709 12:18:15.803107 27900 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.947427 28007 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.973922 27725 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.952270 27922 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:15.802949 28022 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:15.802696 28047 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:15.994122 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.025904 23993 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.000470 23996 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:15.967231 27702 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:16.004062 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 376368us
W20260709 12:18:15.997792 28026 consensus_meta.cc:287] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 1.070s	user 0.012s	sys 0.006s
I20260709 12:18:15.972818 27969 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:16.030580 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.021430 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:15.869733 27994 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.281s
W20260709 12:18:16.089807 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 126944us
I20260709 12:18:16.090934 24034 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:16.006944 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 201297us
W20260709 12:18:16.094157 24070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 2265) took 1912 ms (client timeout 2082 ms). Trace:
I20260709 12:18:16.095886 23993 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:15.967916 27944 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:16.094894 24070 rpcz_store.cc:269] 0709 12:18:14.181745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.181873 (+   128us) service_pool.cc:224] Handling call
0709 12:18:16.093988 (+1912115us) spinlock_profiling.cc:243] Waited 629 ms on lock 0x7b540010ed54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:16.094093 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1445870976}
I20260709 12:18:16.097899 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.002074 27992 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.020773 28048 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:16.107458 24595 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:15.975682 27975 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:16.099992 28021 consensus_meta.cc:287] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.373s	user 0.019s	sys 0.002s
I20260709 12:18:16.084852 27702 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.113963 24598 raft_consensus.cc:1240] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:16.116359 24596 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:16.085180 27969 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.996714 27951 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.097075 28026 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.120157 28070 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.120635 28079 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.170s
I20260709 12:18:16.124645 27969 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.127521 27917 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:16.131440 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 2187) took 1795 ms. Trace:
I20260709 12:18:16.196399 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:18:16.132064 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 994) took 1729 ms (client timeout 2137 ms). Trace:
W20260709 12:18:16.197714 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 106918us
W20260709 12:18:16.135223 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.137621 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.137701 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:16.139006 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.140684 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:16.142198 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.143527 23915 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
W20260709 12:18:16.144147 24061 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2156) took 1388 ms (client timeout 1626 ms). Trace:
I20260709 12:18:16.003590 28058 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:16.199807 24061 rpcz_store.cc:269] 0709 12:18:14.756051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.794073 (+ 38022us) service_pool.cc:224] Handling call
0709 12:18:16.143901 (+1349828us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002d3a54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:16.144073 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2511482752}
I20260709 12:18:16.155462 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:16.118712 27702 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:16.201627 24070 raft_consensus.cc:2393] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:16.086144 28007 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.210649 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:16.118139 28011 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.198622 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:16.134791 28061 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:16.197942 24599 rpcz_store.cc:269] 0709 12:18:14.402743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.402909 (+   166us) service_pool.cc:224] Handling call
0709 12:18:16.131857 (+1728948us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54004f0e54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:16.131988 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3242393856}
I20260709 12:18:16.202806 24070 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:16.202097 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:16.158568 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:18:16.202026 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 61402.2us
I20260709 12:18:16.217832 24068 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:16.220392 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.197278 23988 rpcz_store.cc:276] 0709 12:18:14.335680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.463405 (+127725us) service_pool.cc:224] Handling call
0709 12:18:14.463721 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.647697 (+183976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.131173 (+1483476us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b540009a454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:16.131356 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389427584}
I20260709 12:18:16.221334 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:16.222344 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.116357 28094 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.230417 23988 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.144999 27992 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:16.226501 28064 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.239787 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:16.232313 28078 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
I20260709 12:18:16.156536 28028 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:16.235642 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 135079us
I20260709 12:18:16.228924 23887 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.154098 27785 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.135070 28100 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:16.235103 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:16.238440 24596 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:16.134857 28021 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.156383 27909 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 12:18:16.242998 24035 leader_election.cc:400] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:16.254510 24035 leader_election.cc:403] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:16.246470 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:16.232613 28086 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.270s
I20260709 12:18:16.229410 28061 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.235340 27917 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:16.251155 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.233960 28011 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.272276 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.276655 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.152632 27922 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.287416 23919 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:16.278947 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.226500 28099 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:16.278631 24566 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:16.293634 23920 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:16.299809 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.243710 27965 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:16.293778 23913 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:16.303002 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.303879 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.304589 23913 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:18:16.302412 28042 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 1.780s	user 0.000s	sys 0.020s
I20260709 12:18:16.258165 27768 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.295797 28086 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:16.238685 28014 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.316557 28014 raft_consensus.cc:2764] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:18:16.317602 28014 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:16.275954 28010 consensus_meta.cc:287] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 12:18:16.309656 23920 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:16.318861 28010 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:18:16.319469 23920 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2388) took 1501 ms (client timeout 1684 ms). Trace:
I20260709 12:18:16.310922 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.318954 28086 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:16.157238 28070 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:16.320052 23920 rpcz_store.cc:269] 0709 12:18:14.818338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.843025 (+ 24687us) service_pool.cc:224] Handling call
0709 12:18:16.319253 (+1476228us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54000a91d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:16.319382 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3333873536}
I20260709 12:18:16.240486 27992 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.321902 28086 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.324338 27992 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.324736 28086 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.325486 28070 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.312968 23961 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:16.326130 23993 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:16.327001 27992 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:16.335142 27965 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:16.335831 27965 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.338390 27965 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.339049 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:16.339955 23992 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:16.311049 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.242523 28092 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:16.342154 28092 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.344591 28092 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.333943 28009 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:16.350767 24064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2162) took 1542 ms (client timeout 1706 ms). Trace:
W20260709 12:18:16.351336 24064 rpcz_store.cc:269] 0709 12:18:14.808030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.816328 (+  8298us) service_pool.cc:224] Handling call
0709 12:18:16.350517 (+1534189us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540021c0d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:16.350687 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2639319936}
I20260709 12:18:16.355893 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2158) took 1599 ms. Trace:
W20260709 12:18:16.313894 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 71055us
I20260709 12:18:16.318080 28014 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.320667 23917 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:16.360251 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.278312 27917 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.348276 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 998) took 1474 ms. Trace:
I20260709 12:18:16.360996 23912 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:16.356289 24062 rpcz_store.cc:276] 0709 12:18:14.756613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.871363 (+114750us) service_pool.cc:224] Handling call
0709 12:18:14.871591 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.871767 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:14.998153 (+126386us) log.cc:844] Serialized 14 byte log entry
0709 12:18:16.127060 (+1128907us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b180005d820. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:16.354892 (+227832us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b180005d820. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdadfc0a 00007f75c721f219 00007f75bdb67a40 00007f75bdb624e4 00007f75bdb62455 00007f75c464a3c7 00007f75c0c5c9a7 00007f75c0c6c0bf 00007f75c0c6c038
0709 12:18:16.355304 (+   412us) log.cc:844] Serialized 14 byte log entry
0709 12:18:16.355501 (+   197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:16.355558 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:16.355609 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.355690 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.355812 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":866572,"prepare.queue_time_us":1484536,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"raft.queue_time_us":13138,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":43005568,"thread_start_us":538192,"threads_started":2,"wal-append.queue_time_us":558488}
I20260709 12:18:16.362023 24595 rpcz_store.cc:276] 0709 12:18:14.873791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.873912 (+   121us) service_pool.cc:224] Handling call
0709 12:18:14.874164 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:16.107872 (+1233708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.347918 (+240046us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54005c1a54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:16.348159 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2835912448}
I20260709 12:18:16.368598 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.369441 23913 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:16.370934 28109 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:16.298004 28099 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:16.372032 28102 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:16.372155 28099 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:16.372262 24064 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:16.253201 28028 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.382090 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.375154 23993 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:16.291333 27785 consensus_queue.cc:1059] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:18:16.391479 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:16.392822 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.311551 27875 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.396559 23920 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:16.397119 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.398543 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.399152 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.400171 24069 raft_consensus.cc:2368] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:16.293537 28011 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.401070 24062 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:16.277271 28061 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.428995 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.430675 23920 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:16.431629 24064 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:16.375064 28008 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.314392 27919 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.364854 27917 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:16.361675 28014 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:16.238440 28094 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.444301 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2155) took 1688 ms. Trace:
I20260709 12:18:16.314342 27941 consensus_queue.cc:1059] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:18:16.395543 28022 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.394476 27900 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.451786 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.379034 28092 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:16.247840 28064 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.456961 23919 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:16.401404 27725 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:16.401755 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 150698us
I20260709 12:18:16.489012 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:16.461179 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 319033us
I20260709 12:18:16.462442 24064 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:16.401667 27944 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:16.463454 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 184893us
I20260709 12:18:16.404247 28047 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.466380 24062 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
W20260709 12:18:16.455183 28085 consensus_meta.cc:287] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.004s
I20260709 12:18:16.462767 28026 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.444294 27975 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.373013 28087 consensus_queue.cc:1059] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.153s
W20260709 12:18:16.464437 27963 consensus_meta.cc:287] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.813s	user 0.004s	sys 0.007s
I20260709 12:18:16.444796 28002 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:16.487536 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.502415 23913 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:16.503319 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.512146 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2385) took 1696 ms. Trace:
I20260709 12:18:16.492592 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:16.488452 28092 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:16.539183 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:16.469899 27951 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.495234 28058 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.529829 23912 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:16.541926 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.542476 23912 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:16.542626 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:16.530719 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:16.503760 28110 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:18:16.510147 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2375) took 1709 ms. Trace:
I20260709 12:18:16.513696 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2362) took 1718 ms. Trace:
I20260709 12:18:16.532534 23994 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:16.491936 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.526325 23988 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:16.456312 24066 rpcz_store.cc:276] 0709 12:18:14.755746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.824619 (+ 68873us) service_pool.cc:224] Handling call
0709 12:18:14.824905 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:14.841466 (+ 16561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:14.841508 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:14.841984 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.438172 (+596188us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:16.443807 (+1005635us) log.cc:844] Serialized 14 byte log entry
0709 12:18:16.444096 (+   289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.444146 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.444173 (+    27us) raft_consensus.cc:1685] finished
0709 12:18:16.444180 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.444259 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":933027,"prepare.queue_time_us":917096,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":30937,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":681853,"threads_started":2,"wal-append.queue_time_us":726478}
I20260709 12:18:16.536455 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:16.501854 28106 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.553637 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.509428 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:16.533037 23921 rpcz_store.cc:276] 0709 12:18:14.816294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.887944 (+ 71650us) service_pool.cc:224] Handling call
0709 12:18:16.511970 (+1624026us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b54001fed54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:16.512095 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108149632}
I20260709 12:18:16.555029 24595 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.555318 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.555886 23921 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:16.556476 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.556914 23921 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
W20260709 12:18:16.493634 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 53989.8us
I20260709 12:18:16.530576 24591 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:16.557719 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.543998 23913 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:18:16.510772 24065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2153) took 1755 ms (client timeout 2137 ms). Trace:
I20260709 12:18:16.546936 24068 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:16.548070 23915 rpcz_store.cc:276] 0709 12:18:14.801056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.889166 (+ 88110us) service_pool.cc:224] Handling call
0709 12:18:16.509976 (+1620810us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002eca54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:16.510085 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2882306304}
I20260709 12:18:16.494889 28007 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.551568 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:16.563216 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 70653us
I20260709 12:18:16.570938 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:16.574726 28113 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:18:16.577944 28016 consensus_meta.cc:287] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.787s	user 0.005s	sys 0.004s
I20260709 12:18:16.579625 28064 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.580682 28061 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.580778 28094 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.580984 23996 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:16.582187 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.548137 23918 rpcz_store.cc:276] 0709 12:18:14.795480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.795632 (+   152us) service_pool.cc:224] Handling call
0709 12:18:14.795927 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:15.619394 (+823467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.513492 (+894098us) spinlock_profiling.cc:243] Waited 798 ms on lock 0x7b540017b454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:16.513644 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834383744}
W20260709 12:18:16.540805 28096 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.301s	user 0.000s	sys 0.002s
I20260709 12:18:16.581162 28116 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:18:16.587456 23990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2441) took 1374 ms. Trace:
I20260709 12:18:16.514762 28082 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:16.603124 28082 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:16.604206 28066 consensus_meta.cc:287] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.933s	user 0.008s	sys 0.001s
I20260709 12:18:16.604612 28066 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:16.559603 24065 rpcz_store.cc:269] 0709 12:18:14.755179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.820657 (+ 65478us) service_pool.cc:224] Handling call
0709 12:18:16.510597 (+1689940us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b5400266454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:16.510720 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917297024}
I20260709 12:18:16.609273 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.568913 24595 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:16.585245 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:16.501042 27963 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:16.592345 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 100478us
I20260709 12:18:16.593372 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.596709 28058 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:16.597265 28119 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:16.600939 28099 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.566768 28021 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.587793 23990 rpcz_store.cc:276] 0709 12:18:15.213315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.379434 (+166119us) service_pool.cc:224] Handling call
0709 12:18:15.391505 (+ 12071us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:15.415728 (+ 24223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.415866 (+   138us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:15.416423 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:18:15.771090 (+354667us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b180028c480. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:18:16.014301 (+243211us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:16.014364 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.014477 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.587192 (+572715us) raft_consensus.cc:1685] finished
0709 12:18:16.587213 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.587404 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5823,"raft.queue_time_us":82,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":9976,"spinlock_wait_cycles":34587520,"thread_start_us":242921,"threads_started":1,"wal-append.queue_time_us":718177}
I20260709 12:18:16.605943 28007 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.593173 28008 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:16.609992 24066 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:16.588039 24597 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:16.610865 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.498246 28085 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.612151 24592 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:16.613134 23913 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:16.616329 28107 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.616392 28061 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:16.617686 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.660043 24069 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.619056 24061 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:16.617086 28028 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.616665 28120 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 12:18:16.620918 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.621973 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.567132 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:16.626811 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.628222 24036 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:16.612843 28110 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:16.594136 28094 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:16.584560 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.595530 28016 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.627179 28047 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:18:16.635438 28053 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:16.582518 28106 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.636662 28092 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.636884 27702 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.626806 28119 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.640229 27963 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.720119 24063 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:16.720589 24069 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
W20260709 12:18:16.640427 27893 consensus_meta.cc:287] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 1.736s	user 0.009s	sys 0.011s
I20260709 12:18:16.642519 23915 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:16.629151 28009 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:18:16.721833 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:16.642925 28007 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.645435 28014 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.645525 27969 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.728569 28007 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.728889 28104 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.730669 23914 raft_consensus.cc:2368] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:16.732556 28119 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.732800 28014 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.713301 28022 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:18:16.734800 28099 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.655501 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:16.735750 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 80310.8us
I20260709 12:18:16.736696 28064 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:16.737298 28064 raft_consensus.cc:697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:16.737502 28097 raft_consensus.cc:3055] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:16.737876 28097 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:16.619742 28010 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:16.666111 23913 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:16.741454 23913 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:16.676331 23917 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:16.649931 28008 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:16.662552 28057 consensus_meta.cc:287] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.665s	user 0.001s	sys 0.009s
I20260709 12:18:16.681150 28016 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.671742 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:16.676584 28011 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.662739 28082 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.689062 24066 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
W20260709 12:18:16.766654 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 94990.3us
W20260709 12:18:16.716104 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 95250.5us
I20260709 12:18:16.686529 23912 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:16.724279 24070 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:16.684864 28122 raft_consensus.cc:3055] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:16.714540 28058 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:16.713701 27975 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:18:16.728440 27702 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.734925 28022 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:16.648238 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.666105 28107 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.738183 28064 consensus_queue.cc:237] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.756302 27969 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.685086 28061 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:16.687233 28021 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:18:16.758834 27938 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:18:16.813311 27917 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.726956 27893 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.814915 23987 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:16.815778 27893 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.817070 24599 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:16.768476 23913 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:16.819314 24035 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:16.677851 28094 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.772656 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.828311 23988 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:16.773524 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:16.774897 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.829761 23990 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:16.775216 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.830540 23992 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:16.830418 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.784683 24064 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:16.757202 28008 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:16.792183 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.792004 28085 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:16.757185 28014 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.729460 28104 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.806456 28061 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:16.857152 28128 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:18:16.783632 28022 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:16.769788 28122 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:16.769788 27768 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:18:16.785705 28054 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.775321 28058 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:16.804368 28066 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.769953 27944 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:16.768622 27951 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.832370 28107 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:16.832610 27702 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:16.793058 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.868216 24069 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:16.837347 23988 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:16.839216 24066 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:16.838310 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.845033 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:16.852509 23990 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
W20260709 12:18:16.852906 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 66395us
I20260709 12:18:16.831449 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.854101 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.827839 28100 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:16.873270 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.746363 28097 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.876297 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.877254 23996 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:16.877488 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 46123us
I20260709 12:18:16.879416 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.880105 24064 raft_consensus.cc:2368] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:16.880829 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.881022 27638 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:16.881812 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.873708 28100 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:16.885396 24064 raft_consensus.cc:2368] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:16.888535 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.889155 23917 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:16.866734 28058 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:16.890522 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:16.891222 23912 raft_consensus.cc:2368] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12.
I20260709 12:18:16.884886 24036 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:16.895617 24036 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:16.896906 24069 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:16.861462 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.864660 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.848608 27975 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:16.769227 28057 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.849552 28011 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:18:16.870304 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:16.874513 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:16.898360 24065 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:16.898521 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.906926 23918 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:16.860046 28014 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.899564 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.909312 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.897001 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:16.872767 27944 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:16.902849 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:16.883090 28100 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.911878 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:16.909982 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.910600 24566 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:16.911885 23996 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:16.914476 23996 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:16.915372 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:16.915980 23996 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:16.916803 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:16.917095 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:16.918241 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.894742 28054 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:16.919490 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:16.898967 27875 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:16.896723 28007 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:16.898360 28120 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:16.928597 23990 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:16.920881 23920 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:16.919993 23887 leader_election.cc:400] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:16.983063 23916 raft_consensus.cc:2368] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 13. Current term is 14.
W20260709 12:18:16.986557 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 66701.9us
I20260709 12:18:16.987699 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:16.969163 24566 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:16.984427 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.993525 23960 leader_election.cc:400] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12.
I20260709 12:18:16.993825 23960 leader_election.cc:403] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:18:16.994517 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:16.994769 24064 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:16.996729 23887 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:16.999559 23992 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:16.999698 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:17.000854 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:17.001389 23990 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:17.002048 23887 leader_election.cc:400] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:17.002388 23887 leader_election.cc:403] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:18:17.002911 28099 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:17.011147 28099 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:16.912551 28066 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.011948 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:16.900432 28022 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:16.920424 28011 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:16.921767 28060 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:16.871156 27951 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:17.056743 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 58892.5us
I20260709 12:18:17.019920 23917 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:17.053216 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:17.058849 23918 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:17.060226 23887 leader_election.cc:400] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:17.060544 23887 leader_election.cc:403] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:18:17.055722 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 61290.1us
I20260709 12:18:17.054488 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:17.061467 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:16.918022 28125 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:17.062175 24065 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:16.900648 27881 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
I20260709 12:18:16.905222 27975 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:16.921448 28085 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:17.064471 24566 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:17.065678 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.012969 28007 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:17.013669 27963 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:16.919935 28114 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:17.056740 28100 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:17.070911 28047 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:17.061367 28021 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.071475 27944 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.052050 28119 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:17.081135 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:17.069598 27893 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:17.046308 27638 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12.
I20260709 12:18:17.000560 28016 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:17.075124 23918 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:17.066922 28066 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:17.063891 28099 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:17.053431 28059 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:16.985563 27969 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:18:17.060801 28060 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.015661 27875 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:17.013298 28120 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:18:17.078305 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 169026us
I20260709 12:18:17.079589 28125 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:17.114969 23912 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:17.080013 28047 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.081977 28119 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.084798 28057 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:17.078889 27917 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:17.117300 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:17.123442 24036 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:17.113989 28016 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:17.123641 27963 raft_consensus.cc:3055] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:17.131208 27909 raft_consensus.cc:3055] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:17.132220 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2164) took 2259 ms. Trace:
I20260709 12:18:17.133911 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:17.158845 28014 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:17.161271 24070 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:17.161087 24067 rpcz_store.cc:276] 0709 12:18:14.872371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.885167 (+ 12796us) service_pool.cc:224] Handling call
0709 12:18:14.885404 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:15.561944 (+676540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.131900 (+1569956us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b5400265554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:17.132109 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1478960000}
I20260709 12:18:17.162424 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:18:17.163118 23987 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 2440) took 1950 ms (client timeout 1802 ms). Trace:
W20260709 12:18:17.163580 23987 rpcz_store.cc:269] 0709 12:18:15.212978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.213119 (+   141us) service_pool.cc:224] Handling call
0709 12:18:17.162938 (+1949819us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002562d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:17.163056 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3485189888}
I20260709 12:18:17.165568 27909 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:17.166411 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 1156) took 1011 ms. Trace:
I20260709 12:18:17.166611 27963 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:17.166878 24594 rpcz_store.cc:276] 0709 12:18:16.155366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.155484 (+   118us) service_pool.cc:224] Handling call
0709 12:18:16.156623 (+  1139us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:16.345146 (+188523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:16.345180 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:16.345224 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:16.345253 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.166176 (+820923us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54004fd654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:17.166217 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.166360 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433095040}
I20260709 12:18:17.167775 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:17.167543 27963 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.168363 24067 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:17.168730 27963 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:17.169094 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.169477 24067 raft_consensus.cc:1240] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:17.169813 23913 raft_consensus.cc:2368] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:17.171020 28104 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:17.171603 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.171845 27909 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.172922 27909 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.173410 27922 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.116916 28007 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.083452 28114 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:17.177865 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.147468 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:17.178679 23913 raft_consensus.cc:2376] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11. Re-sending same reply.
I20260709 12:18:17.177376 24070 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:17.179744 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.180898 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.149099 23994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 2445) took 1012 ms. Trace:
I20260709 12:18:17.181350 23913 raft_consensus.cc:2368] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13.
I20260709 12:18:17.150377 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.150821 28047 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:17.152309 28120 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.121711 28060 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:17.153597 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.188079 23914 raft_consensus.cc:2393] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:17.084702 27893 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:17.156462 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:17.191679 27726 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:17.114679 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.197286 23918 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:17.198125 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:17.156265 27917 consensus_queue.cc:1059] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:17.157969 27975 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:17.120843 28059 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:17.158654 27889 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:17.160239 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:17.139084 27875 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.166332 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:17.208851 24065 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.182096 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:17.182694 23915 raft_consensus.cc:2393] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:17.087809 28094 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:17.181321 23994 rpcz_store.cc:276] 0709 12:18:16.136248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.199601 (+ 63353us) service_pool.cc:224] Handling call
0709 12:18:17.148920 (+949319us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400098b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:17.149017 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":607332608}
I20260709 12:18:17.189316 24070 raft_consensus.cc:1240] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: [4.4-7.6]
I20260709 12:18:17.187515 28074 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:17.189826 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.214943 28074 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.215557 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:17.216248 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:17.216856 23990 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:17.217195 28074 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:17.208465 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:17.217901 23994 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:17.218400 23914 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:17.192705 28101 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:17.189517 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.219354 23917 raft_consensus.cc:2376] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14. Re-sending same reply.
I20260709 12:18:17.154677 28119 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:17.201023 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:17.203559 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.212280 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:17.182210 28016 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:17.198452 28102 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:17.177350 28114 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.159181 28079 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:18:17.222762 23915 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:17.204742 28059 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.227998 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:17.231690 24070 raft_consensus.cc:2393] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:17.221884 23962 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:17.233062 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:17.233625 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.233845 23912 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:17.229950 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.234584 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:17.236764 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:17.240018 24070 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:17.240777 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:17.241796 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:17.236061 23913 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:17.232558 27914 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:17.221760 27889 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:17.250090 24065 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:17.232592 28102 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:17.251359 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:17.258867 23917 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:17.241842 23962 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:17.244097 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.255756 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.264806 24034 leader_election.cc:400] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:17.267676 23914 raft_consensus.cc:2393] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:18:17.270579 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.256803 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:17.226996 27917 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:18:17.275806 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:17.280052 24034 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:17.280838 27725 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:17.281114 28085 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:17.281379 27725 raft_consensus.cc:697] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:17.281651 28085 raft_consensus.cc:697] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:17.282239 27725 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.282467 28085 consensus_queue.cc:237] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.285531 27889 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.287776 28066 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:17.257488 28132 raft_consensus.cc:2764] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:18:17.300479 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.300979 23917 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:17.301319 23917 raft_consensus.cc:2368] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:17.237735 27638 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:18:17.304029 23962 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:17.305294 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.242666 27938 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:18:17.229825 28101 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.308355 24034 leader_election.cc:400] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13.
I20260709 12:18:17.306690 28053 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.312252 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:17.296336 28057 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:17.323578 23918 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:17.238034 27893 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.310613 28074 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:17.331634 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:17.250764 28125 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.341982 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:17.307646 28094 consensus_queue.cc:1059] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:18:17.338917 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:17.349488 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:17.350126 23917 raft_consensus.cc:2368] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
W20260709 12:18:17.348835 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49400.2us
I20260709 12:18:17.330921 28053 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:17.362116 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:17.362808 24067 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
W20260709 12:18:17.351188 28008 consensus_meta.cc:287] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.000s
I20260709 12:18:17.368947 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.383998 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:17.349164 27859 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:17.384153 23912 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:17.386147 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.325326 28102 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.326905 28057 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.396843 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:17.363878 27917 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.401657 23914 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:17.385346 27859 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.408309 28119 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.404927 27859 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:17.400333 28142 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.389024 28008 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:17.418609 28101 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:17.424198 28004 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:17.413846 28058 consensus_meta.cc:287] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.005s
I20260709 12:18:17.428344 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.428624 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:17.431687 23915 raft_consensus.cc:2410] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:18:17.434013 24069 raft_consensus.cc:2368] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14.
I20260709 12:18:17.437661 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:17.442301 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:17.443071 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:17.451663 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:17.452378 23912 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:17.457656 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.441195 28004 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.455978 27875 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.440412 28048 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:17.449903 28119 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:17.451200 28142 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:17.436887 28058 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.481498 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:17.470585 28048 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:17.494405 28053 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:17.495230 28057 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:17.495515 28058 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:17.503175 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:17.504623 27702 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:17.505119 27702 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:17.467720 28060 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:17.604267 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:17.625761 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 182771us
I20260709 12:18:17.628644 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:17.636042 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.652160 23960 leader_election.cc:400] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 13. Current term is 14.
I20260709 12:18:17.652653 23960 leader_election.cc:403] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:17.653158 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.677691 28085 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.678323 28085 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.680480 28085 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:17.682899 28008 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:17.685297 28094 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:17.685988 28094 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.688426 28094 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:17.688751 28074 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:17.771459 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 142887us
I20260709 12:18:17.772264 24034 leader_election.cc:400] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
I20260709 12:18:17.774768 23990 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
W20260709 12:18:17.785482 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.789110 24034 leader_election.cc:400] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10.
W20260709 12:18:17.709342 28047 consensus_meta.cc:287] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.507s	user 0.010s	sys 0.000s
I20260709 12:18:17.818799 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 701) took 2928 ms. Trace:
I20260709 12:18:17.819468 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:17.826440 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.844823 23987 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:17.852080 23912 raft_consensus.cc:2468] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:17.790264 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:17.843967 23995 rpcz_store.cc:276] 0709 12:18:14.843062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.843529 (+   467us) service_pool.cc:224] Handling call
0709 12:18:14.843803 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:15.662046 (+818243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.770988 (+2108942us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54002aa3d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:17.771167 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1880124160}
W20260709 12:18:17.871508 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 219512us
I20260709 12:18:17.872557 23960 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:17.770751 28016 consensus_meta.cc:287] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.539s	user 0.005s	sys 0.005s
W20260709 12:18:17.884819 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 94654.3us
I20260709 12:18:17.920651 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:17.921352 23912 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:17.924865 23987 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:17.818816 28111 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.938138 27915 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.948288 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:17.949198 24068 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:17.881572 28145 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.910833 28060 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:17.975903 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.926295 28064 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 13. Current term is 14.
I20260709 12:18:17.877180 28047 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.948700 27935 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.948436 28085 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.914933 28016 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:17.980110 28102 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:18.005544 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:18.004187 28085 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.013231 28085 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.004500 28102 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.018826 28102 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:18.023281 28149 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:18:17.992715 28120 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.001559 27935 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.033916 28120 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.035766 27935 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:18.036398 23913 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:18.037328 28016 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:18.033391 27702 consensus_meta.cc:287] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.528s	user 0.006s	sys 0.000s
I20260709 12:18:17.955308 28111 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.050563 28047 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:18.051239 27909 consensus_meta.cc:287] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.878s	user 0.010s	sys 0.003s
W20260709 12:18:18.051327 28059 consensus_meta.cc:287] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.808s	user 0.009s	sys 0.002s
I20260709 12:18:18.055176 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:18.060470 24068 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
W20260709 12:18:18.056829 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 184317us
I20260709 12:18:18.065294 23960 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:18.033428 27859 consensus_meta.cc:287] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.619s	user 0.006s	sys 0.001s
I20260709 12:18:18.064003 28111 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.035776 28120 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.064626 28059 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.060249 27768 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:18.056203 27702 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.087859 23988 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:18.073851 28059 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:18.089576 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:18.074318 27638 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:18.086624 27768 raft_consensus.cc:697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:18.107750 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:18.108688 23912 raft_consensus.cc:2393] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 13: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:18.071935 27859 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.108143 27768 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.094717 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:18.093999 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:18.113890 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.110455 28087 consensus_queue.cc:1059] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:18.123234 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:18.123965 23912 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:18.131491 27702 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.118547 28010 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:18:18.133092 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 824) took 1216 ms. Trace:
I20260709 12:18:18.094791 28142 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.133476 24067 rpcz_store.cc:276] 0709 12:18:16.916682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.364604 (+447922us) service_pool.cc:224] Handling call
0709 12:18:17.364942 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.365242 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.365271 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.383654 (+ 18383us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.676964 (+293310us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:17.677015 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.690908 (+ 13893us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.132867 (+441959us) raft_consensus.cc:1685] finished
0709 12:18:18.132887 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.133034 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21860,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":275002,"threads_started":1,"wal-append.queue_time_us":663809}
I20260709 12:18:18.136262 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:18.116319 28120 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:18.112937 27638 raft_consensus.cc:697] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:18.138520 24067 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:18:18.119124 27744 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:18.139209 27915 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.111071 27935 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:18:18.115427 28101 consensus_queue.cc:1059] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260709 12:18:18.142025 27917 consensus_meta.cc:287] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.736s	user 0.004s	sys 0.007s
I20260709 12:18:18.137720 28064 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.147955 28155 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.174551 28155 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.174563 28094 consensus_queue.cc:1059] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:18.176815 28155 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.179709 27859 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:18.145958 28120 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:18.179275 28102 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.181393 27909 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.193743 28021 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:18.194492 28021 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.182054 28064 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.196844 28064 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.197176 28021 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:18.189682 28016 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:18.198128 24564 connection.cc:256] RPC call timeout handler was delayed by -1.3540644770000654s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 12:18:18.198396 28016 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.199863 24564 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:18.200598 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.205111 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2174) took 1415 ms. Trace:
I20260709 12:18:18.205554 24066 rpcz_store.cc:276] 0709 12:18:16.786934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.787085 (+   151us) service_pool.cc:224] Handling call
0709 12:18:16.787372 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:16.871934 (+ 84562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.202056 (+1330122us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b5400213ed4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:18.202234 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118676224}
I20260709 12:18:18.164713 23912 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:18.162341 23987 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:18.166836 27638 consensus_queue.cc:237] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.146925 27915 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.144132 27744 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.217648 23912 raft_consensus.cc:1240] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:18.209308 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 830) took 1064 ms. Trace:
I20260709 12:18:18.220630 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2599) took 1236 ms. Trace:
I20260709 12:18:18.221014 23912 rpcz_store.cc:276] 0709 12:18:16.983872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.217181 (+1233309us) service_pool.cc:224] Handling call
0709 12:18:18.217465 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.220375 (+  2910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.220571 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:18.212441 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:18.207880 27992 raft_consensus.cc:993] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:18.223866 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:18.222695 24061 rpcz_store.cc:276] 0709 12:18:17.144787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.454601 (+309814us) service_pool.cc:224] Handling call
0709 12:18:17.456363 (+  1762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.456652 (+   289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.456679 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.457122 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.658471 (+201349us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:18.165079 (+506608us) log.cc:844] Serialized 14 byte log entry
0709 12:18:18.208901 (+ 43822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.208976 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.209018 (+    42us) raft_consensus.cc:1685] finished
0709 12:18:18.209032 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.209250 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42323,"raft.queue_time_us":51348,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":5640,"thread_start_us":422688,"threads_started":2,"wal-append.queue_time_us":684099}
W20260709 12:18:18.188268 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.210516 28059 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.138789 28142 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.162099 27917 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:18.216836 24066 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260709 12:18:18.231880 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.186705 23989 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:18.233340 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:18.219110 27744 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:18.219502 27911 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:18.239298 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:18.193831 27909 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.249878 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:18.250700 24066 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:18:18.254245 28102 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.255988 27915 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.257607 28083 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:18.232702 28064 raft_consensus.cc:1081] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:18.271176 23914 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:18.230993 28016 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.275548 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:18.218919 28047 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:18:18.282758 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:18.181106 28120 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.282758 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2582) took 1833 ms. Trace:
I20260709 12:18:18.287003 23920 rpcz_store.cc:276] 0709 12:18:16.449471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.668501 (+219030us) service_pool.cc:224] Handling call
0709 12:18:16.670456 (+  1955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:16.995399 (+324943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.282527 (+1287128us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b54001fd954. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:18.282696 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575513344}
I20260709 12:18:18.284983 24066 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
W20260709 12:18:18.287678 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 56458.7us
W20260709 12:18:18.291494 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 79148.7us
I20260709 12:18:18.292245 24034 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:18.292496 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:18.239450 28059 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.294186 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:18.294987 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:18.278755 28157 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.289690 28016 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.309186 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 831) took 1164 ms. Trace:
I20260709 12:18:18.309789 24068 rpcz_store.cc:276] 0709 12:18:17.145088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.066248 (+921160us) service_pool.cc:224] Handling call
0709 12:18:18.066627 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.067000 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.067037 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.072584 (+  5547us) log.cc:844] Serialized 26 byte log entry
0709 12:18:18.208377 (+135793us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:18.208419 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.208482 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.308862 (+100380us) raft_consensus.cc:1685] finished
0709 12:18:18.308894 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.309109 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5110,"thread_start_us":123425,"threads_started":1,"wal-append.queue_time_us":205519}
I20260709 12:18:18.312405 24068 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:18.287086 27725 raft_consensus.cc:3055] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:18.314493 27725 raft_consensus.cc:740] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:18.315927 27726 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.315614 27725 consensus_queue.cc:260] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.317520 27725 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:18.290057 28058 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:18:18.295776 27917 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:18.298112 28102 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.320732 27917 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.323720 27917 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.305477 28154 raft_consensus.cc:2804] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:18.324867 28154 raft_consensus.cc:697] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:18.326164 28154 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.327082 28142 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:18.327308 23989 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 2194) took 2542 ms (client timeout 2208 ms). Trace:
W20260709 12:18:18.327703 23989 rpcz_store.cc:269] 0709 12:18:15.784408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.808522 (+ 24114us) service_pool.cc:224] Handling call
0709 12:18:18.327098 (+2518576us) spinlock_profiling.cc:243] Waited 2.17 s on lock 0x7b540024f9d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:18.327216 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4989094656}
W20260709 12:18:18.329551 28150 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.239s	user 0.000s	sys 0.000s
I20260709 12:18:18.330305 23991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 2202) took 2225 ms. Trace:
I20260709 12:18:18.330689 23991 rpcz_store.cc:276] 0709 12:18:16.105050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.105188 (+   138us) service_pool.cc:224] Handling call
0709 12:18:18.328819 (+2223631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.329208 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.329237 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:18.329284 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:18.329320 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.329434 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.330129 (+   695us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b540024f9d0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:18.330233 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5112574720}
I20260709 12:18:18.331813 27951 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.335968 27909 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:18.337363 28048 consensus_meta.cc:287] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.837s	user 0.009s	sys 0.001s
I20260709 12:18:18.337687 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:18.337796 28048 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.339143 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:18.339617 24592 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:18.339850 24595 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:18.340548 23994 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:18.341066 24596 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:18.342199 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:18.309262 28157 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.344774 28157 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.344859 24068 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:18.345368 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2414) took 1258 ms. Trace:
I20260709 12:18:18.345760 23915 rpcz_store.cc:276] 0709 12:18:17.086884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.229740 (+142856us) service_pool.cc:224] Handling call
0709 12:18:18.345192 (+1115452us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400159fd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:18.345313 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451888000}
I20260709 12:18:18.346879 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:18.316434 27726 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:18.298991 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:18.347429 23915 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:18.352810 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2422) took 1112 ms. Trace:
I20260709 12:18:18.351467 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:18.298394 24061 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:18:18.364359 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 136377us
W20260709 12:18:18.375512 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 142207us
I20260709 12:18:18.353348 23913 rpcz_store.cc:276] 0709 12:18:17.240446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.243882 (+  3436us) service_pool.cc:224] Handling call
0709 12:18:18.352551 (+1108669us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b5400223b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:18.352717 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784726272}
I20260709 12:18:18.377321 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:18.378417 23913 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:18.379032 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2421) took 1149 ms. Trace:
I20260709 12:18:18.379221 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 2277) took 2001 ms. Trace:
I20260709 12:18:18.379374 23913 rpcz_store.cc:276] 0709 12:18:17.229803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.377960 (+1148157us) service_pool.cc:224] Handling call
0709 12:18:18.378238 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.378785 (+   547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.378974 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:18.379688 24063 rpcz_store.cc:276] 0709 12:18:16.377697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.400143 (+ 22446us) service_pool.cc:224] Handling call
0709 12:18:18.379045 (+1978902us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b5400182254. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:18.379165 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":666987392}
I20260709 12:18:18.380419 24564 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:18.381044 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2426) took 1120 ms. Trace:
I20260709 12:18:18.381417 23913 rpcz_store.cc:276] 0709 12:18:17.261026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.380333 (+1119307us) service_pool.cc:224] Handling call
0709 12:18:18.380592 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.380755 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.380781 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:18.380820 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:18.380851 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.380902 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.380998 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:18.356274 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:18.383051 23913 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: []
W20260709 12:18:18.385934 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.384258 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:18.388636 24564 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:18.389901 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:18.392942 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:18.393548 23920 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:18.394248 23915 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:18.396034 23913 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:18.398813 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:18.399842 27911 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:18.400218 27911 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:18.400557 27911 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:18.405876 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:18.407883 28070 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:18.408565 28070 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:18.409693 28070 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:18.412499 23993 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 2444) took 2276 ms (client timeout 2772 ms). Trace:
W20260709 12:18:18.412964 23993 rpcz_store.cc:269] 0709 12:18:16.135872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.138718 (+  2846us) service_pool.cc:224] Handling call
0709 12:18:18.412335 (+2273617us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400310954. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:18.412445 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291348352}
I20260709 12:18:18.414932 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:18.385628 28021 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:18.417028 28081 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:18.422318 28081 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:18.422842 28081 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:18.390990 28085 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:18.417184 28133 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 1.115s	user 0.011s	sys 0.000s
I20260709 12:18:18.395390 28115 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:18.432919 23920 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:18.352303 28016 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.437932 28016 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.438544 28016 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:18.438902 28016 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:18.439554 23917 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:18.441028 28016 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:18.445070 23920 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:18.445281 27744 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.446605 23920 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:18.417644 27829 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:18.457237 24034 leader_election.cc:336] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.590s (SENT)
I20260709 12:18:18.457739 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:18.388321 28060 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:18:18.458457 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 43597.5us
I20260709 12:18:18.432520 28085 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:18.471117 23920 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:18.475874 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:18.477242 24594 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:18.479210 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:18.460027 27829 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:18.480767 27829 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.457305 28115 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:18.497627 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:18.489020 24597 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:18.490849 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.492439 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.493652 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.494906 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.462201 28154 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:18.499471 24596 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:18:18.502909 23992 raft_consensus.cc:2368] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14.
I20260709 12:18:18.504163 23989 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:18.505306 23993 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:18.509451 23991 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 8: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:18.476276 28085 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:18.514436 28160 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:18:18.516480 27744 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.496300 27924 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:18.517393 27924 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.519562 27924 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.527032 24035 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:18.528643 24035 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:18.530236 27944 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.530351 27917 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:18.514367 28074 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.531436 27944 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.531584 28074 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.532582 27944 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:18.533739 28074 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.543454 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 717) took 1628 ms. Trace:
I20260709 12:18:18.543906 23996 rpcz_store.cc:276] 0709 12:18:16.915285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.997046 (+ 81761us) service_pool.cc:224] Handling call
0709 12:18:16.997367 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.055831 (+ 58464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.055862 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.060609 (+  4747us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.182538 (+121929us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:17.182574 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.182637 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.263388 (+1080751us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:18.543135 (+279747us) raft_consensus.cc:1685] finished
0709 12:18:18.543158 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.543367 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58065,"raft.queue_time_us":58888,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":7032,"spinlock_wait_cycles":13958016,"thread_start_us":111548,"threads_started":1,"wal-append.queue_time_us":162058}
I20260709 12:18:18.545995 28059 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:18.546634 28048 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:18.549662 24035 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:18.550433 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 166186us
I20260709 12:18:18.550678 28168 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.551156 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:18.551266 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.551234 28168 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.552129 23989 raft_consensus.cc:2368] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:18.553220 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.547528 28115 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.555184 28011 raft_consensus.cc:3055] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:18.555578 28011 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:18.556406 28011 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.556869 28122 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.562835 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.563563 23987 raft_consensus.cc:2368] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:18.563939 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.564471 23920 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:18:18.565922 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:18.567694 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.569048 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.569973 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:18.571293 23989 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.499045 27768 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.488493 27992 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.577011 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.582993 23992 raft_consensus.cc:2368] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:18.578729 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.584005 23988 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:18.583925 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:18.580407 23995 raft_consensus.cc:1240] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:18:18.573390 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:18.585517 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.593890 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:18.594637 23996 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:18:18.584823 24597 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:18.595603 23989 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:18.597981 27726 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.604456 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2416) took 1485 ms. Trace:
I20260709 12:18:18.619997 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:18.620451 23912 rpcz_store.cc:276] 0709 12:18:17.119363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.232401 (+1113038us) service_pool.cc:224] Handling call
0709 12:18:18.283080 (+ 50679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:18.288251 (+  5171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.288280 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:18.290565 (+  2285us) log.cc:844] Serialized 26 byte log entry
0709 12:18:18.467574 (+177009us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:18.467638 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:18.467739 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.604190 (+136451us) raft_consensus.cc:1685] finished
0709 12:18:18.604222 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.604385 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2563,"raft.queue_time_us":2673,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2543,"thread_start_us":162140,"threads_started":1,"wal-append.queue_time_us":302839}
I20260709 12:18:18.606765 28016 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.630633 23995 raft_consensus.cc:3055] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:18.562999 28168 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.612953 28114 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:18.567951 28167 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:18:18.622529 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2406) took 1538 ms. Trace:
I20260709 12:18:18.636404 23918 rpcz_store.cc:276] 0709 12:18:17.084141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.197874 (+113733us) service_pool.cc:224] Handling call
0709 12:18:18.622384 (+1424510us) spinlock_profiling.cc:243] Waited 99.5 ms on lock 0x7b54000f0ad4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:18.622478 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228833536}
I20260709 12:18:18.620222 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.637974 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.638700 23988 raft_consensus.cc:2368] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:18.624118 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:18.628165 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:18.631984 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:18.631126 23995 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:18.622614 28122 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:18.573092 28154 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.581715 28011 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:18.634683 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:18.592242 27909 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.633335 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:18.640743 23995 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.645975 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:18.646523 28168 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:18.574748 28081 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.615275 27768 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.615978 27992 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:18.839248 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.927626 23992 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:18.928645 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:18.929378 23992 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:18.654992 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:18.649719 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:18.824555 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.931583 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 181073us
W20260709 12:18:18.738427 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.931651 24062 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:18.947593 23995 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:18.963637 24062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2180) took 2144 ms (client timeout 1616 ms). Trace:
W20260709 12:18:18.964041 24062 rpcz_store.cc:269] 0709 12:18:16.788866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.817277 (+ 28411us) service_pool.cc:224] Handling call
0709 12:18:18.649438 (+1832161us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b5800133e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:18:18.933296 (+283858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10162432}
W20260709 12:18:18.979274 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.636204 28021 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:18.956713 27911 consensus_meta.cc:287] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
I20260709 12:18:18.639938 27900 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:18.860673 28094 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.807775 27717 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:19.002830 27717 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:19.003566 28166 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.493s	user 0.000s	sys 0.001s
I20260709 12:18:19.005008 27717 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.971040 27915 consensus_queue.cc:1059] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:18:19.005235 28021 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.008441 28087 raft_consensus.cc:3055] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:19.008837 28087 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:19.009579 28087 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:18.641672 28114 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.013101 28114 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.647814 27726 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.014551 28154 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:19.015138 28154 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.017310 28154 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:18.997548 27911 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.023626 24595 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:19.024791 28176 consensus_queue.cc:1059] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:19.026412 27951 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:19.026942 27951 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.028982 27951 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.029639 28173 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:18.880193 28100 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:18.998378 24594 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:18.880874 28170 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:18.994567 27969 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:18:19.010767 28087 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:18.969523 27909 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:18.637611 28175 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:18.920125 27829 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.058203 23996 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:19.065076 24067 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:18:19.063050 27726 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:18:19.071097 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:19.072176 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:19.072715 23996 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:19.072813 27992 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.073534 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:19.051254 27911 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.075122 24067 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:19.047068 28028 consensus_queue.cc:1059] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:18:19.041675 27900 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.078477 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:19.051746 27717 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:18:19.080862 24063 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:19.046578 28094 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.080400 28028 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:19.084276 27768 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.086201 28016 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.061086 28074 consensus_queue.cc:1059] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:18:19.092000 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:19.092796 28157 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.093142 28085 consensus_meta.cc:287] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.000s
I20260709 12:18:19.098664 24066 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.052263 28100 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.054025 28170 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.097883 28028 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:19.101229 28168 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:19.080170 28175 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.073827 27909 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.124698 28170 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.125501 27893 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.102497 28085 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.128911 28085 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.102053 28157 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.111163 28168 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:19.136523 28028 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.139791 28028 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:19.144155 28081 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:19.122903 28175 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.151641 28175 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.146418 28168 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:19.187752 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 541741us
I20260709 12:18:19.189668 23886 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:19.194761 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:19.196082 23918 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:19.197817 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:19.201462 23918 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:19.200611 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:19.206563 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:19.207536 23917 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:18:19.193961 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:19.210472 23913 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:18:19.199376 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:19.213354 23919 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:19.095248 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:19.216380 23996 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:19.218214 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:19.228364 23996 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:19.257122 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:19.279633 27900 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.282578 27829 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:19.289090 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.289680 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 100341us
I20260709 12:18:19.265808 28100 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:19.295490 27889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.007s	user 0.004s	sys 0.024s
I20260709 12:18:19.285672 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:19.307575 24034 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.297780 27889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.009s	user 0.004s	sys 0.024s
W20260709 12:18:19.308660 24069 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 2286) took 2488 ms (client timeout 2156 ms). Trace:
W20260709 12:18:19.319708 24069 rpcz_store.cc:269] 0709 12:18:16.820397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.897637 (+ 77240us) service_pool.cc:224] Handling call
0709 12:18:19.308135 (+2410498us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54001b80d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:19.308423 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198447488}
I20260709 12:18:19.301286 28170 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:19.322480 28170 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.323279 27768 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:19.323565 24065 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:19.323791 27768 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:19.325373 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 828) took 2405 ms. Trace:
I20260709 12:18:19.303829 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:19.325183 27768 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.327536 27768 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:19.330005 28100 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:19.325409 28170 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.332798 23887 leader_election.cc:400] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:19.333179 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 845) took 2803 ms. Trace:
I20260709 12:18:19.333441 23887 leader_election.cc:403] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:19.333582 24599 rpcz_store.cc:276] 0709 12:18:16.529602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.529782 (+   180us) service_pool.cc:224] Handling call
0709 12:18:16.816755 (+286973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:16.817401 (+   646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.332758 (+2515357us) spinlock_profiling.cc:243] Waited 287 ms on lock 0x7b54005b0250. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:19.332972 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":659190016}
I20260709 12:18:19.334863 28021 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:19.335644 23887 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.337860 28170 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:19.337774 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:19.307585 24064 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2181) took 2518 ms (client timeout 2216 ms). Trace:
I20260709 12:18:19.338342 28170 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.338758 23913 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:19.338907 28170 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.306917 23994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2464) took 1826 ms. Trace:
I20260709 12:18:19.325745 24065 rpcz_store.cc:276] 0709 12:18:16.925999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.398189 (+472190us) service_pool.cc:224] Handling call
0709 12:18:19.322834 (+1924645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.324013 (+  1179us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.325126 (+  1113us) spinlock_profiling.cc:243] Waited 1.91 s on lock 0x7b5400070b50. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:19.325290 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4395127680}
W20260709 12:18:19.338673 24064 rpcz_store.cc:269] 0709 12:18:16.789170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.902568 (+113398us) service_pool.cc:224] Handling call
0709 12:18:19.307019 (+2404451us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b5400070b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:19.307282 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194158848}
I20260709 12:18:19.297664 28016 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.355567 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:19.339743 23994 rpcz_store.cc:276] 0709 12:18:17.480217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.480407 (+   190us) service_pool.cc:224] Handling call
0709 12:18:17.488592 (+  8185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:18.341009 (+852417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.305745 (+964736us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b5400311d54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:19.306094 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958754688}
I20260709 12:18:19.360785 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:19.361478 23994 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:19.361661 23996 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:19.362422 23996 raft_consensus.cc:2410] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 11 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:19.362854 28097 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.363554 23994 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:19.305199 28094 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.366818 28016 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.369285 28016 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.376770 23994 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:18:19.376643 23886 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:19.377951 27904 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.379906 28164 log.cc:927] Time spent T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.911s	user 0.003s	sys 0.008s
W20260709 12:18:19.381490 28171 log.cc:927] Time spent T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.907s	user 0.003s	sys 0.005s
I20260709 12:18:19.381592 28021 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.383275 28100 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.385658 28173 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.388388 28106 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.395346 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:19.403461 24066 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:19.403546 27904 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.404101 28085 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:19.405361 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 64092.8us
I20260709 12:18:19.405938 28016 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:19.370134 28157 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:19.406816 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:19.409053 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:19.418396 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 95169.9us
I20260709 12:18:19.423921 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:19.433954 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:19.374151 28061 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.436208 28011 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:19.436897 28011 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:19.436789 28061 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.438266 28011 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.443969 27904 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.439525 28061 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:19.436170 27944 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:19.441972 28021 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:19.425740 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.421523 23913 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:19.402123 23918 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:19.441851 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:19.445875 28022 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:19.472247 23912 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:19.432754 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:19.442993 24036 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:19.476740 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.477550 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:19.441597 28100 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.485966 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:19.487979 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:19.489643 27944 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:19.493913 23913 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:19.494647 23988 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
W20260709 12:18:19.494767 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 51842us
I20260709 12:18:19.495373 28064 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.495707 24036 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.495923 28064 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.497136 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.497816 28157 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.498458 28157 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.498945 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:19.505404 23987 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:19.508805 23994 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:19.514796 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2593) took 2626 ms. Trace:
W20260709 12:18:19.514972 24070 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2186) took 2318 ms (client timeout 1849 ms). Trace:
W20260709 12:18:19.515321 24070 rpcz_store.cc:269] 0709 12:18:17.196701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.241582 (+ 44881us) service_pool.cc:224] Handling call
0709 12:18:19.506804 (+2265222us) spinlock_profiling.cc:243] Waited 2.12 s on lock 0x7b5400071554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:19.514800 (+  7996us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4868370816}
I20260709 12:18:19.515218 23921 rpcz_store.cc:276] 0709 12:18:16.887782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.912387 (+ 24605us) service_pool.cc:224] Handling call
0709 12:18:16.991924 (+ 79537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:17.079145 (+ 87221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.079192 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:17.079421 (+   229us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:17.079475 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.507783 (+2428308us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b5400320854. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:19.514377 (+  6594us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.514607 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200086400}
I20260709 12:18:19.516573 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:19.517027 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:19.517198 23992 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:19.519517 28165 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 1.044s	user 0.004s	sys 0.000s
I20260709 12:18:19.520646 27788 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:19.521404 27788 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:19.522943 23990 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 2465) took 2041 ms (client timeout 1719 ms). Trace:
I20260709 12:18:19.523314 23913 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:19.523622 23918 raft_consensus.cc:2393] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 14: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:19.524488 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:19.525276 23918 raft_consensus.cc:1240] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:19.525547 23994 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.526892 28157 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:19.529937 23995 consensus_meta.cc:287] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.582s	user 0.019s	sys 0.014s
I20260709 12:18:19.530830 23995 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:18:19.531210 23995 pending_rounds.cc:85] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 5
I20260709 12:18:19.531443 23995 pending_rounds.cc:107] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:18:19.531742 23995 raft_consensus.cc:2889] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:19.533526 23995 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:18:19.534570 27922 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:18:19.484913 28173 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.536469 23914 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:18:19.536803 23914 pending_rounds.cc:85] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 5
I20260709 12:18:19.537025 23914 pending_rounds.cc:107] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:18:19.537289 23914 raft_consensus.cc:2889] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:19.537405 28173 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.500228 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:19.526943 23991 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:19.541893 28061 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:19.543939 28061 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:19.543977 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 64673.9us
I20260709 12:18:19.544436 28061 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:19.547895 28100 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.548575 28100 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:19.549724 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:19.516607 28021 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.552175 28120 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:19.552634 28120 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:19.553014 28120 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:19.523416 23990 rpcz_store.cc:269] 0709 12:18:17.481063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.481236 (+   173us) service_pool.cc:224] Handling call
0709 12:18:19.522517 (+2041281us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400067cd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:19.522710 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477013760}
I20260709 12:18:19.554136 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:19.550498 28178 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.555603 28178 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.557212 23990 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:19.557752 23996 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:19.555083 23915 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:19.558051 23919 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:19.559355 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:19.560344 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.560802 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:19.518153 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:19.560845 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.562944 28154 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.569207 27829 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.550602 23993 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 6.
I20260709 12:18:19.571470 23886 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:19.561821 23921 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:19.576450 23992 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:19.569877 23994 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
W20260709 12:18:19.584002 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.590958 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 44663.9us
I20260709 12:18:19.579383 23915 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:19.590698 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.591157 23988 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
W20260709 12:18:19.613977 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.597293 23919 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:18:19.589037 23921 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:18:19.618193 24594 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:19.621088 23991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 2215) took 1045 ms. Trace:
I20260709 12:18:19.609755 23918 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:19.594880 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.623497 23912 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:19.580446 27788 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.626113 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 2213) took 1060 ms. Trace:
I20260709 12:18:19.592902 28011 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:19.626551 23987 rpcz_store.cc:276] 0709 12:18:18.565433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.565589 (+   156us) service_pool.cc:224] Handling call
0709 12:18:19.621457 (+1055868us) spinlock_profiling.cc:243] Waited 822 ms on lock 0x7b54002571d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:19.626045 (+  4588us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1890017664}
I20260709 12:18:19.622634 23991 rpcz_store.cc:276] 0709 12:18:18.575668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.575804 (+   136us) service_pool.cc:224] Handling call
0709 12:18:19.526532 (+950728us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:19.542004 (+ 15472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.620886 (+ 78882us) spinlock_profiling.cc:243] Waited 950 ms on lock 0x7b5400067cd0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:19.621033 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2185405184}
I20260709 12:18:19.628795 23915 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:19.621519 27904 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.629781 27904 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.603322 28168 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.627095 28011 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.634259 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.635258 24591 raft_consensus.cc:1240] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:18:19.635689 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.637293 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.637471 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.631589 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.621809 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.596405 23960 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:19.632323 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 2.729s (SENT) [suppressed 37 similar messages]
I20260709 12:18:19.632177 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.638566 27904 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.591013 28100 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:19.586452 28154 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.611162 28178 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.596588 28097 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.600303 28064 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.655038 23919 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:18:19.651520 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 74321.2us
I20260709 12:18:19.656833 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.643093 28011 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.662643 24600 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:19.587781 27829 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.682881 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:19.656152 28097 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.687065 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.645740 27922 consensus_queue.cc:1059] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:18:19.693114 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.694569 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.695955 27919 consensus_queue.cc:1059] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:19.696502 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:19.696910 27911 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:19.697220 28154 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:19.696446 24594 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:19.701275 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.701385 28115 raft_consensus.cc:3055] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:19.701829 28115 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
W20260709 12:18:19.703217 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.687139 28157 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:19.706727 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.685232 28064 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:19.689368 28011 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.714545 23819 catalog_manager.cc:5697] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 5 to 6, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:19.716671 23819 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 8 to 10, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 10 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:19.718760 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 122640us
W20260709 12:18:19.720196 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:19.720892 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.710664 28059 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:18:19.707994 28157 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:19.711869 28115 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.735311 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.722539 23819 catalog_manager.cc:5697] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 7, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 7 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:19.718472 28081 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:19.748625 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.750591 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.731202 28111 raft_consensus.cc:3055] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:19.754513 24595 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:19.753820 28061 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.760555 27938 raft_consensus.cc:3055] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:19.751631 27922 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:19.770371 27944 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:19.733325 28157 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:19.714542 28011 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.772519 28111 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:19.777416 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:19.731751 28154 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:18:19.782176 24070 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:19.733987 28170 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.781442 28011 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:19.783684 23916 raft_consensus.cc:2393] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:19.774958 27938 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:19.786140 27938 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.787549 27938 raft_consensus.cc:3060] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:19.788018 28061 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.789449 28100 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:19.789485 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.790380 28100 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.790835 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.790637 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.791507 24599 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 6.
I20260709 12:18:19.791934 24591 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eac75053172041f285deb68d4418ed57"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37694
I20260709 12:18:19.792671 24591 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:19.793054 24591 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:19.792775 24595 raft_consensus.cc:2393] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:19.793849 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.794134 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:19.794576 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.792994 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.794960 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.795663 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.796270 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.796685 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.796780 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.797309 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.792681 28100 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.798077 24593 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 13: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:19.798375 28097 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.798681 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.799732 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.800437 24599 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:19.800978 24591 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.801316 28097 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:19.814848 23920 raft_consensus.cc:2410] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260709 12:18:19.815214 24598 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:19.799099 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:19.816679 28154 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:19.817087 24591 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.817271 28154 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.819219 28170 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:19.819357 28154 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:19.778028 28060 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:18:19.820731 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:19.821677 24595 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:18:19.801079 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:19.781245 28111 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.812144 24035 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:19.813901 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:19.839515 27889 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:19.840305 27889 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.841460 28011 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:19.842000 28011 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:19.842800 27889 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:19.843041 28011 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.844935 28111 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:19.845996 28154 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:18:19.848696 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 76517.1us
W20260709 12:18:19.864197 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 50074.5us
I20260709 12:18:19.868875 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:19.825711 28081 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:19.869518 24599 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:19.872504 27726 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:19.873891 27911 consensus_queue.cc:1059] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:19.874408 24566 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.875982 27911 raft_consensus.cc:3055] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:19.876466 27911 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:19.877590 27911 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.881351 27911 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.882553 28115 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.884529 28048 consensus_queue.cc:1059] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:19.885823 28048 raft_consensus.cc:3055] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:19.886164 28048 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:19.887180 28048 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.888445 28048 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:19.890007 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 141486us
I20260709 12:18:19.892598 28154 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:19.892755 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 80838.1us
I20260709 12:18:19.893148 28154 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:19.893644 28154 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:19.894657 27889 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:19.895236 27889 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:19.895495 24035 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:19.902402 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:19.903000 24595 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.903633 23886 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:19.864887 28097 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:19.904474 23961 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:19.910565 28122 consensus_queue.cc:1059] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:19.911373 27889 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:19.911579 28199 log.cc:927] Time spent T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:18:19.911978 27889 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:19.912174 28087 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:19.916218 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 115320us
I20260709 12:18:19.942402 28168 consensus_queue.cc:1059] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:18:19.951354 28168 raft_consensus.cc:3055] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:19.951771 28168 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:19.952775 28168 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.920199 28170 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:19.955601 28097 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.957398 27829 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:19.907011 28106 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:18:19.926213 27726 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:19.962682 28081 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:19.963537 23960 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.965293 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.966331 27726 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:19.966859 27726 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:19.967054 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 96505.7us
I20260709 12:18:19.968139 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.969372 23961 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:19.954140 28168 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.966526 28124 raft_consensus.cc:3055] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:19.972419 28159 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:19.972600 28124 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:19.972898 28159 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.973291 28159 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:19.973825 28124 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:19.974923 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.975416 28124 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:19.977113 23961 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:19.974447 27938 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:19.978104 27938 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.967279 27726 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:19.978379 28100 consensus_queue.cc:1059] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:19.983259 28178 raft_consensus.cc:3055] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:19.983700 28178 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:19.987222 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:19.971917 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:19.991290 24595 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:19.917390 28087 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.919658 28061 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:20.009406 23886 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:20.015107 28087 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:19.984659 28178 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.019481 28178 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:19.978502 27938 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:20.021314 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 53305.5us
I20260709 12:18:19.995666 27922 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:20.026616 28203 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.053s	user 0.004s	sys 0.003s
I20260709 12:18:20.016921 28170 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:20.017894 28100 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:18:20.027429 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 132191us
W20260709 12:18:20.044464 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 152602us
I20260709 12:18:20.044823 28100 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.023005 28064 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:20.058632 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 184336us
I20260709 12:18:20.043143 27768 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:20.084295 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 107331us
I20260709 12:18:20.054522 28100 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:20.087407 24036 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:20.098227 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.049567 28170 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:20.090474 28106 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:18:20.100608 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.101018 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:20.101117 28106 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:20.101768 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.101907 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.103765 23991 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:18:20.104136 23991 pending_rounds.cc:85] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 7
I20260709 12:18:20.104374 23991 pending_rounds.cc:107] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:18:20.104596 23991 raft_consensus.cc:2889] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:20.105566 24566 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:20.109637 23988 raft_consensus.cc:2410] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:20.114094 28100 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.116612 28100 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.117982 28106 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:20.118517 28106 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.118597 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.118978 28106 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:20.077174 27904 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:18:20.126888 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.085273 27768 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:20.067571 28205 raft_consensus.cc:2764] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:18:20.138674 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.142477 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.142753 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.132761 27768 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:20.172509 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.184384 23994 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:20.091449 28154 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.189411 23992 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:20.190065 28212 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:20.191298 28212 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:20.148646 28170 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.192286 28212 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.202759 27944 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:20.203263 27944 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:20.204247 27944 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.205442 27944 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:20.217947 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 322218us
W20260709 12:18:20.224872 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 133590us
W20260709 12:18:20.225426 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 124458us
W20260709 12:18:20.228200 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 121001us
I20260709 12:18:20.224392 27904 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:20.228044 28122 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:20.259780 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.266616 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.280596 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.282948 23819 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 8 to 12, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 12 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:20.293766 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 195374us
I20260709 12:18:20.289441 23819 catalog_manager.cc:5697] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.233160 28209 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:18:20.293164 24600 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
W20260709 12:18:20.297539 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 59668.8us
I20260709 12:18:20.235533 28087 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:20.300218 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 47575.4us
I20260709 12:18:20.246897 28157 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.303956 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:20.307925 24594 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:20.312700 28210 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.313241 28210 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.323547 28210 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:20.324156 28210 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.324673 28210 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.333262 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:20.319931 28120 consensus_meta.cc:287] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.766s	user 0.006s	sys 0.007s
I20260709 12:18:20.336653 24070 raft_consensus.cc:2393] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:20.294852 28122 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.339135 28120 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.346474 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.347961 28120 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.355053 23819 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 5 to 8, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 8 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.359447 28087 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.361248 28157 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.365669 27922 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:20.366425 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.367332 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:20.367601 24065 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:20.357625 23819 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 9, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 9 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.372193 23819 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 11, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.385668 23992 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:20.346570 28213 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:20.374467 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 56698.9us
W20260709 12:18:20.382395 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.384500 28064 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:20.397360 24594 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:20.339861 28154 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:20.399456 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 58678.7us
I20260709 12:18:20.399493 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
W20260709 12:18:20.402750 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 67244us
I20260709 12:18:20.407645 24035 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:20.405922 23819 catalog_manager.cc:5697] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.412048 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.408744 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.413849 23987 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:18:20.415670 23993 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:20.400785 28210 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:20.382014 28106 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.404796 28168 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:20.340469 28217 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:18:20.425031 23990 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:20.429029 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.427908 23990 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:20.436256 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.437350 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.438766 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.439152 24064 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:20.439584 24066 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:20.440649 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.440884 24069 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:18:20.441444 24062 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:20.442116 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:20.442584 28122 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.442957 24061 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:20.418713 28048 consensus_meta.cc:287] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.006s
I20260709 12:18:20.446601 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.456360 23987 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:20.458837 24068 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:18:20.460377 23815 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39310 (request call id 312) took 40674 ms (client timeout 15000 ms). Trace:
I20260709 12:18:20.409214 28213 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.449719 23819 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 8 to 10, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 10 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:20.465281 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 44128us
I20260709 12:18:20.466425 24065 raft_consensus.cc:2393] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:20.471014 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:20.471596 23992 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:20.444164 28154 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:20.474828 23990 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.472406 28212 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:18:20.476928 23990 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:20.472294 28205 consensus_queue.cc:1059] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:18:20.478415 28216 consensus_queue.cc:1059] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:20.479589 28216 consensus_queue.cc:1243] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer ef0dd15ac654478b8371c22b8909240e log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:18:20.446327 28168 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:20.481045 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.486953 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:20.480285 28097 consensus_queue.cc:1175] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71a48f59ff764d249519c6a53ec57f02" responder_term: 10 status { last_received { term: 9 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:20.489005 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:20.490644 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:20.492122 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:18:20.493016 28159 consensus_meta.cc:287] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.002s
I20260709 12:18:20.493456 28159 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.493587 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:20.494566 24594 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:20.495250 27922 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:20.495867 27922 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:20.497797 28106 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:20.444468 27768 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.498184 27829 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:20.498867 27829 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:20.499555 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:20.499989 27768 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.500123 23914 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:20.500795 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:20.501148 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:20.501417 23916 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:20.501785 23920 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:20.501814 28064 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.503489 28064 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.498134 28087 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:20.505918 28064 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:20.506781 27917 raft_consensus.cc:3055] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:20.486887 28048 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:20.523010 28159 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:20.523658 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.524304 28111 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:20.507359 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.525652 24068 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:20.478504 28205 raft_consensus.cc:3055] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:18:20.509490 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 173467us
I20260709 12:18:20.510686 23996 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:20.518736 23989 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:20.519223 27938 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.518787 23819 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.512379 27917 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:20.520804 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.521452 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.522655 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:20.528267 24070 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:20.530036 24065 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:20.555016 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:20.556309 23960 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:20.556475 24063 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:20.558329 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.561097 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:20.561645 23912 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:20.563108 23960 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:20.565009 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.522894 28216 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:18:20.569352 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:20.530517 28205 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:20.496956 27922 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.557963 28097 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.577648 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:20.588114 23920 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:20.470243 27726 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.578394 23819 catalog_manager.cc:5697] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 6, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 6 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.524869 28111 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.579119 23915 raft_consensus.cc:1240] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:20.486444 27889 consensus_queue.cc:1059] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:18:20.591922 23990 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
W20260709 12:18:20.585372 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 58245.9us
I20260709 12:18:20.560866 28106 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:20.587992 23914 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:20.569229 28159 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:20.569519 28048 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:20.597791 23992 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:20.598198 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.601663 23996 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:18:20.595731 28209 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:20.606762 28209 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.587441 28210 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.609890 23819 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 7 to 8, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 8 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.615978 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.617869 23990 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:20.618848 23995 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:18:20.618906 24063 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:20.621863 28220 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:20.622375 27938 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.622433 28220 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.624887 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.625749 24065 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:20.625957 24066 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:20.626446 24070 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:20.626521 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:20.626947 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.627238 24065 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:20.628794 24062 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:20.621865 28221 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.629276 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:20.629691 28221 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.630005 28154 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:20.631708 28157 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.631909 28221 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.632406 28221 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:20.632233 28157 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.632490 28218 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:20.632907 28221 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.633280 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:20.634220 28157 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:20.635533 28011 raft_consensus.cc:3055] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:20.630168 24069 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:18:20.636142 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 82500.9us
I20260709 12:18:20.638470 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.639669 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.640667 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.638521 28011 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:20.641402 28111 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.641836 28011 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.642498 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.643148 28011 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:20.643553 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.643651 24069 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:20.619707 28215 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.647454 28215 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:20.638556 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 83231.4us
I20260709 12:18:20.649600 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:20.649632 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.611148 27917 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.651316 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.641781 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.608614 28168 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.652927 24065 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260709 12:18:20.652948 23991 raft_consensus.cc:2368] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14.
I20260709 12:18:20.653146 28122 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:20.653849 28157 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:20.625073 28220 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.609115 28048 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.664708 28048 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:20.664803 28122 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:20.667909 24067 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:20.669674 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.664713 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.670796 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:20.671743 28213 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:20.670884 23991 raft_consensus.cc:2376] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13. Re-sending same reply.
I20260709 12:18:20.672289 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.616695 28064 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:18:20.673030 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.673249 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.674388 28210 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.599359 28106 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.676381 28210 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:20.597474 28097 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.677688 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.674597 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:20.678622 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.678939 24069 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:20.651907 23819 catalog_manager.cc:5697] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 3 to 6, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 6 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.679242 23990 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:20.676774 28106 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:20.678047 23993 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:20.670876 23961 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:20.687342 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.686829 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:20.597393 28159 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:20.685180 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.694424 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.696982 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:20.708105 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.711908 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:20.715256 23819 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 9, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 9 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.717875 23912 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:20.691280 28221 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:20.691877 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:20.684748 23996 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:20.734758 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:20.678575 28097 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:20.734695 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:20.738065 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.749459 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:20.750434 24594 raft_consensus.cc:2368] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13.
I20260709 12:18:20.751595 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:20.752543 24595 raft_consensus.cc:2393] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 7: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:20.753547 23819 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.694741 28159 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:20.758381 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:20.757944 23990 raft_consensus.cc:2376] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10. Re-sending same reply.
W20260709 12:18:20.460968 23815 rpcz_store.cc:269] 0709 12:17:39.750979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.752607 (+  1628us) service_pool.cc:224] Handling call
0709 12:18:20.416358 (+40663751us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:14.775918 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:14.821645 (+ 45727us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:14.821687 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:18:14.821704 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:14.822268 (+   564us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:14.822351 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:14.822383 (+    32us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:18:14.822730 (+   347us) tablet.cc:701] Row locks acquired
0709 12:18:14.822751 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:14.822908 (+   157us) write_op.cc:270] Start()
0709 12:18:14.823017 (+   109us) write_op.cc:276] Timestamp: P: 1783599494822854 usec, L: 0
0709 12:18:14.823039 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:14.915674 (+ 92635us) log.cc:844] Serialized 1289 byte log entry
0709 12:18:16.022472 (+1106798us) op_driver.cc:464] REPLICATION: finished
0709 12:18:16.277578 (+255106us) write_op.cc:301] APPLY: starting
0709 12:18:16.293319 (+ 15741us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:16.317772 (+ 24453us) spinlock_profiling.cc:243] Waited 8.57 ms on lock 0x7b54002e4354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c4de28 00007f75c4688581 00007f75c4687d58 00007f75c468c9f1 00007f75c468c9a9 00007f75c468c939 00007f75c468c901 00007f75c468bb2d 0000000000388634 0000000000388479
0709 12:18:16.459953 (+142181us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:16.463455 (+  3502us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:16.518300 (+ 54845us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:16.552799 (+ 34499us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:18:16.578326 (+ 25527us) write_op.cc:312] APPLY: finished
0709 12:18:16.578555 (+   229us) log.cc:844] Serialized 35 byte log entry
0709 12:18:16.578732 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:16.578829 (+    97us) write_op.cc:454] Released schema lock
0709 12:18:16.578869 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:16.579243 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:16.579270 (+    27us) write_op.cc:454] Released schema lock
0709 12:18:16.681300 (+102030us) spinlock_profiling.cc:243] Waited 4.41 ms on lock 0x7b54002e4354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c4f32a 00007f75c0bd4f14 00007f75c0bd4ec3 00007f75c0bd4e38 00007f75c0bd4df3 00007f75c0bd40dc 00007f75c0bfde16 00007f75c0be5cbb 00007f75c0bd039d 00007f75c0bd3d75
Metrics: {"mutex_wait_us":467593,"reported_tablets":46,"spinlock_wait_cycles":3072,"child_traces":[["op",{"apply.queue_time_us":157344,"apply.run_cpu_time_us":3069,"apply.run_wall_time_us":325026,"num_ops":3,"prepare.queue_time_us":281697,"prepare.run_cpu_time_us":88208,"prepare.run_wall_time_us":1591283,"raft.queue_time_us":268209,"raft.run_cpu_time_us":11120,"raft.run_wall_time_us":718979,"replication_time_us":1157170,"spinlock_wait_cycles":29857920,"thread_start_us":1041714,"threads_started":4,"wal-append.queue_time_us":688136,"wal-append.run_cpu_time_us":21643,"wal-append.run_wall_time_us":2076327}]]}
W20260709 12:18:20.761592 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 69798.5us
I20260709 12:18:20.760792 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:20.736687 28111 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:20.735919 28064 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:20.772464 23962 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:20.774626 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.775532 24066 raft_consensus.cc:2393] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:20.775998 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.776517 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:20.778013 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.758829 28154 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.764221 28218 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:20.765437 27904 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:20.786996 23819 catalog_manager.cc:5697] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.779071 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:20.737742 27938 consensus_queue.cc:1059] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:18:20.800173 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.801071 23819 catalog_manager.cc:5697] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.775305 28064 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:20.766289 27788 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:18:20.790565 27904 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.789083 28209 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:20.815238 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.832577 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 69823us
I20260709 12:18:20.827310 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:20.793275 28111 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:20.783654 27768 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:18:20.830070 27904 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:20.802363 28115 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:20.841387 23819 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 8, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 8 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.804700 28064 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.736603 28205 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.790757 28154 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.828246 28218 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:20.849884 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55679.8us
I20260709 12:18:20.845703 28217 raft_consensus.cc:3055] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:20.856156 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 97862.9us
I20260709 12:18:20.849321 28172 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.865171 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:20.872067 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.873726 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.849327 28111 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:20.878464 23819 catalog_manager.cc:5697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 2 to 7, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 7 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:20.879928 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:20.882249 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:20.877815 28219 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:18:20.856796 28217 raft_consensus.cc:740] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:20.887002 28232 log.cc:927] Time spent T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:18:20.886399 28217 consensus_queue.cc:260] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.888360 27829 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:20.889389 27829 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:20.894583 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:20.894789 23819 catalog_manager.cc:5697] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:20.895234 23917 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:20.859213 27726 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:20.915709 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:20.916590 24598 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:20.917753 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:20.881170 28205 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:20.927845 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:20.932969 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:20.933811 23919 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:20.934691 24564 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:20.936493 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:20.938766 24595 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 12:18:20.939270 24595 pending_rounds.cc:85] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 9
I20260709 12:18:20.939563 24595 pending_rounds.cc:107] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:18:20.939859 24595 raft_consensus.cc:2889] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:20.864737 28115 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:18:20.930948 24597 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:20.900530 28217 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:20.955549 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.962549 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.956789 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:20.969965 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:20.942049 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 63024.1us
I20260709 12:18:20.961630 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.895954 28243 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:20.996686 28097 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.997052 23960 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:20.997493 28097 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:20.992976 23992 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:20.881321 28172 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:20.989529 28240 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:18:20.969002 28219 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:20.955760 23819 catalog_manager.cc:5697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 9, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 9 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:20.994382 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 114715us
I20260709 12:18:20.987779 28170 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:20.973060 28249 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:21.011904 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 239512us
I20260709 12:18:21.012036 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:21.012893 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:20.913757 28106 consensus_queue.cc:1059] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:18:20.970312 28048 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.016391 28170 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.031020 28115 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:18:21.046806 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:20.942345 27788 consensus_queue.cc:1059] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 12:18:21.047195 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 110812us
I20260709 12:18:21.048759 23989 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:21.033206 24069 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
W20260709 12:18:21.011899 28241 log.cc:927] Time spent T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:18:21.009131 28219 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:21.071234 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:21.072494 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:21.016598 28097 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:21.019428 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:21.074575 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:21.075309 23992 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:21.008347 27726 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:21.073092 23989 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:21.005575 27768 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.034740 28172 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.048041 28154 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.076771 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:21.085165 23996 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:21.065690 28170 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:21.086829 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 75904.1us
W20260709 12:18:21.091064 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 95195.4us
I20260709 12:18:21.095697 27788 consensus_queue.cc:1059] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:21.015254 23819 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 7 to 8, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 8 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:21.100944 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:21.101821 23992 raft_consensus.cc:2393] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:21.077504 28246 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.076640 27726 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.107239 27726 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:21.108939 28115 raft_consensus.cc:3055] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:21.109439 28115 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:21.091436 27768 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.089931 28172 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:21.113966 28172 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:21.115149 28251 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:18:21.116698 28168 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:21.117437 28168 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:21.118203 27768 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:21.118749 27768 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:21.120198 27768 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:21.116446 28172 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:21.122610 28239 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:18:21.110450 28115 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.134611 23919 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
I20260709 12:18:21.137734 24063 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:21.034432 28111 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.009725 28243 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:18:21.142185 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:21.145784 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 52226.9us
I20260709 12:18:21.146857 23992 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:21.153616 23960 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:21.155771 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.156662 23920 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
W20260709 12:18:21.159221 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 70564.5us
I20260709 12:18:21.162879 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:21.167934 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:21.169975 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:21.170809 23992 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
W20260709 12:18:21.178406 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 83485us
I20260709 12:18:21.180166 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:21.180909 23992 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:21.182150 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:21.182991 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 82896.2us
I20260709 12:18:21.182713 23920 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:21.186856 28242 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:21.188304 28253 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:18:21.191066 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.191563 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:21.173003 28217 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:21.175176 28115 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:21.192679 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:21.195302 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:21.204167 28218 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:21.209971 28064 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.212977 28064 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.201853 28172 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:21.200795 28217 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.222757 28216 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:21.223325 28216 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:21.223670 28215 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.221850 28064 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.226814 28064 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.228986 28064 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:21.234501 28242 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:21.230952 28217 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:21.274392 28159 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.276163 23988 raft_consensus.cc:2368] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
W20260709 12:18:21.277056 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 70007.5us
I20260709 12:18:21.279054 24597 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:21.279690 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 96159.9us
I20260709 12:18:21.242640 28256 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:21.246603 28048 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:21.280411 23887 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:21.216224 27726 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.288990 24595 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:21.290892 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:21.291234 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 98599.3us
I20260709 12:18:21.291939 23962 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:21.292949 28172 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:21.293071 28260 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:18:21.294884 23993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 2494) took 1198 ms. Trace:
I20260709 12:18:21.295383 23993 rpcz_store.cc:276] 0709 12:18:20.096625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.122783 (+ 26158us) service_pool.cc:224] Handling call
0709 12:18:21.294670 (+1171887us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400389d54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:21.294810 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622821248}
I20260709 12:18:21.298623 23994 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:21.305449 27904 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.156132 28219 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.306931 28219 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.224534 28216 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.319739 28249 raft_consensus.cc:3055] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:21.320310 28249 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:21.321291 28246 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:21.301123 28260 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.322638 28260 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.324920 28260 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.328229 28170 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.329216 23995 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:21.331682 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:21.331730 28159 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:21.335628 24595 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:21.361936 23987 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:18:21.368666 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:21.372191 23961 leader_election.cc:400] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13.
I20260709 12:18:21.373055 23961 leader_election.cc:403] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:18:21.321393 28249 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:21.381027 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 89128us
W20260709 12:18:21.385772 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 105423us
I20260709 12:18:21.386744 23887 leader_election.cc:400] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14.
I20260709 12:18:21.387290 23887 leader_election.cc:403] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:18:21.388027 28260 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14.
I20260709 12:18:21.389235 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:21.383486 23962 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:21.403915 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 211632us
I20260709 12:18:21.406507 24566 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:21.385056 28256 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:21.408217 28115 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:21.408911 28115 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:21.409271 28256 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:21.411165 23961 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:21.390204 28260 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:21.414487 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:21.416523 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:21.418649 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:21.362900 28217 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.413699 28159 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:21.427589 27768 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.421212 28246 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:21.406085 28261 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:21.418083 28249 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.421020 28064 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
W20260709 12:18:21.446175 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.433442 28246 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:21.420917 28111 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:21.438575 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:21.422899 28258 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:21.448205 24595 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:18:21.448285 28258 raft_consensus.cc:697] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:21.449200 28258 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.423303 27829 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:21.437947 28170 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.453150 27829 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:21.428172 28257 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:18:21.367467 28242 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.423475 28259 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:18:21.447355 28246 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.418462 28260 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.468600 27726 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:21.470615 28217 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:21.455098 27768 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.475004 27768 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.475227 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:21.479620 24600 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:21.479863 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:21.466825 23886 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:21.433597 28172 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:21.481945 28259 raft_consensus.cc:3055] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:21.482446 28259 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
W20260709 12:18:21.482988 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.483522 28259 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.485107 28259 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:21.486557 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:21.488646 24035 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:21.490008 24035 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:21.490564 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:21.491226 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.410100 28115 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:21.499568 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 105986us
I20260709 12:18:21.500839 23887 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:21.502558 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:21.502828 27904 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:21.504264 28159 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13.
I20260709 12:18:21.504407 28246 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.466391 28260 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:21.513757 24596 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:21.509498 23961 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:21.513898 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.515419 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:21.527243 24591 raft_consensus.cc:2410] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:21.515864 28168 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.492141 28170 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:21.519903 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:21.521296 27917 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:21.516821 28257 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:21.492051 28172 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:21.493871 28061 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:21.495106 28011 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:21.560837 28061 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:21.561448 28061 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:21.588663 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.493732 28215 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:18:21.595762 24062 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:21.594324 24061 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:18:21.501757 28256 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.597775 24066 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:21.529035 28159 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:21.528934 28170 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.559782 28011 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.560009 28178 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:21.562633 28172 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.530412 28257 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:21.610303 24035 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:21.615209 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 95380us
I20260709 12:18:21.619231 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:21.606654 28170 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.613786 28011 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:21.530238 28168 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.612579 28159 raft_consensus.cc:697] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:21.628886 28257 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.648988 28268 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:21.649312 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.540150 27829 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.657698 28168 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.632107 28210 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:21.668125 28246 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.667649 28268 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.644269 28100 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:21.681320 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:18:21.686084 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 66847.2us
I20260709 12:18:21.688346 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.691447 23917 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:21.692224 23915 raft_consensus.cc:1240] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:21.671164 28210 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.692571 23914 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:21.641093 28267 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:18:21.695896 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.696556 23913 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:21.697009 23913 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:21.696758 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.678573 28287 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.697461 23920 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:21.697705 28287 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.701304 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.701537 28159 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.702682 23918 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:21.703998 28283 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.127s	user 0.002s	sys 0.000s
I20260709 12:18:21.707757 23919 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:21.709057 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.714604 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.714303 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 852) took 1088 ms. Trace:
I20260709 12:18:21.716113 24065 rpcz_store.cc:276] 0709 12:18:20.626222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.627822 (+  1600us) service_pool.cc:224] Handling call
0709 12:18:20.628953 (+  1131us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:20.653374 (+ 24421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.714009 (+1060635us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b5400070b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:21.714207 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54259072}
I20260709 12:18:21.718596 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:21.688985 28284 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:21.719419 23913 raft_consensus.cc:2368] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 16. Current term is 17.
I20260709 12:18:21.695369 28210 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.721257 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.706718 28221 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:21.689759 28100 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.737262 24068 raft_consensus.cc:2410] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:18:21.743189 28289 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.743852 28289 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.747797 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 2239) took 1110 ms. Trace:
I20260709 12:18:21.747922 23990 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:21.748190 23988 rpcz_store.cc:276] 0709 12:18:20.637755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.640475 (+  2720us) service_pool.cc:224] Handling call
0709 12:18:21.747569 (+1107094us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b5400068bd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:21.747742 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1459651328}
I20260709 12:18:21.749948 23990 raft_consensus.cc:1217] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Deduplicated request from leader. Original: 12.10->[14.11-14.11]   Dedup: 14.11->[]
I20260709 12:18:21.751694 23990 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 12:18:21.752022 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.752300 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:21.747457 28289 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.753641 28289 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.754170 28289 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.751398 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:21.756317 23913 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:21.757057 28289 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.761641 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.727629 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.766752 23913 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:21.773612 23960 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:21.776844 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.777942 23919 raft_consensus.cc:2393] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:21.783012 23914 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:21.784296 28100 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.726048 28087 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:21.727974 28221 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:21.781749 28159 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:21.798202 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.806670 23990 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:21.823855 23995 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:21.834947 28268 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:21.836063 28287 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.838712 28221 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:21.839984 28221 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:21.841584 28011 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:21.842350 28290 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:21.845856 28250 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:21.849382 28252 log.cc:927] Time spent T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.669s	user 0.001s	sys 0.001s
I20260709 12:18:21.842595 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:21.796052 28087 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.851598 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 839) took 1232 ms. Trace:
W20260709 12:18:21.852070 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.851954 24068 rpcz_store.cc:276] 0709 12:18:20.618832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.618973 (+   141us) service_pool.cc:224] Handling call
0709 12:18:21.851395 (+1232422us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400273b54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:21.851520 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2545747200}
I20260709 12:18:21.844800 28216 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:21.880213 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.897753 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:21.899526 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:21.900151 24068 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:21.897719 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:21.899654 24064 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:21.903275 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:21.903625 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.904110 24069 raft_consensus.cc:2410] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:18:21.904835 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:21.819104 28159 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:21.910050 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:21.861840 28215 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.911450 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:21.911401 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:21.862080 27917 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:21.912438 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.861442 28087 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:21.913095 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:21.913326 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:21.915454 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:21.861363 28061 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.923996 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:21.924939 23912 raft_consensus.cc:1240] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:18:21.933070 24069 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:21.916455 24064 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:21.944024 24064 raft_consensus.cc:2468] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:21.945426 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:21.946868 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:21.962038 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:21.962899 23916 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:21.964039 24069 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
W20260709 12:18:21.983256 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.987190 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:21.915069 28221 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:22.000389 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:21.957383 28297 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:22.006446 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:22.017066 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.017876 23916 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:18:22.018138 28294 log.cc:927] Time spent T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:18:22.018479 23919 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:18:22.019644 28285 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
W20260709 12:18:22.020778 28298 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 12:18:22.022547 28302 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 12:18:22.023939 28288 log.cc:927] Time spent T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.356s	user 0.002s	sys 0.000s
I20260709 12:18:22.024456 23988 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:22.025749 28274 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
W20260709 12:18:22.031033 28293 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:18:21.923791 27917 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:21.916095 28215 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:22.057403 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 146184us
I20260709 12:18:22.061782 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:22.066586 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.067258 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.081653 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:22.083349 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:22.084333 24069 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:22.094365 24064 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:22.102736 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.061529 28258 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:22.110827 23919 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:22.122511 23994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 737) took 1738 ms. Trace:
I20260709 12:18:22.122947 23994 rpcz_store.cc:276] 0709 12:18:20.383637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.385459 (+  1822us) service_pool.cc:224] Handling call
0709 12:18:21.298385 (+912926us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:21.299102 (+   717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.122254 (+823152us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b5400389d50. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:22.122444 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2042786176}
I20260709 12:18:22.085712 28297 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:22.127307 24594 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:18:22.127871 24594 pending_rounds.cc:85] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 9
I20260709 12:18:22.128115 24594 pending_rounds.cc:107] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:18:22.128329 24594 raft_consensus.cc:2889] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:22.098871 28260 consensus_meta.cc:287] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.568s	user 0.009s	sys 0.002s
I20260709 12:18:22.014168 28257 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.143870 28011 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:22.160655 23989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2517) took 1153 ms. Trace:
W20260709 12:18:22.169586 28279 log.cc:927] Time spent T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.506s	user 0.001s	sys 0.000s
I20260709 12:18:22.173594 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.174388 23915 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:22.161137 23989 rpcz_store.cc:276] 0709 12:18:21.007731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.746905 (+739174us) service_pool.cc:224] Handling call
0709 12:18:21.747233 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:21.853450 (+106217us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:21.853756 (+   306us) log.cc:844] Serialized 14 byte log entry
0709 12:18:21.962951 (+109195us) log.cc:844] Serialized 14 byte log entry
0709 12:18:21.968700 (+  5749us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:21.968749 (+    49us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:21.968788 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.159137 (+190349us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b180039f760. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb332a6 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419
0709 12:18:22.160405 (+  1268us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540038ac54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:22.160457 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.160591 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8619,"prepare.queue_time_us":33039,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2441,"raft.queue_time_us":11425,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":9053,"spinlock_wait_cycles":365910144,"thread_start_us":107159,"threads_started":1,"wal-append.queue_time_us":143761}
I20260709 12:18:22.176102 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.176820 23917 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:22.172108 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:22.180091 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 98509.6us
I20260709 12:18:22.181618 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:22.199551 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.064127 28159 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.212131 23915 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:22.206265 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2503) took 1309 ms. Trace:
I20260709 12:18:22.147554 28260 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:22.214778 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.175714 28297 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:22.214327 23921 raft_consensus.cc:2410] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:22.217519 23992 rpcz_store.cc:276] 0709 12:18:20.897230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.201256 (+304026us) service_pool.cc:224] Handling call
0709 12:18:21.216937 (+ 15681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:21.220831 (+  3894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:21.220850 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:21.230113 (+  9263us) log.cc:844] Serialized 26 byte log entry
0709 12:18:21.576396 (+346283us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:21.576455 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.576547 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:22.168912 (+592365us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:22.170791 (+  1879us) raft_consensus.cc:1685] finished
0709 12:18:22.170816 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.206173 (+ 35357us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7743,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":4827392,"thread_start_us":345826,"threads_started":1,"wal-append.queue_time_us":402814}
I20260709 12:18:22.204411 28256 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.229020 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.226302 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.140571 28258 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:22.255479 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.256404 23915 raft_consensus.cc:2393] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:22.257609 23920 raft_consensus.cc:1240] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:18:22.183043 27938 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:18:22.263247 28256 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.265432 28260 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:22.274153 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.263720 28061 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:22.278582 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42676 (request call id 840) took 1656 ms. Trace:
I20260709 12:18:22.279507 24063 rpcz_store.cc:276] 0709 12:18:20.622114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.686535 (+ 64421us) service_pool.cc:224] Handling call
0709 12:18:22.278065 (+1591530us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54001b71d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:22.278213 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":998963072}
I20260709 12:18:22.279832 28215 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:22.282891 28304 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 12:18:22.283754 28308 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
W20260709 12:18:22.284545 28312 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:18:22.299654 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.325471 28250 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:22.326081 28250 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:22.334614 28300 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:18:22.274943 28210 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:22.356555 23917 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:22.361604 23919 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:18:22.304739 27917 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:22.353147 28316 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:18:22.414731 24034 leader_election.cc:336] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 2.729s (SENT)
I20260709 12:18:22.426594 24068 raft_consensus.cc:2368] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9.
I20260709 12:18:22.427527 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.429854 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.430588 23960 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:22.431011 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.431591 27938 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:22.431792 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.432250 27938 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.432435 23916 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:22.432737 27938 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.433862 23917 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
W20260709 12:18:22.434552 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.434854 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.435549 23917 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:22.433306 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.436007 23916 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:22.439225 23960 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:22.441090 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:22.444084 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60351.3us
I20260709 12:18:22.444476 23960 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:22.457592 28170 consensus_meta.cc:287] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.812s	user 0.006s	sys 0.004s
I20260709 12:18:22.459461 28210 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:22.466267 28246 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:22.467527 28256 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:22.467698 28221 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:22.468457 28262 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:22.469112 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 287543us
I20260709 12:18:22.469833 24036 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:22.427084 28283 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:22.474506 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:22.475710 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.468286 28221 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:22.491020 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:22.494822 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:22.501413 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:22.502028 24594 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:22.458038 28170 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:22.492940 28271 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.512650 28315 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:22.513674 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 43927.2us
I20260709 12:18:22.514165 28210 raft_consensus.cc:2764] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:18:22.514122 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:22.491094 28246 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:22.522135 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:22.521682 24036 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:22.528508 24036 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:22.529750 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:22.516594 28178 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.023s	sys 0.027s
I20260709 12:18:22.520782 28315 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.534051 24036 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:22.534730 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:22.535281 23886 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:22.532761 28319 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:22.538759 28315 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.545742 28319 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.546151 28319 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.533658 28221 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:22.531538 28318 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:22.548415 28318 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:22.548761 28318 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.549108 28170 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:22.553140 28315 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.533617 27904 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:22.554677 27904 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:22.555804 28315 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:22.556859 27904 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:22.536928 28210 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:22.557806 28210 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.558248 28210 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:22.564589 28221 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:22.566869 28246 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.574229 28319 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.576975 28319 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:22.577560 28319 raft_consensus.cc:3055] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:22.577880 28319 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:22.578740 27917 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:22.574501 28318 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.579504 27917 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:22.579175 28319 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.580955 28318 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:22.580651 27917 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:22.526669 28271 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:22.588030 28271 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:22.577996 28216 consensus_meta.cc:287] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.680s	user 0.003s	sys 0.004s
I20260709 12:18:22.592767 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:22.593560 24597 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:22.594018 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.594309 24599 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:22.549947 28170 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:22.541350 28178 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.024s	sys 0.028s
I20260709 12:18:22.600726 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.578692 28210 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.595948 28170 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.596084 28178 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:22.644829 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 200419us
I20260709 12:18:22.628229 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.629019 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.635759 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:22.636583 24564 leader_election.cc:336] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.745s (SENT)
I20260709 12:18:22.650460 24564 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:22.637096 24034 leader_election.cc:336] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.916s (SENT)
I20260709 12:18:22.651185 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:22.652390 23913 raft_consensus.cc:2393] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:22.641269 28250 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:22.661604 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.679560 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 116524us
W20260709 12:18:22.682940 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 45872.1us
W20260709 12:18:22.685662 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.686832 24034 leader_election.cc:336] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.594s (SENT)
I20260709 12:18:22.687373 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:22.689123 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:22.689980 24591 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.690871 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.691252 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:22.691896 23913 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:22.693282 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.649562 28170 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.694317 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.682441 28318 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:22.696765 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:22.617514 27938 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.698803 23921 raft_consensus.cc:2393] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:22.700516 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.701223 23914 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:22.702016 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:22.702621 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:22.703466 24595 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:22.648732 28178 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.704811 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:22.702751 24596 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:22.710223 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.710786 23921 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:22.711983 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.712046 23960 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:22.708235 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.714030 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.715186 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.709805 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:22.719641 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.720119 23992 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:22.707417 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.721889 23992 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:22.722497 23914 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:22.723065 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.723685 23921 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:22.724380 23992 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:22.727064 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.731220 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:22.734166 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.738921 24070 raft_consensus.cc:2393] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 14: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:22.735599 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.740005 23913 raft_consensus.cc:2410] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 11 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:18:22.735878 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.741628 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.736160 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.736734 24067 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:22.745685 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:22.751914 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.742854 23921 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:22.756680 24591 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:22.755543 23960 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:22.761649 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.761855 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.746488 24067 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:22.762467 23921 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:22.762909 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:22.764461 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.765458 24069 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:22.723568 28249 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:22.768113 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.763736 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.768194 24595 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:22.727389 28327 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:22.758862 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.769347 23921 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:22.774011 24066 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:22.727936 28321 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.777412 28327 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:22.778654 28325 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:18:22.778465 24063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:22.779456 24063 raft_consensus.cc:606] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:22.779635 28310 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:22.779961 24063 raft_consensus.cc:614] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:22.781638 27938 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:22.782526 28281 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 1.127s	user 0.000s	sys 0.005s
I20260709 12:18:22.784890 23993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2516) took 1789 ms. Trace:
I20260709 12:18:22.785363 28157 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:22.785260 23993 rpcz_store.cc:276] 0709 12:18:20.995385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.476432 (+481047us) service_pool.cc:224] Handling call
0709 12:18:21.476769 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:21.477133 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:21.477169 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:21.477620 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:18:21.599193 (+121573us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:21.599231 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.599289 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:22.781641 (+1182352us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:22.784565 (+  2924us) raft_consensus.cc:1685] finished
0709 12:18:22.784586 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.784830 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":14062,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2959,"spinlock_wait_cycles":21801344,"thread_start_us":121230,"threads_started":1,"wal-append.queue_time_us":177203}
I20260709 12:18:22.790786 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:22.791749 23918 raft_consensus.cc:2410] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:22.792902 23918 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:22.722030 28011 consensus_queue.cc:1059] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:18:22.794710 28011 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:22.795046 28011 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:22.795810 28011 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.796964 28011 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:22.798135 28326 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:18:22.798853 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:22.781582 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 70246.8us
I20260709 12:18:22.805630 23919 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:22.735146 28329 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:22.815405 24597 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
W20260709 12:18:22.822852 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.816993 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.826170 23921 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.737977 28318 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:18:22.815451 28249 raft_consensus.cc:697] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:22.778707 28327 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:22.815513 27938 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:22.857033 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 56492.6us
W20260709 12:18:22.857218 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 79426.3us
I20260709 12:18:22.832295 28330 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:22.824436 28247 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:22.859949 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:22.862115 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 62927.9us
I20260709 12:18:22.868368 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:22.859380 24035 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:22.861119 28338 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:22.817509 28159 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:22.810653 28321 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.880306 23962 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:22.856900 28219 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.889984 23995 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:22.861040 28061 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:18:22.831878 27904 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:18:22.887370 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:22.899209 23987 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:22.887966 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:22.888499 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:22.900367 23989 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:22.882453 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 69749.7us
I20260709 12:18:22.885840 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:22.891875 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:22.904734 23992 raft_consensus.cc:2393] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:22.869275 28310 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:22.906899 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:22.914347 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:22.914881 23913 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.907688 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:22.910151 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.915905 23995 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:22.874660 28159 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.912987 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:22.913297 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:22.916013 24065 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:22.861848 27938 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:22.907578 28333 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:18:22.923252 24065 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:18:22.940647 24065 pending_rounds.cc:85] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 9
I20260709 12:18:22.940925 24065 pending_rounds.cc:107] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:18:22.941154 24065 raft_consensus.cc:2889] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:22.924655 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 94445.3us
I20260709 12:18:22.942538 23886 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:22.903373 28246 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:22.936298 23995 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:22.890688 28157 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:22.911532 28210 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:22.921833 23994 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.938766 23993 raft_consensus.cc:2393] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:18:22.946225 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 86947.4us
I20260709 12:18:22.937042 24063 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:22.946863 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:22.937376 28318 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:22.937454 28159 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:22.918938 28250 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:22.881750 28338 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.945487 27922 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:22.969969 23994 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:22.971138 24036 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:22.953591 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 73381.8us
W20260709 12:18:22.937397 23887 connection.cc:256] RPC call timeout handler was delayed by -1.8029289579999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 12:18:22.950945 24035 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:22.955972 23913 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
W20260709 12:18:22.974094 23887 connection.cc:256] RPC call timeout handler was delayed by -1.682328957999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
W20260709 12:18:22.974597 23887 connection.cc:256] RPC call timeout handler was delayed by -1.6796289579999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:18:22.974973 23887 connection.cc:256] RPC call timeout handler was delayed by -1.6796289579999666s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 12:18:22.975340 23887 connection.cc:256] RPC call timeout handler was delayed by -1.6346289579998938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 12:18:22.975701 23887 connection.cc:256] RPC call timeout handler was delayed by -1.6049289580000732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
W20260709 12:18:22.976321 23887 connection.cc:256] RPC call timeout handler was delayed by -1.5977289580000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 12:18:22.976682 23887 connection.cc:256] RPC call timeout handler was delayed by -1.5671289580000121s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 12:18:22.977037 23887 connection.cc:256] RPC call timeout handler was delayed by -1.3592289579999033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2101s for a response
W20260709 12:18:22.977392 23887 connection.cc:256] RPC call timeout handler was delayed by -1.3259289580000768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 12:18:22.977741 23887 connection.cc:256] RPC call timeout handler was delayed by -1.3097289580000506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2156s for a response
W20260709 12:18:22.978094 23887 connection.cc:256] RPC call timeout handler was delayed by -1.2818289580000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260709 12:18:22.978473 23887 connection.cc:256] RPC call timeout handler was delayed by -1.2422289579999415s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
W20260709 12:18:22.978820 23887 connection.cc:256] RPC call timeout handler was delayed by -1.0100289580000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2489s for a response
I20260709 12:18:22.979496 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:22.898679 28330 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:18:22.904426 28219 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:22.962920 23989 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:22.985064 24036 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:22.975572 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:22.959156 23987 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:22.957584 28124 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:22.992450 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 49983.9us
I20260709 12:18:22.960000 28318 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.990907 24036 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:22.914000 28329 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:18:22.952286 28246 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:22.966878 28271 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.965227 28343 raft_consensus.cc:2804] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:23.013289 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:23.014397 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 137748us
I20260709 12:18:23.011646 23887 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:23.014551 24598 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:23.015390 23915 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:22.995639 28346 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.996435 28061 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:23.001960 28124 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:22.991748 28348 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:23.015120 23962 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:23.005219 28318 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:22.947182 28249 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.008649 28268 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.015556 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 65018.6us
I20260709 12:18:23.019937 28346 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.019433 28330 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:23.017560 28250 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:23.018857 28278 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 1.521s	user 0.005s	sys 0.000s
I20260709 12:18:23.019284 28343 raft_consensus.cc:697] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:23.036054 28210 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:23.020063 28061 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:23.034665 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:23.041927 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2234) took 1181 ms. Trace:
I20260709 12:18:23.072621 24064 rpcz_store.cc:276] 0709 12:18:21.860987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.946570 (+ 85583us) service_pool.cc:224] Handling call
0709 12:18:23.041752 (+1095182us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54002d3f54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:23.041860 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337387392}
I20260709 12:18:23.069599 28337 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:23.044368 23962 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:23.041541 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:23.014056 28339 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 12:18:23.070317 28334 log.cc:927] Time spent T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:18:22.966521 28310 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.063351 28353 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:23.015189 28271 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.036439 28348 raft_consensus.cc:697] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:23.043838 24035 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:23.050873 28354 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:23.104385 28354 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:23.104984 28348 consensus_queue.cc:237] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:23.105434 28354 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:23.039366 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 133566us
I20260709 12:18:23.079197 23962 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:23.080065 28344 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:23.080603 28321 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:23.081315 28061 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:23.082722 28343 consensus_queue.cc:237] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:23.083537 28332 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:18:23.084437 23921 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:23.085325 28318 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:23.090899 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.111310 24564 leader_election.cc:336] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.655s (SENT)
I20260709 12:18:23.168581 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:23.177912 23918 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:23.183197 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:23.175350 28344 raft_consensus.cc:697] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:23.174901 28321 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:23.100464 28250 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:23.067274 28268 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:23.171418 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 180598us
W20260709 12:18:23.214520 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 135428us
W20260709 12:18:23.173198 28341 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:18:23.223477 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:23.228402 23987 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:23.176204 27904 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.170193 27938 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:23.224622 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 113331us
W20260709 12:18:23.248133 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.283733 28338 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:23.258836 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 224239us
I20260709 12:18:23.209511 28321 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:23.284787 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:23.285168 28321 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:23.285980 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:23.288210 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2663) took 1016 ms. Trace:
I20260709 12:18:23.295486 28330 raft_consensus.cc:697] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:23.288596 23912 rpcz_store.cc:276] 0709 12:18:22.271631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.796913 (+525282us) service_pool.cc:224] Handling call
0709 12:18:22.797214 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.797399 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:22.797734 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 12:18:22.888527 (+ 90793us) log.cc:844] Serialized 14 byte log entry
0709 12:18:23.287892 (+399365us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:23.287950 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:23.287992 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.288056 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:23.288158 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":6021,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":3059,"raft.queue_time_us":255702,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":13915,"thread_start_us":486740,"threads_started":3,"wal-append.queue_time_us":143310}
W20260709 12:18:23.306375 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.237973 28352 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:23.299201 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 255416us
W20260709 12:18:23.290992 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 249474us
W20260709 12:18:23.311743 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.230792 28366 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.287881 28246 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:23.346259 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.363696 24035 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:23.297763 28124 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:23.368507 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 63740.7us
I20260709 12:18:23.369038 28353 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:23.292666 27938 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.234076 28219 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:23.248382 28210 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:23.289400 27904 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.406999 28210 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:23.407553 28353 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:23.403735 28350 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.404953 28367 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.372309 28337 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:23.390129 28366 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:23.452214 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:23.466118 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:23.479802 24598 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
W20260709 12:18:23.484524 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 97325.6us
I20260709 12:18:23.303071 28344 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.421222 28360 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:23.485332 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:23.487363 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 194969us
I20260709 12:18:23.450302 28346 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:23.490669 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:23.493883 23886 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:23.447361 28366 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:23.530818 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 167202us
I20260709 12:18:23.510020 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:23.462496 28330 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.485280 28318 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:23.541749 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:23.544626 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:23.539043 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:23.544997 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 54447.2us
I20260709 12:18:23.546254 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:23.486824 28350 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:23.487900 28271 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:23.491462 28360 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:23.558465 24064 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:23.558501 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:23.538336 28346 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:23.536773 28268 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:23.495693 28352 raft_consensus.cc:697] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:23.447937 28367 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:23.563335 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:23.538064 28366 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.558943 24064 pending_rounds.cc:85] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 5
I20260709 12:18:23.571676 24064 pending_rounds.cc:107] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:18:23.572036 24064 raft_consensus.cc:2889] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:23.575340 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45226.3us
I20260709 12:18:23.448939 28337 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.544915 28215 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 12:18:23.582443 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 44728.3us
I20260709 12:18:23.559804 28360 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.583741 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:23.570034 28377 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.590808 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:23.592634 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:23.579566 28350 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:23.595979 24566 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:23.587067 28379 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:23.593406 28346 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:23.570379 28343 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:18:23.601529 28338 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:23.587215 28356 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260709 12:18:23.603293 28372 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:23.585508 27904 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:23.601941 24564 leader_election.cc:336] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 2.148s (SENT)
W20260709 12:18:23.591874 28327 consensus_meta.cc:287] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.730s	user 0.010s	sys 0.002s
I20260709 12:18:23.603307 28374 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:23.601140 28373 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.587527 28363 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:18:23.588874 28318 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.617430 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:23.604912 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 65890.4us
W20260709 12:18:23.605808 28011 consensus_meta.cc:287] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.808s	user 0.010s	sys 0.004s
W20260709 12:18:23.625039 28317 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 1.270s	user 0.000s	sys 0.004s
W20260709 12:18:23.615460 28368 log.cc:927] Time spent T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260709 12:18:23.639736 23960 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:23.641551 28376 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.641829 28381 raft_consensus.cc:3055] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:23.643196 28367 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:23.594722 28377 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:23.607244 28365 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.643724 28352 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.614559 28338 consensus_queue.cc:1059] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:18:23.609109 28375 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:23.622097 28372 raft_consensus.cc:697] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:18:23.615495 27922 consensus_meta.cc:287] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.001s
I20260709 12:18:23.614719 28246 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:23.649580 28170 consensus_meta.cc:287] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.947s	user 0.005s	sys 0.006s
I20260709 12:18:23.618974 28379 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.603423 28388 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:23.691067 28321 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.603585 28361 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:23.609012 28390 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.651162 28373 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.614583 28369 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:23.635285 28327 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.654482 28387 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:23.689342 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 49696.4us
I20260709 12:18:23.690618 28385 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:23.695140 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.698732 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:23.699745 24595 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:18:23.697153 28271 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:18:23.688002 28376 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.687161 28381 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:18:23.693833 28159 consensus_meta.cc:287] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.711s	user 0.009s	sys 0.002s
W20260709 12:18:23.705559 24034 leader_election.cc:336] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.620s (SENT)
W20260709 12:18:23.707062 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 113239us
I20260709 12:18:23.694950 28310 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:23.603314 28371 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 12:18:23.678493 28318 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:23.700202 28343 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:23.826620 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 139047us
I20260709 12:18:23.900869 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:23.901206 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.894809 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:23.903137 23990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2533) took 1015 ms. Trace:
I20260709 12:18:23.903578 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:23.903546 23990 rpcz_store.cc:276] 0709 12:18:22.888046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.889083 (+  1037us) service_pool.cc:224] Handling call
0709 12:18:22.910361 (+ 21278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:23.016788 (+106427us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:23.022595 (+  5807us) log.cc:844] Serialized 14 byte log entry
0709 12:18:23.254756 (+232161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:23.254805 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:23.254847 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.902908 (+648061us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b540009a454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:23.902955 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:23.903087 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19016,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":52226,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":61708,"spinlock_wait_cycles":244204928,"thread_start_us":221302,"threads_started":1,"wal-append.queue_time_us":364336}
W20260709 12:18:23.901994 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 196454us
I20260709 12:18:23.908535 24595 pending_rounds.cc:85] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 8
I20260709 12:18:23.908982 24595 pending_rounds.cc:107] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:18:23.908749 23887 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:23.909405 24595 raft_consensus.cc:2889] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:23.903826 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:23.911675 24591 raft_consensus.cc:2393] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:23.843813 24600 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:18:23.915126 24600 pending_rounds.cc:85] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 8
I20260709 12:18:23.918893 24600 pending_rounds.cc:107] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:18:23.921141 24600 raft_consensus.cc:2889] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:23.907151 24592 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:23.917279 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:23.846099 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:23.914162 23960 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:23.872260 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:23.735528 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2664) took 1448 ms. Trace:
I20260709 12:18:23.712504 28350 raft_consensus.cc:3055] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:23.956969 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:23.713318 27922 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.837621 28319 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:23.780771 28377 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:23.907922 28315 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:23.727897 28361 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.777621 28389 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.958575 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2485) took 1333 ms. Trace:
I20260709 12:18:23.908226 28061 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:24.014076 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:23.987464 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 62550.8us
I20260709 12:18:24.015247 23921 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:18:24.006567 23916 rpcz_store.cc:276] 0709 12:18:22.625520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.845792 (+1220272us) service_pool.cc:224] Handling call
0709 12:18:23.958497 (+112705us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:24.016321 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:23.957512 28350 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:23.914410 28385 raft_consensus.cc:697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:24.000201 23913 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:18:23.923691 28210 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:24.006146 23918 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:23.712499 28170 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:23.956928 28338 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:24.048179 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:24.021652 23887 leader_election.cc:400] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:24.067440 23887 leader_election.cc:403] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:18:23.871462 28159 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:23.960642 28375 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:24.017390 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:24.072806 24063 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:24.028420 23912 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:23.996023 28361 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:24.031678 23913 pending_rounds.cc:85] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 10
I20260709 12:18:24.037022 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:24.037460 28376 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:24.037278 28350 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:24.077965 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 56914.1us
I20260709 12:18:24.080036 28350 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.038079 28087 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.038863 28366 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.039292 28393 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:24.043848 28246 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:24.044092 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:24.044351 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 130253us
W20260709 12:18:24.084973 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 184067us
I20260709 12:18:24.068895 23915 raft_consensus.cc:2376] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9. Re-sending same reply.
I20260709 12:18:23.994546 28321 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:23.955528 23919 rpcz_store.cc:276] 0709 12:18:22.287289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.793914 (+506625us) service_pool.cc:224] Handling call
0709 12:18:22.805280 (+ 11366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.806109 (+   829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.735300 (+929191us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b54000a91d0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:23.735461 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25472256}
I20260709 12:18:24.063202 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:23.916093 28310 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:24.069646 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 163510us
I20260709 12:18:24.090106 23918 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:23.924659 28343 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.005353 28369 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:24.075421 23921 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
I20260709 12:18:24.076368 23913 pending_rounds.cc:107] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:18:24.017763 28344 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:18:24.096278 23913 raft_consensus.cc:2889] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:23.991293 27922 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.076637 24064 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:24.077701 28365 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:24.078262 24063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:24.078620 28397 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:24.078900 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:23.736507 28390 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.082978 23914 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:24.088675 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:24.090924 24034 leader_election.cc:336] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.598s (SENT)
I20260709 12:18:24.071302 28395 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:24.072621 28375 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.017304 28405 consensus_queue.cc:1059] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:18:24.029625 28377 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:18:23.908347 28372 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:24.161149 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 56786.5us
I20260709 12:18:24.157454 23916 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:18:24.027526 28061 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:24.167095 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 70484.6us
I20260709 12:18:24.158265 23915 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:18:24.158594 24063 raft_consensus.cc:606] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:24.169018 24063 raft_consensus.cc:614] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:24.158618 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 54795.6us
I20260709 12:18:24.066555 28210 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:24.157416 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 66527.2us
I20260709 12:18:24.162302 23916 pending_rounds.cc:85] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 11
I20260709 12:18:24.102533 28097 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.084784 28087 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.105283 23918 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:24.170506 23916 pending_rounds.cc:107] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:18:24.171641 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:24.177635 23916 raft_consensus.cc:2889] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:24.033387 28389 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.156852 28395 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.092777 28371 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:24.151691 28011 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.031291 28381 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:24.089920 28393 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:24.212303 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.281811 23996 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:24.151461 28375 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:24.423297 28427 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:24.424012 28427 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.211614 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:24.368587 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:24.378194 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 167134us
I20260709 12:18:24.253240 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.443329 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:24.253530 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:24.445935 23993 raft_consensus.cc:2393] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:18:24.401909 23991 consensus_meta.cc:287] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.003s
I20260709 12:18:24.462088 23991 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:24.252812 23990 raft_consensus.cc:1240] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:24.236444 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44098.1us
I20260709 12:18:24.464074 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:24.452941 24034 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:24.261004 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:24.378261 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.219599 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.255821 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.457659 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:24.443639 23988 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:24.541273 23989 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:24.222031 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:24.258800 23915 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:24.542807 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.543895 23989 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
W20260709 12:18:24.545035 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37708 (request call id 886) took 1878 ms (client timeout 1699 ms). Trace:
W20260709 12:18:24.545480 24599 rpcz_store.cc:269] 0709 12:18:22.534344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.534493 (+   149us) service_pool.cc:224] Handling call
0709 12:18:24.412818 (+1878325us) spinlock_profiling.cc:243] Waited 52 ms on lock 0x7b54003ece54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:24.412927 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119657344}
I20260709 12:18:24.551456 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.552335 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:24.559538 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2469) took 2544 ms. Trace:
W20260709 12:18:24.560355 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 107475us
W20260709 12:18:24.378950 28413 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:18:24.559954 23920 rpcz_store.cc:276] 0709 12:18:22.015487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.015692 (+   205us) service_pool.cc:224] Handling call
0709 12:18:22.017307 (+  1615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:22.268536 (+251229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.559291 (+2290755us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54002f1054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:24.559480 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526853504}
I20260709 12:18:24.573843 23995 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:24.582963 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.583809 23995 raft_consensus.cc:2410] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:18:24.571588 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.177026 28417 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:24.572842 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:24.586066 23990 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:24.211143 28221 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:24.568820 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:24.596683 23987 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:24.575278 23992 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:24.379190 28418 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:24.577515 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:24.590384 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:24.610870 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.379323 28087 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.546013 28373 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.235518 28271 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.326565 28318 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:24.302064 28344 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.462697 28217 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:24.601939 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 428603us
I20260709 12:18:24.539947 28395 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:24.512898 28377 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:24.604830 23993 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:24.357468 28327 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.592971 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:24.263567 28321 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:24.379784 28412 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 12:18:24.563093 28381 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:24.623186 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.624178 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:24.625314 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:24.696769 23913 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:24.627842 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:24.574044 28159 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:24.581385 28398 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:24.190089 28097 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.582971 28343 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.674551 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.188781 28405 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.445s
I20260709 12:18:24.681568 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.600086 28170 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.545455 28011 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.694146 28310 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:24.657789 28268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.047s	sys 0.090s
I20260709 12:18:24.651268 28421 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:18:24.217965 28267 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.464s
I20260709 12:18:24.295523 28246 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:24.649029 27922 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.675570 28318 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:24.707943 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 243946us
I20260709 12:18:24.711105 23995 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:24.702777 23987 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:24.576521 28371 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:24.725942 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:24.752993 24063 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.171598 28365 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:24.718127 28410 log.cc:927] Time spent T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:18:24.700682 28061 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.671654 28271 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.678364 28217 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:24.611888 28417 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.749168 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.764569 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.749920 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.678153 28344 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.695240 28321 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:24.722064 28210 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.721055 28422 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:24.728341 28268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.047s	sys 0.091s
W20260709 12:18:24.759224 28419 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.516s	user 0.001s	sys 0.001s
W20260709 12:18:24.771687 28400 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260709 12:18:24.765313 23987 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:24.671429 28418 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:24.748015 28389 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.733717 28390 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.209295 28385 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:24.743520 28427 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.805454 28430 raft_consensus.cc:3055] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:18:24.786357 28350 consensus_meta.cc:287] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.691s	user 0.011s	sys 0.000s
W20260709 12:18:24.804942 28428 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:18:24.809585 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:24.786736 23988 raft_consensus.cc:2410] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
W20260709 12:18:24.810071 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 157973us
I20260709 12:18:24.812821 24063 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
W20260709 12:18:24.730155 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 152724us
I20260709 12:18:24.823031 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:24.830071 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2258) took 1126 ms. Trace:
I20260709 12:18:24.830593 24063 rpcz_store.cc:276] 0709 12:18:23.703616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.829052 (+1125436us) service_pool.cc:224] Handling call
0709 12:18:24.829409 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.829642 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.829680 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:24.829738 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:24.829784 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.829864 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.830005 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:24.825960 28426 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:24.798188 28415 consensus_queue.cc:1059] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:18:24.823308 28430 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:24.826377 28390 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:24.841913 28426 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.852411 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:24.854569 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2261) took 1065 ms. Trace:
I20260709 12:18:24.855146 24063 rpcz_store.cc:276] 0709 12:18:23.788669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.838365 (+1049696us) service_pool.cc:224] Handling call
0709 12:18:24.853866 (+ 15501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.854048 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.854072 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:24.854118 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:24.854155 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.854413 (+   258us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.854515 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:24.856398 28426 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:24.862885 28430 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.864251 28397 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:24.864496 28430 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:24.857028 28360 consensus_meta.cc:287] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 1.262s	user 0.013s	sys 0.000s
I20260709 12:18:24.849896 28393 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:24.868373 24063 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:18:24.868667 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.865620 28435 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:24.843113 28421 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:18:24.842907 28267 consensus_queue.cc:1059] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 12:18:24.866902 28429 log.cc:927] Time spent T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 12:18:24.864771 28397 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:24.876511 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.876611 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2262) took 1087 ms. Trace:
I20260709 12:18:24.891011 24063 rpcz_store.cc:276] 0709 12:18:23.788980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.855818 (+1066838us) service_pool.cc:224] Handling call
0709 12:18:24.868081 (+ 12263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.876349 (+  8268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.876556 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:24.867271 28210 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:24.801477 28422 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.869288 28011 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.854063 28247 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:18:24.871585 28097 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.871901 28415 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:24.908926 23995 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:24.871373 28268 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:18:24.918197 28365 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:24.913508 28205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.011s	sys 0.021s
I20260709 12:18:24.907423 28405 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.873239 28360 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:24.925954 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 43731.6us
I20260709 12:18:24.929361 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:24.898372 28210 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.911624 28415 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:24.941111 28319 consensus_meta.cc:287] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.950s	user 0.005s	sys 0.009s
I20260709 12:18:24.927626 28417 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:24.925712 28205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.011s	sys 0.022s
I20260709 12:18:24.947353 28360 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:24.948236 28425 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:24.919320 28271 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:24.925292 28371 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:24.932184 28321 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:24.953091 23918 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 12:18:24.955753 24068 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2232) took 3095 ms (client timeout 1599 ms). Trace:
I20260709 12:18:24.955968 24061 raft_consensus.cc:1240] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:24.956175 24068 rpcz_store.cc:269] 0709 12:18:21.860452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.901028 (+ 40576us) service_pool.cc:224] Handling call
0709 12:18:24.955548 (+3054520us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400273654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:24.955682 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1176089984}
I20260709 12:18:24.954119 28405 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.961774 28445 raft_consensus.cc:3055] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:24.962359 28445 raft_consensus.cc:740] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:24.963552 28445 consensus_queue.cc:260] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.965140 28445 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:24.955094 28390 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.943274 28318 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:24.972440 24068 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:24.973032 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 876) took 1052 ms. Trace:
I20260709 12:18:24.973340 24068 rpcz_store.cc:276] 0709 12:18:23.920933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.957178 (+1036245us) service_pool.cc:224] Handling call
0709 12:18:24.972128 (+ 14950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.972809 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.972975 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:24.973755 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:24.974622 28421 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:24.975090 28421 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.975438 28421 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:24.978946 28418 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:24.979528 28221 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:24.981884 28361 consensus_meta.cc:287] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.893s	user 0.002s	sys 0.007s
W20260709 12:18:24.982064 28388 consensus_meta.cc:287] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 1.253s	user 0.000s	sys 0.010s
I20260709 12:18:24.969645 28390 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:24.987376 23994 raft_consensus.cc:2393] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 15: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:24.990224 28426 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:24.993739 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 888) took 2401 ms. Trace:
I20260709 12:18:24.985001 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:24.992326 28426 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.003542 28254 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:25.003958 28254 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.004268 28254 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:24.995730 28214 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:25.006196 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 877) took 1085 ms. Trace:
I20260709 12:18:25.006685 24068 rpcz_store.cc:276] 0709 12:18:23.921235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.974028 (+1052793us) service_pool.cc:224] Handling call
0709 12:18:25.005592 (+ 31564us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.005877 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.005908 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:25.005948 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:25.005979 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.006036 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.006136 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:24.994256 24594 rpcz_store.cc:276] 0709 12:18:22.592198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.595543 (+  3345us) service_pool.cc:224] Handling call
0709 12:18:22.599969 (+  4426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.600230 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:22.676307 (+ 76077us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.989167 (+2312860us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b1800454120. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75c07fa4bc 00007f75bdb4848b 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f223a
0709 12:18:24.993085 (+  3918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:24.993353 (+   268us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:24.993417 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:24.993521 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:24.993668 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3658,"prepare.queue_time_us":77794,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":30664576,"thread_start_us":68643,"threads_started":2,"wal-append.queue_time_us":950,"wal-append.run_cpu_time_us":1188,"wal-append.run_wall_time_us":1021489}
I20260709 12:18:25.004938 28214 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.005057 28395 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.029803 23989 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:18:25.034096 28260 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.425s	user 0.011s	sys 0.024s
W20260709 12:18:25.034663 28260 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.426s	user 0.012s	sys 0.024s
I20260709 12:18:24.998512 28216 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:24.924455 28397 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.039340 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:24.998934 28388 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:25.040549 23987 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:25.041783 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.500s (SENT) [suppressed 27 similar messages]
I20260709 12:18:24.992839 28361 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.048084 28257 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.049633 28361 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.050432 23919 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 12. Ops: [10.10-10.10]
I20260709 12:18:25.060655 28405 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:25.067445 28375 consensus_meta.cc:287] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.644s	user 0.011s	sys 0.000s
I20260709 12:18:25.072829 28366 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.073592 28422 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.053604 28397 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:25.078167 28210 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.080047 28395 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.081297 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.083807 23995 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:25.086875 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56870 (request call id 702) took 1085 ms. Trace:
I20260709 12:18:25.087240 23921 rpcz_store.cc:276] 0709 12:18:24.001380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.016038 (+ 14658us) service_pool.cc:224] Handling call
0709 12:18:25.086676 (+1070638us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b54003359d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:25.086780 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134057344}
I20260709 12:18:25.088478 23921 raft_consensus.cc:3055] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:25.088795 23921 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:25.089048 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:25.091130 23987 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:25.094054 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:25.089463 23921 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.095992 23921 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:25.124161 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.067915 28375 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.065877 28421 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.098259 28247 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:25.263043 23921 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:25.263500 23921 pending_rounds.cc:85] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 5
I20260709 12:18:25.263726 23921 pending_rounds.cc:107] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:18:25.263962 23921 raft_consensus.cc:2889] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:25.065907 28254 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.277243 28291 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:25.277647 28394 consensus_queue.cc:1059] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.182s
I20260709 12:18:25.278796 28394 raft_consensus.cc:3055] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:25.279147 28394 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:25.279907 28394 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.282583 28430 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:25.283174 28430 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:25.288039 28362 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 1.980s	user 0.006s	sys 0.007s
I20260709 12:18:25.290822 28430 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.291447 28430 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.292647 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.293455 24598 raft_consensus.cc:2410] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:18:25.294525 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.295231 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:25.296008 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.296634 24599 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:25.291942 28430 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.299077 28430 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:25.301327 28397 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:25.277890 28291 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.295029 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.306452 24591 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:25.303350 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.308837 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.312336 28291 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:25.313678 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 271892us
I20260709 12:18:25.269851 28247 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:25.320881 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2508) took 1040 ms. Trace:
I20260709 12:18:25.322751 23920 rpcz_store.cc:276] 0709 12:18:24.280240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.975900 (+695660us) service_pool.cc:224] Handling call
0709 12:18:24.976188 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.976367 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:25.018845 (+ 42478us) log.cc:844] Serialized 14 byte log entry
0709 12:18:25.320541 (+301696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:25.320599 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:25.320645 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.320716 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.320823 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27286,"prepare.queue_time_us":64603,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":1384,"raft.queue_time_us":1029,"thread_start_us":301244,"threads_started":1}
I20260709 12:18:25.314625 28397 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.335006 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2509) took 1054 ms. Trace:
I20260709 12:18:25.339807 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:25.339679 28247 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.341406 23920 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:25.339007 23918 rpcz_store.cc:276] 0709 12:18:24.280516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.010143 (+729627us) service_pool.cc:224] Handling call
0709 12:18:25.010431 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.010605 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:25.255950 (+245345us) log.cc:844] Serialized 14 byte log entry
0709 12:18:25.334652 (+ 78702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:25.334706 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:25.334747 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.334814 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.334921 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13707,"prepare.queue_time_us":48350,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":953,"raft.queue_time_us":16307,"thread_start_us":280533,"threads_started":2}
I20260709 12:18:25.344028 28445 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.344010 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.345393 23918 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:25.352033 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:25.346216 28445 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.357182 28445 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.365931 28375 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.367362 28397 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.368600 28254 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.370182 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2504) took 1091 ms. Trace:
I20260709 12:18:25.372668 28415 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:25.375808 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.370553 23912 rpcz_store.cc:276] 0709 12:18:24.279105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.861853 (+582748us) service_pool.cc:224] Handling call
0709 12:18:25.086813 (+224960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.087261 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:25.087302 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:25.087839 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:18:25.259540 (+171701us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:25.318445 (+ 58905us) log.cc:844] Serialized 14 byte log entry
0709 12:18:25.318720 (+   275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.318788 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.329450 (+ 10662us) raft_consensus.cc:1685] finished
0709 12:18:25.329470 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.370025 (+ 40555us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b54003359d0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:25.370125 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11855,"prepare.queue_time_us":56932,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":1307,"raft.queue_time_us":3303,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":6201,"spinlock_wait_cycles":516474240,"thread_start_us":171267,"threads_started":1,"wal-append.queue_time_us":238916}
I20260709 12:18:25.377569 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.377889 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:25.378755 28408 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 1.010s	user 0.007s	sys 0.005s
I20260709 12:18:25.379033 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.378635 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.379837 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.381359 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.406502 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.406750 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.406474 24591 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
W20260709 12:18:25.393262 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.408725 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:25.381636 24600 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:25.412467 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.413137 24595 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:25.413527 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.416049 23918 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:25.381533 28124 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:25.411351 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.411908 24596 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:25.416348 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.417866 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.418787 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:25.420158 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.425266 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.426105 24067 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:25.427244 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.405833 28210 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.431555 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:25.380576 28254 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:18:25.410182 28339 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.444063 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:25.444276 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.445550 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:25.445122 24068 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:25.459136 23918 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:25.461310 23918 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:25.462589 24592 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:18:25.465248 23912 raft_consensus.cc:3060] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:25.455461 28415 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:25.430619 28124 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.467227 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:25.471103 28402 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 1.466s	user 0.002s	sys 0.000s
I20260709 12:18:25.438651 28210 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.449223 28339 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.449585 27917 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:18:25.475594 28438 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:25.495729 23920 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:25.499634 23989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 2264) took 1048 ms. Trace:
I20260709 12:18:25.500783 23989 rpcz_store.cc:276] 0709 12:18:24.451246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.551218 (+ 99972us) service_pool.cc:224] Handling call
0709 12:18:25.499431 (+948213us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b5400066dd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:25.499570 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1095082240}
I20260709 12:18:25.500288 23994 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:18:25.490907 28438 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.512455 23912 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:25.504240 28438 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:25.520836 23917 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2475) took 3298 ms (client timeout 2682 ms). Trace:
I20260709 12:18:25.522408 24065 raft_consensus.cc:1240] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:25.524350 28339 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:25.525068 28124 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:25.526958 28157 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.527376 28388 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.527499 28157 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.527946 28388 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.530249 28220 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:25.530786 28220 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.534017 28157 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.535202 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.536689 28388 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.538182 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.541352 24065 raft_consensus.cc:1240] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 12. Current term is 13. Ops: []
W20260709 12:18:25.521410 23917 rpcz_store.cc:269] 0709 12:18:22.216971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.593741 (+376770us) service_pool.cc:224] Handling call
0709 12:18:25.515165 (+2921424us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54002ec554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:25.515285 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413635456}
I20260709 12:18:25.547767 28124 consensus_queue.cc:1059] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:18:25.569278 28124 consensus_queue.cc:1243] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer a46beb8868d749fdbaa732dd1ef6b89b log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:25.569831 28124 raft_consensus.cc:3055] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:25.570151 28124 raft_consensus.cc:740] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:25.561163 28291 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.570978 28124 consensus_queue.cc:260] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.572135 28124 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:25.572386 24591 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:25.574057 28390 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:25.576378 28465 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:18:25.577935 28466 log.cc:927] Time spent T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:18:25.582224 24068 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:25.572142 28291 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.597111 28388 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:25.586184 28210 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:25.606534 28157 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:25.607344 28157 consensus_queue.cc:1243] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer 71a48f59ff764d249519c6a53ec57f02 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:18:25.607810 28157 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:25.602643 28381 consensus_queue.cc:1059] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:18:25.608160 28157 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:25.608533 28381 raft_consensus.cc:3055] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:25.608646 28397 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:25.609002 28381 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:25.609078 28157 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.609285 28397 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:25.608346 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.611326 28157 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:25.611507 28397 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.612648 28397 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.613088 28397 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.614367 28375 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.615016 28375 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.616844 28375 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.614434 23996 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:25.618002 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 696) took 1618 ms. Trace:
I20260709 12:18:25.618400 23919 rpcz_store.cc:276] 0709 12:18:23.999793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.088675 (+ 88882us) service_pool.cc:224] Handling call
0709 12:18:24.088970 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.054410 (+965440us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.617749 (+563339us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54000a91d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:25.617924 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210514816}
W20260709 12:18:25.620251 23914 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45136 (request call id 2488) took 2994 ms (client timeout 2307 ms). Trace:
W20260709 12:18:25.620707 23914 rpcz_store.cc:269] 0709 12:18:22.640907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.741392 (+100485us) service_pool.cc:224] Handling call
0709 12:18:25.620074 (+2878682us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54000a87d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:25.620190 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3068148096}
I20260709 12:18:25.621954 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.625064 23989 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:25.626938 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.631537 23991 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 2242) took 4976 ms (client timeout 1745 ms). Trace:
W20260709 12:18:25.631951 23991 rpcz_store.cc:269] 0709 12:18:20.655001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.672798 (+ 17797us) service_pool.cc:224] Handling call
0709 12:18:25.631343 (+4958545us) spinlock_profiling.cc:243] Waited 3.04 s on lock 0x7b54002ab2d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:25.631451 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6983732608}
I20260709 12:18:25.610088 28381 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.635783 28381 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:25.637640 23917 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:25.638765 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:25.639146 23991 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:25.639288 23915 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:25.629971 28379 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.640172 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.620378 28397 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.640901 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.658752 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.660815 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:25.663024 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.663612 23992 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:25.665366 28438 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.667953 28438 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.671167 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.671958 23992 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:25.671820 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.672328 23995 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:25.673146 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.673943 23987 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 15.
I20260709 12:18:25.674117 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:25.675444 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.675117 23989 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:25.677057 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.677554 28220 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:25.683858 28217 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:25.686443 28214 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:25.691946 23992 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:18:25.692113 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54686.5us
I20260709 12:18:25.693322 23915 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:25.696409 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.705838 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.704349 28217 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:18:25.695643 28397 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:25.728796 28397 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:25.749281 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.750620 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2246) took 2860 ms. Trace:
I20260709 12:18:25.750689 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.751156 24061 rpcz_store.cc:276] 0709 12:18:22.889804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.889927 (+   123us) service_pool.cc:224] Handling call
0709 12:18:24.955713 (+2065786us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.956582 (+   869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.748346 (+791764us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b5400273650. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:25.750541 (+  2195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4702752000}
I20260709 12:18:25.755882 28330 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.756374 28330 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.758931 28330 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:25.764072 28258 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.772812 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.774601 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.775219 24065 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:25.776029 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:25.776571 24065 raft_consensus.cc:3060] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:25.774094 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.781867 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.783706 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:25.784583 28346 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.174s	user 0.017s	sys 0.017s
I20260709 12:18:25.784775 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.812614 24063 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:25.789202 28397 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.790735 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.820884 23987 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:25.791931 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:25.781669 23807 maintenance_manager.cc:643] P b335f82e70ec42589bee8577eecf648f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 9.581s	user 0.192s	sys 0.065s Metrics: {"bytes_written":30278,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":207123,"dirs.run_cpu_time_us":593,"dirs.run_wall_time_us":74612,"drs_written":1,"lbm_read_time_us":63014,"lbm_reads_1-10_ms":2,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":1,"lbm_write_time_us":245745,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":7,"lbm_writes_lt_1ms":26,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":176408,"threads_started":2,"update_count":26,"wal-append.queue_time_us":68200}
I20260709 12:18:25.795722 28258 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.796232 28420 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.797602 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:25.807374 28477 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.785995 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.815346 23992 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:25.822077 23995 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:25.818421 28346 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.208s	user 0.017s	sys 0.017s
I20260709 12:18:25.853997 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.842905 28346 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:25.826829 28420 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.826949 28258 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.882685 23995 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:25.880601 24566 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:25.881898 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 61579.4us
I20260709 12:18:25.883755 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:25.884590 24036 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:25.885794 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:25.846838 28477 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:25.891829 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:25.892982 28480 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:25.896554 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:25.899598 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 171848us
I20260709 12:18:25.904443 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.905318 24063 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:25.900521 23960 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:25.918192 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:25.898344 28425 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:25.923336 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.924297 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.898612 28381 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:25.913908 28348 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.622s	user 0.014s	sys 0.022s
I20260709 12:18:25.899060 28337 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.926108 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.885757 28390 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:18:25.907011 28268 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:25.901613 28124 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:25.930148 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:25.932133 24592 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 14: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:25.934653 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:25.934494 23808 maintenance_manager.cc:419] P b335f82e70ec42589bee8577eecf648f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9700 bytes on disk
I20260709 12:18:25.925031 28425 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.936961 24591 raft_consensus.cc:2393] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:18:25.927747 28348 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.640s	user 0.015s	sys 0.023s
W20260709 12:18:25.936223 28387 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.923s	user 0.026s	sys 0.039s
I20260709 12:18:25.901096 28480 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:18:25.941627 24597 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:25.943064 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.947603 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:25.947872 24063 raft_consensus.cc:2410] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:18:25.942646 24600 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:25.943233 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.948345 24595 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 14: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:25.949079 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.946762 24065 raft_consensus.cc:2468] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:25.950363 23886 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:25.951084 24065 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:18:25.946489 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 60801.7us
I20260709 12:18:25.948915 24592 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:25.956363 23807 maintenance_manager.cc:643] P b335f82e70ec42589bee8577eecf648f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":331,"lbm_reads_lt_1ms":4}
I20260709 12:18:25.958485 28337 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:25.959086 28337 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:25.960083 28337 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:25.952142 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2256) took 2249 ms. Trace:
I20260709 12:18:25.961115 24066 rpcz_store.cc:276] 0709 12:18:23.703058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.703725 (+   667us) service_pool.cc:224] Handling call
0709 12:18:23.713379 (+  9654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:23.872322 (+158943us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:23.872352 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:23.872832 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:18:23.994236 (+121404us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:23.994274 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.947271 (+1952997us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540004c254. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:25.947322 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.947359 (+    37us) raft_consensus.cc:1685] finished
0709 12:18:25.947370 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:25.952084 (+  4714us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1734,"raft.queue_time_us":19112,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":15802,"spinlock_wait_cycles":364628864,"thread_start_us":119944,"threads_started":1,"wal-append.queue_time_us":300738,"wal-append.run_cpu_time_us":11451,"wal-append.run_wall_time_us":1540908}
I20260709 12:18:25.964052 28258 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:25.966473 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:25.968770 23886 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:25.953768 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:25.970391 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:25.949815 28387 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.954s	user 0.026s	sys 0.040s
I20260709 12:18:25.940902 28268 raft_consensus.cc:697] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:25.949401 28425 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:25.972874 24036 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:25.949535 28381 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:25.968078 28157 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 12:18:25.978924 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.935828 28346 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:25.984138 28479 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:18:25.985522 28472 log.cc:927] Time spent T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260709 12:18:25.992764 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.979401 28483 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
I20260709 12:18:25.971247 28487 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:25.973363 28390 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:18:25.986887 28481 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 12:18:25.972015 28397 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:26.008527 28397 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:26.009040 28397 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:26.010448 28344 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.012048 28394 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.015303 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 1036) took 2173 ms. Trace:
I20260709 12:18:26.015637 24593 rpcz_store.cc:276] 0709 12:18:23.841570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:23.844020 (+  2450us) service_pool.cc:224] Handling call
0709 12:18:23.844362 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:24.028497 (+184135us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.028526 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:24.028956 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:18:25.730127 (+1701171us) spinlock_profiling.cc:243] Waited 4.03 ms on lock 0x7b18002630e0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:18:25.873538 (+143411us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:25.873596 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:25.983944 (+110348us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b5400572954. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:25.984004 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:25.986214 (+  2210us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:26.015091 (+ 28877us) raft_consensus.cc:1685] finished
0709 12:18:26.015111 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.015241 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19789,"raft.queue_time_us":163328,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10095,"spinlock_wait_cycles":177576832,"thread_start_us":264652,"threads_started":2,"wal-append.queue_time_us":1850890}
W20260709 12:18:26.017234 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.015651 28262 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:18:26.018509 28420 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:26.021706 24062 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:26.024863 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2502) took 1754 ms. Trace:
I20260709 12:18:25.989326 28381 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:26.027767 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:25.975275 28379 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:26.035983 28379 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.995616 28330 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.036422 28379 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:25.974205 28387 raft_consensus.cc:697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
W20260709 12:18:26.032415 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.025329 23913 rpcz_store.cc:276] 0709 12:18:24.278394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.697373 (+418979us) service_pool.cc:224] Handling call
0709 12:18:24.715358 (+ 17985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:24.797997 (+ 82639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:24.798032 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:24.798480 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 12:18:24.872273 (+ 73793us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:24.921428 (+ 49155us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.921888 (+   460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.024385 (+1102497us) spinlock_profiling.cc:243] Waited 82.3 ms on lock 0x7b54001fed54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:26.024447 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.024506 (+    59us) raft_consensus.cc:1685] finished
0709 12:18:26.024624 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.024796 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15938,"prepare.queue_time_us":60873,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":784,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":3050,"spinlock_wait_cycles":189867776,"thread_start_us":89724,"threads_started":2,"wal-append.queue_time_us":106121,"wal-append.run_cpu_time_us":2263,"wal-append.run_wall_time_us":1032032}
I20260709 12:18:25.994702 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:26.044354 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49768.4us
I20260709 12:18:26.044683 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:26.045081 24036 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:26.026906 28390 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.041541 24564 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:26.046692 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:26.048997 24067 raft_consensus.cc:2368] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:26.049749 28441 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.058373 23995 raft_consensus.cc:3055] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:26.058766 23995 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:25.998229 28210 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:18:26.058301 28339 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.064131 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2245) took 3174 ms. Trace:
I20260709 12:18:26.036952 28381 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:26.067122 23988 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:26.052482 28390 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:26.071028 23993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 2274) took 1393 ms. Trace:
I20260709 12:18:26.059526 23995 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.075922 23995 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.064659 24069 rpcz_store.cc:276] 0709 12:18:22.889339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.889482 (+   143us) service_pool.cc:224] Handling call
0709 12:18:22.909971 (+ 20489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:25.498497 (+2588526us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:25.502813 (+  4316us) log.cc:844] Serialized 14 byte log entry
0709 12:18:25.550044 (+ 47231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:25.550108 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:25.550165 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.063653 (+513488us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b540021c0d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:26.063701 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.064025 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3911,"prepare.queue_time_us":4439,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":1242,"raft.queue_time_us":118,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2885,"spinlock_wait_cycles":5952404352,"thread_start_us":46700,"threads_started":1,"wal-append.queue_time_us":95129}
I20260709 12:18:26.079116 24595 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:18:26.082418 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.071555 23993 rpcz_store.cc:276] 0709 12:18:24.677206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.718721 (+ 41515us) service_pool.cc:224] Handling call
0709 12:18:24.743169 (+ 24448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:24.793093 (+ 49924us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:24.898028 (+104935us) log.cc:844] Serialized 14 byte log entry
0709 12:18:24.914984 (+ 16956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:24.915047 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:24.915103 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.070767 (+1155664us) spinlock_profiling.cc:243] Waited 49.6 ms on lock 0x7b540024f9d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:26.070817 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:26.070950 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":133130,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2408,"raft.queue_time_us":129,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":114126720,"thread_start_us":106405,"threads_started":2,"wal-append.queue_time_us":28754,"wal-append.run_cpu_time_us":991,"wal-append.run_wall_time_us":1024778}
I20260709 12:18:26.061219 28388 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:26.070209 28397 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.032183 28268 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.077761 28441 consensus_queue.cc:1059] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:18:26.084411 28220 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 12:18:26.103539 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 130592us
I20260709 12:18:26.120519 24594 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:26.142362 23960 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:26.145454 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 70286.5us
W20260709 12:18:26.148991 23887 connection.cc:256] RPC call timeout handler was delayed by -1.5351657170001545s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 12:18:26.149127 23994 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 772) took 1170 ms. Trace:
I20260709 12:18:26.149477 23994 rpcz_store.cc:276] 0709 12:18:24.978553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.090380 (+111827us) service_pool.cc:224] Handling call
0709 12:18:25.500044 (+409664us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:25.501925 (+  1881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.148945 (+647020us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b5400066dd0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:26.149072 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920192896}
I20260709 12:18:26.118474 28487 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:26.153126 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 317240us
I20260709 12:18:26.154529 23960 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:26.155738 23887 connection.cc:256] RPC call timeout handler was delayed by -1.4928657170000861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20790000000000003s for a response
W20260709 12:18:26.156162 23887 connection.cc:256] RPC call timeout handler was delayed by -1.4856657170000744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
I20260709 12:18:26.146173 28383 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:18:26.131109 28329 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:18:26.164152 23995 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
W20260709 12:18:26.159621 23887 connection.cc:256] RPC call timeout handler was delayed by -1.4316657170002145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 12:18:26.156858 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 65489.5us
W20260709 12:18:26.166095 23887 connection.cc:256] RPC call timeout handler was delayed by -1.410965717000181s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 12:18:26.114297 28387 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.158063 28409 raft_consensus.cc:2804] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:26.157347 28487 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:26.176707 23995 pending_rounds.cc:85] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 7
I20260709 12:18:26.175187 28475 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.178421 23995 pending_rounds.cc:107] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:18:26.178828 23995 raft_consensus.cc:2889] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:26.157792 28346 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:26.158489 28258 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:18:26.158633 28420 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:18:26.176026 28369 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.176209 28344 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.163293 28357 consensus_queue.cc:1059] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:18:26.205534 28100 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.175503 28220 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:18:26.216713 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 157705us
I20260709 12:18:26.209173 28409 raft_consensus.cc:697] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:26.209026 28477 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:26.211905 28351 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:26.238256 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 83050.3us
I20260709 12:18:26.206533 28475 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:26.227743 28337 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:26.242231 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:26.217713 28344 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:26.209306 28346 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.230510 28100 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.219934 28369 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:26.280011 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.253080 28397 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.249971 28351 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:26.247258 28337 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.258075 23962 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:26.313462 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 1042) took 1021 ms. Trace:
W20260709 12:18:26.330782 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 72791.1us
I20260709 12:18:26.330459 24594 rpcz_store.cc:276] 0709 12:18:25.291692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.294990 (+  3298us) service_pool.cc:224] Handling call
0709 12:18:26.313282 (+1018292us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54003ec454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:26.313387 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670066048}
W20260709 12:18:26.278901 28493 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
W20260709 12:18:26.316427 28488 log.cc:927] Time spent T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:26.315295 28425 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:26.310434 28492 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:18:26.331697 23962 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:26.312383 28346 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.307974 28475 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:26.334126 28499 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:26.311656 28247 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:26.320084 28100 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.339156 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:26.291371 28495 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:18:26.341225 28354 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:26.290246 28379 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.344058 23962 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:26.258260 28486 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 12:18:26.282791 28409 consensus_queue.cc:237] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:26.263758 28344 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:26.348572 23962 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:26.264220 28477 raft_consensus.cc:2764] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:18:26.349859 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 121423us
I20260709 12:18:26.342774 28247 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
W20260709 12:18:26.350931 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 113227us
I20260709 12:18:26.260718 28381 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.352573 23961 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:26.345183 28420 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:26.350293 28351 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.356722 28420 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:26.358565 28383 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:26.359860 28420 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:26.360266 23962 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:26.361135 28420 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:26.362355 23961 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:26.353781 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:26.364526 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.357635 28390 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:26.345818 28354 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:26.350112 28499 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:26.373452 23992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8132db9882c041d1845d0a8815c39788"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:26.374006 23992 raft_consensus.cc:606] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:26.370663 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:26.372129 23887 leader_election.cc:400] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:26.372540 24064 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:18:26.374981 23887 leader_election.cc:403] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:26.375121 24064 pending_rounds.cc:85] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 7
I20260709 12:18:26.375519 24064 pending_rounds.cc:107] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:18:26.375921 24064 raft_consensus.cc:2889] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:26.376190 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.377719 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.378021 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:26.379853 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:26.372566 28344 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.380879 28503 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:26.378437 23919 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:26.386518 23916 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:18:26.387763 28381 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.388100 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.390606 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.392191 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.392576 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.394801 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:26.395644 23920 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:26.402984 28337 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.403628 28441 raft_consensus.cc:3055] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:26.403717 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.404145 28441 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:26.405066 28441 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:26.411015 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.414717 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:26.407147 28504 log.cc:927] Time spent T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:26.419047 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.419930 23917 raft_consensus.cc:2410] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:18:26.421418 28421 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:26.422931 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.423748 23912 raft_consensus.cc:2410] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:18:26.424175 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.425426 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.426234 24595 raft_consensus.cc:2410] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:18:26.426796 24592 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:26.427847 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:26.428367 24593 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:26.428779 28390 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:26.430061 28425 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:26.430636 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.430801 28247 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.431324 28344 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:26.431838 28247 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:26.431416 28337 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.432899 28337 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.435178 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.435763 23989 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:26.436560 28337 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.436614 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:26.437270 23990 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.436940 28487 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.389549 28477 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:26.389386 28499 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.438871 28499 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:26.369606 28354 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.441761 24593 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 16.
I20260709 12:18:26.443161 24061 raft_consensus.cc:1275] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:26.443490 23988 raft_consensus.cc:1240] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:26.444387 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:26.445626 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:26.445696 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 75885.3us
I20260709 12:18:26.446591 23995 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:26.446555 23961 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:26.406258 28379 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.406243 28441 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:26.454515 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:26.455852 23995 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:26.463163 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.455935 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:26.457113 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:26.464007 23961 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:26.464128 24070 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:26.459355 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:26.463773 23993 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 7.
I20260709 12:18:26.468261 23990 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:26.432021 28344 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.464262 24067 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:26.470558 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:26.471181 24061 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.471386 28344 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.472357 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.473114 24597 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:18:26.467659 24566 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:26.476418 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.479135 24063 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:26.481889 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:26.482110 23886 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:26.482478 23991 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:26.475654 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.485468 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:26.486579 23919 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:26.489226 28357 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:26.487368 28480 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:18:26.493260 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.494443 28489 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:26.494889 28489 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:26.495254 28489 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.497486 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:26.497925 23961 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:18:26.498632 24564 leader_election.cc:336] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.634s (SENT)
I20260709 12:18:26.499058 24564 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:26.502403 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.503391 23991 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:26.504155 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:26.504830 24061 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:26.504802 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:26.506472 23991 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:26.511022 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.514953 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:26.516559 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:26.517524 24067 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:26.480392 28425 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:26.480216 28486 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:26.487160 28100 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:26.483888 28421 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:26.527035 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.528263 24063 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:26.530493 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:26.539070 24061 raft_consensus.cc:2410] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:18:26.547060 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.547293 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 2332) took 2446 ms. Trace:
I20260709 12:18:26.474846 28339 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:18:26.553954 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:26.556249 23995 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:26.527426 28425 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:26.547598 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.548085 23914 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:26.558472 23914 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:26.549220 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.561566 23917 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:26.549998 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.547627 24062 rpcz_store.cc:276] 0709 12:18:24.101023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.988533 (+887510us) service_pool.cc:224] Handling call
0709 12:18:24.988796 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.022179 (+1033383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.547060 (+524881us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400070654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:26.547240 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2374829312}
I20260709 12:18:26.553129 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.453225 28505 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:18:26.561589 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.569063 24600 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:26.549398 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.564548 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.521247 28357 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:26.567363 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:26.571090 24062 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:26.559614 23914 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:26.485611 28503 consensus_queue.cc:1059] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:18:26.560644 24592 raft_consensus.cc:2376] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9. Re-sending same reply.
I20260709 12:18:26.678756 24062 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:18:26.575640 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:26.578835 24596 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 11: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:26.531775 28480 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:26.679860 24062 pending_rounds.cc:85] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 8
I20260709 12:18:26.684935 24062 pending_rounds.cc:107] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:18:26.685249 24062 raft_consensus.cc:2889] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:26.685580 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:26.680775 23914 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.534080 28395 consensus_queue.cc:1048] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:18:26.661378 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:26.547123 28330 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:26.658583 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.661892 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.649385 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:26.686133 23913 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:26.687263 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 111695us
I20260709 12:18:26.702694 23961 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:26.704821 24066 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:26.648891 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 78905.2us
W20260709 12:18:26.690660 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.693068 23995 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:26.707666 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.535354 28421 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:26.708763 23913 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:26.713150 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:26.714241 24066 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:26.712123 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:26.585167 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:26.639462 28344 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:26.551919 28100 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:26.663977 28483 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:26.565855 28425 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.555063 28369 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.679833 28157 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.727639 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:26.745460 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 248181us
I20260709 12:18:26.747273 23913 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:26.639747 28487 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.695081 28490 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:26.707883 28493 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:18:26.743247 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.708580 28480 raft_consensus.cc:697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:26.709903 28421 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:26.737015 28475 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.745426 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.765938 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:26.733902 28256 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.764336 28100 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.766641 28369 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:26.736163 28344 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.779038 23914 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:18:26.764106 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.780275 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.784022 23918 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:26.803330 23991 raft_consensus.cc:2393] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:26.804256 23914 pending_rounds.cc:85] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 6
I20260709 12:18:26.719339 28330 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.790637 23913 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:26.791200 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.798467 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.808823 23916 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:26.785136 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.804744 23914 pending_rounds.cc:107] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:18:26.810178 23914 raft_consensus.cc:2889] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:26.805495 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.806499 23912 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:18:26.811509 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:26.813349 23914 raft_consensus.cc:2410] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 12:18:26.826042 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.766719 28157 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:26.840499 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.840456 23916 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:26.844408 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.845335 23916 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 15.
I20260709 12:18:26.852550 28354 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.853700 23987 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:26.854748 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.852241 23918 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:26.858752 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:26.865527 23960 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:26.794103 28475 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:26.877405 23960 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:26.817088 28369 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:26.881611 28256 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 12:18:26.889741 28521 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:18:26.891563 28157 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:26.892678 28409 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:18:26.894039 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.895375 28409 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:18:26.898159 28518 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 12:18:26.899497 24596 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:26.899848 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.903563 28397 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:26.907295 28522 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:26.908689 28354 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.910547 28344 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:26.913230 28508 log.cc:927] Time spent T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.483s	user 0.000s	sys 0.002s
I20260709 12:18:26.913897 28485 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:26.914211 23987 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:26.915512 23987 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:26.916512 23987 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:26.919039 28337 raft_consensus.cc:3055] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:26.919533 28337 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:26.920536 28337 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.921133 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.925164 24063 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:26.862612 28496 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:26.875697 28351 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:26.921994 28337 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:26.935912 28354 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:26.936444 28496 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:26.916203 28489 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.951565 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:26.944090 23919 raft_consensus.cc:2410] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:26.957863 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:26.886835 28330 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.962963 24063 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:26.966337 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:26.969851 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:26.971071 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.972086 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:26.977090 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.978729 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:26.979386 23912 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:26.980192 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:26.980712 23912 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:26.983796 28489 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:26.938622 28496 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:26.985522 28397 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:26.986055 28397 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:26.988077 28397 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:26.988981 28520 log.cc:927] Time spent T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:18:26.882536 28480 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:26.991400 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:26.994267 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:26.964704 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:26.995983 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:26.943068 28351 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.000262 28503 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:27.001116 28503 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:26.965620 28247 consensus_meta.cc:287] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 12:18:27.003353 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:27.031428 24591 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
W20260709 12:18:27.008070 24034 leader_election.cc:336] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.500s (SENT)
I20260709 12:18:27.032522 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:27.013768 28475 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:27.002172 28351 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.015558 28369 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:27.016479 28346 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:27.016731 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:27.023169 23960 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:26.998153 28441 consensus_meta.cc:287] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.003s
I20260709 12:18:27.026808 24036 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.031957 23912 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:27.064086 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:27.065629 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:27.066901 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:27.067457 23912 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:27.068116 23912 raft_consensus.cc:2368] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12.
I20260709 12:18:26.950896 28344 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:18:26.999692 28397 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:27.071275 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44604us
I20260709 12:18:27.072207 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:27.073572 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 358156us
I20260709 12:18:27.074692 24598 raft_consensus.cc:2410] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:18:27.061205 28499 consensus_meta.cc:287] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.000s
I20260709 12:18:27.076225 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:27.029102 28390 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:27.057499 28496 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:27.077466 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:27.083889 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37704 (request call id 1213) took 1706 ms (client timeout 2032 ms). Trace:
W20260709 12:18:27.084414 24599 rpcz_store.cc:269] 0709 12:18:25.377908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.378823 (+   915us) service_pool.cc:224] Handling call
0709 12:18:27.083717 (+1704894us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54004fd654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:27.083837 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467167616}
I20260709 12:18:27.071187 28485 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:27.057973 28395 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:18:27.076892 28157 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:18:27.123320 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.078292 28388 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:27.127178 24566 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:27.127857 23921 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:18:27.128253 23921 pending_rounds.cc:85] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 7
I20260709 12:18:27.128731 23921 pending_rounds.cc:107] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:18:27.129067 23921 raft_consensus.cc:2889] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:27.145349 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.071668 28346 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:27.081350 28499 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:27.084522 28390 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:27.088981 28210 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:27.149711 28525 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:27.250346 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 113740us
W20260709 12:18:27.251121 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.252017 23994 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:27.254825 23919 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 15. Current term is 16. Ops: []
W20260709 12:18:27.254809 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 256967us
W20260709 12:18:27.256089 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 129983us
W20260709 12:18:27.268935 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.356299 23990 raft_consensus.cc:2368] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
W20260709 12:18:27.440255 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 71265us
W20260709 12:18:27.378189 24064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.990s	user 0.027s	sys 0.027s
I20260709 12:18:27.484452 24063 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:18:27.407752 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.372174 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 376210us
W20260709 12:18:27.441570 24064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.033s	sys 0.036s
W20260709 12:18:27.491503 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 126250us
I20260709 12:18:27.492010 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:27.482729 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.493332 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.382444 28523 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.592s	user 0.004s	sys 0.001s
W20260709 12:18:27.385166 28531 log.cc:927] Time spent T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
W20260709 12:18:27.504132 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.515911 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.364709 28525 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:27.492153 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:27.560418 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 68343.7us
I20260709 12:18:27.517990 28397 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:27.523141 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 795) took 1023 ms. Trace:
I20260709 12:18:27.561452 23992 rpcz_store.cc:276] 0709 12:18:26.500146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.877510 (+377364us) service_pool.cc:224] Handling call
0709 12:18:26.877798 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.878136 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.878161 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.883851 (+  5690us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.234708 (+350857us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:27.234760 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.234906 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.522873 (+287967us) raft_consensus.cc:1685] finished
0709 12:18:27.522901 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.523068 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4560,"raft.queue_time_us":3758,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4589,"thread_start_us":269084,"threads_started":1,"wal-append.queue_time_us":434062}
I20260709 12:18:27.375191 28346 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:27.491128 28220 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.525856 28532 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 12:18:27.322256 28425 consensus_meta.cc:287] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.557s	user 0.013s	sys 0.005s
I20260709 12:18:27.480067 28210 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:27.557981 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:27.480458 28247 consensus_queue.cc:1059] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:18:27.561060 24566 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:27.568274 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.560009 28475 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:27.581486 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:27.562852 28441 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:27.587334 24592 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:27.563302 28525 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.585845 23988 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:27.588195 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.571736 28357 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:27.591169 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.582082 28344 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:27.590758 28538 log.cc:927] Time spent T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:18:27.590190 28529 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:27.597100 28526 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 12:18:27.592144 28346 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:27.575055 28220 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:27.620977 24070 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 896) took 1106 ms. Trace:
I20260709 12:18:27.578341 28425 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:27.619351 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.625471 23887 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.593438 28548 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:27.589331 28441 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:27.610493 28369 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:27.621368 24070 rpcz_store.cc:276] 0709 12:18:26.514376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.517910 (+  3534us) service_pool.cc:224] Handling call
0709 12:18:26.518341 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.532046 (+ 13705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.532096 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.532670 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.874788 (+342118us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:26.929079 (+ 54291us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.929300 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.929368 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.620776 (+691408us) raft_consensus.cc:1685] finished
0709 12:18:27.620795 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.620921 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21842,"prepare.queue_time_us":54091,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":6500,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":8989,"thread_start_us":237081,"threads_started":1,"wal-append.queue_time_us":498407}
W20260709 12:18:27.621891 28543 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:18:27.621721 28535 log.cc:927] Time spent T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:18:27.636512 23916 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:18:27.640553 24034 leader_election.cc:336] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.715s (SENT)
I20260709 12:18:27.647078 24595 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:27.620695 28346 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:27.617357 28552 consensus_queue.cc:1059] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:18:27.678124 28553 raft_consensus.cc:3055] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:27.678581 28553 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:27.679414 28553 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:27.680423 28553 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.682638 28556 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:18:27.683375 28547 log.cc:927] Time spent T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:18:27.687340 28475 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:27.685513 28556 consensus_queue.cc:1059] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 12:18:27.689174 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.609031 28210 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:27.655491 28548 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:27.671128 28346 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:27.626832 28344 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
W20260709 12:18:27.705996 28337 consensus_meta.cc:287] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.755s	user 0.007s	sys 0.003s
I20260709 12:18:27.707834 28529 raft_consensus.cc:697] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
W20260709 12:18:27.715857 28534 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:18:27.709331 28421 consensus_meta.cc:287] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.913s	user 0.003s	sys 0.009s
I20260709 12:18:27.705952 28482 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:27.712802 28523 log.cc:927] Time spent T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:18:27.717581 28496 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.735641 28537 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 12:18:27.737279 23912 raft_consensus.cc:1275] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:18:27.742146 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 116737us
I20260709 12:18:27.745042 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.746340 23912 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:18:27.709482 28383 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:18:27.758050 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.729364 28482 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:27.769285 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 725) took 1364 ms. Trace:
W20260709 12:18:27.773394 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 114003us
I20260709 12:18:27.771787 23920 rpcz_store.cc:276] 0709 12:18:26.405263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.406316 (+  1053us) service_pool.cc:224] Handling call
0709 12:18:26.406614 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.406955 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:26.481063 (+ 74108us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.698065 (+217002us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.698216 (+   151us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.698647 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.698757 (+   110us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:26.698900 (+   143us) log.cc:844] Serialized 14 byte log entry
0709 12:18:26.708950 (+ 10050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.709014 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:26.898357 (+189343us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b180043c7e0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:26.938169 (+ 39812us) spinlock_profiling.cc:243] Waited 7.13 ms on lock 0x7b4800002dd8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c5b7baa1 00007f75c5b72b37 00007f75c5b729ca 00007f75c5c6a26f 00007f75c5c69f37 00007f75c5c7e55c 00007f75c5c7e508 00007f75c5c7e488 00007f75c5c7e443 00007f75c5c7d6ec 00007f75c4ba7a96
0709 12:18:26.979325 (+ 41156us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b180043c7e0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb65522 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:27.381857 (+402532us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:27.769013 (+387156us) raft_consensus.cc:1685] finished
0709 12:18:27.769048 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.769207 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39904,"prepare.queue_time_us":697814,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":19734,"raft.run_cpu_time_us":3031,"raft.run_wall_time_us":248604,"spinlock_wait_cycles":58524416,"thread_start_us":210262,"threads_started":2,"wal-append.queue_time_us":184395}
I20260709 12:18:27.778612 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:27.781514 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.781667 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:27.786990 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 138389us
I20260709 12:18:27.788131 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:27.788830 23991 raft_consensus.cc:2368] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:27.788875 23920 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:27.792753 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:27.793490 23991 raft_consensus.cc:2393] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 7: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:27.795423 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.796427 24067 raft_consensus.cc:2410] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:18:27.798620 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.799368 24068 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:27.797963 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.802407 24067 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 13: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:27.795423 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:27.804106 23991 raft_consensus.cc:2368] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:27.806855 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.809362 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.810222 24070 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:27.811293 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.812194 24067 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:18:27.812726 28381 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:27.814641 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.815491 24068 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:27.815649 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:27.817739 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.817828 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:27.819566 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.820358 28339 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:27.820974 28339 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:27.821650 28339 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:27.823658 24034 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.822003 28339 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:27.824626 28339 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:27.827044 28549 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:27.835731 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.837594 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.839236 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.841740 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:27.843863 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:27.774434 28337 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:27.846933 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:27.741569 28421 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:27.854956 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 53232.1us
I20260709 12:18:27.855990 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:27.755143 28496 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:27.846839 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:27.855023 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:27.852452 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:27.882498 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:27.883069 23995 raft_consensus.cc:2368] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:27.853772 23920 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:27.756001 28369 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:18:27.828909 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.775679 28560 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.888504 24593 raft_consensus.cc:1240] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:27.887342 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 58589.4us
I20260709 12:18:27.891242 24034 leader_election.cc:400] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12.
I20260709 12:18:27.895120 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.896641 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.898150 24068 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:18:27.915670 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.925012 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.856671 28553 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:18:27.895995 28381 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:27.889878 28390 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:27.939532 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:27.943717 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:27.944995 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:27.902478 28441 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:27.929229 28551 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:27.929692 28557 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:27.957886 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.958612 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 109630us
I20260709 12:18:27.956005 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2535) took 1037 ms. Trace:
I20260709 12:18:27.965934 23913 rpcz_store.cc:276] 0709 12:18:26.918950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.252590 (+333640us) service_pool.cc:224] Handling call
0709 12:18:27.252895 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.253099 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.253123 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.300115 (+ 46992us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.488413 (+188298us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:27.491598 (+  3185us) log.cc:844] Serialized 14 byte log entry
0709 12:18:27.491775 (+   177us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.491854 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.737639 (+245785us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b18003d8ca0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:27.941637 (+203998us) raft_consensus.cc:1685] finished
0709 12:18:27.954856 (+ 13219us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.955944 (+  1088us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7199,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":4898,"raft.queue_time_us":4751,"spinlock_wait_cycles":53043328,"thread_start_us":166300,"threads_started":1,"wal-append.queue_time_us":209621}
I20260709 12:18:27.930105 28425 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:27.953552 28545 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:27.856300 28529 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:27.969084 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:27.986352 28337 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:27.987011 28337 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:27.930430 28549 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:18:27.989080 28344 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:27.989377 28337 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:27.989537 28344 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:27.961130 28390 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:27.990039 28337 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:27.991073 28337 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:27.991467 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2290) took 1086 ms. Trace:
I20260709 12:18:27.991700 28337 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:27.991879 24062 rpcz_store.cc:276] 0709 12:18:26.904692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.918783 (+ 14091us) service_pool.cc:224] Handling call
0709 12:18:26.919033 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.937561 (+ 18528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.937592 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:26.937631 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:26.937664 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.991245 (+1053581us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b5400265a54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:27.991292 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:27.991414 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42181504}
I20260709 12:18:27.993614 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2714) took 1172 ms. Trace:
I20260709 12:18:27.999487 28496 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:27.899885 28482 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.001199 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2287) took 1458 ms. Trace:
I20260709 12:18:27.902552 28555 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 12:18:28.001784 28575 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.005956 23994 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:27.971726 28475 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:28.010756 28337 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.011319 28490 raft_consensus.cc:993] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:28.015903 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:27.990381 28390 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:27.994032 23919 rpcz_store.cc:276] 0709 12:18:26.821500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.080638 (+259138us) service_pool.cc:224] Handling call
0709 12:18:27.080957 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.365726 (+284769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.993394 (+627668us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540017aa54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:27.993558 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237440896}
I20260709 12:18:27.990054 28344 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:28.018762 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:28.034758 24597 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:28.019804 24069 rpcz_store.cc:276] 0709 12:18:26.543232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.543362 (+   130us) service_pool.cc:224] Handling call
0709 12:18:26.543776 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.576643 (+ 32867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.576676 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.658987 (+ 82311us) log.cc:844] Serialized 26 byte log entry
0709 12:18:26.880772 (+221785us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:26.880830 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.880923 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.000327 (+1119404us) spinlock_profiling.cc:243] Waited 8.11 ms on lock 0x7b24001ef638. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bd9eb9c4 00007f75bd9e9acb 00007f75bdba4dc9 00007f75bdba4a55 00007f75bdba3fb0 00007f75c081a488 00007f75c081abe8 00007f75c07f2398 00007f75c07ed76a 00007f75c07ecbb6
0709 12:18:28.000859 (+   532us) raft_consensus.cc:1685] finished
0709 12:18:28.000890 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.001133 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32259,"raft.queue_time_us":33236,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":21439,"spinlock_wait_cycles":18661760,"thread_start_us":173715,"threads_started":1,"wal-append.queue_time_us":439563}
W20260709 12:18:27.973865 28351 consensus_meta.cc:287] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.002s
I20260709 12:18:28.022359 24596 raft_consensus.cc:1240] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:28.024149 23994 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:28.009809 28421 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:28.028765 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:18:28.029634 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 104859us
I20260709 12:18:28.052608 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:28.015625 28561 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:28.021833 27904 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:28.036937 23994 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.054303 23994 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:28.016827 23961 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:27.974040 28557 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.061724 28557 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:27.961628 28562 consensus_queue.cc:1059] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:18:27.984169 28220 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.037321 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:28.062927 28490 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:28.022749 28553 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.022562 28554 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.070262 24597 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:28.019335 28420 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:28.075219 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2718) took 1148 ms. Trace:
I20260709 12:18:28.080060 28337 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:28.080233 24591 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37708 (request call id 907) took 1655 ms (client timeout 1819 ms). Trace:
I20260709 12:18:28.084939 24595 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:28.033126 28409 raft_consensus.cc:1081] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:28.083319 24592 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:18:28.082419 23914 rpcz_store.cc:276] 0709 12:18:26.927230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.642600 (+715370us) service_pool.cc:224] Handling call
0709 12:18:27.642948 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.742789 (+ 99841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.742820 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.743252 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.956473 (+213221us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:27.956540 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.956880 (+   340us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.074941 (+118061us) raft_consensus.cc:1685] finished
0709 12:18:28.074971 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.075142 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44769,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":65,"thread_start_us":281085,"threads_started":2,"wal-append.queue_time_us":270171}
I20260709 12:18:28.071137 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2719) took 1143 ms. Trace:
I20260709 12:18:28.083905 23961 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:28.084671 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:28.051088 28482 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:28.038516 28576 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:28.087072 24591 rpcz_store.cc:269] 0709 12:18:26.424389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.430394 (+  6005us) service_pool.cc:224] Handling call
0709 12:18:28.080006 (+1649612us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b5400462154. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:28.080156 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380182400}
I20260709 12:18:28.089190 23916 rpcz_store.cc:276] 0709 12:18:26.927597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.648189 (+720592us) service_pool.cc:224] Handling call
0709 12:18:27.648558 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.661794 (+ 13236us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:27.691419 (+ 29625us) log.cc:844] Serialized 14 byte log entry
0709 12:18:27.898263 (+206844us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.899529 (+  1266us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.899739 (+   210us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:27.899768 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.899844 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.065517 (+165673us) raft_consensus.cc:1685] finished
0709 12:18:28.065536 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.071076 (+  5540us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12072,"prepare.queue_time_us":43817,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":98178,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7699,"thread_start_us":169681,"threads_started":1,"wal-append.queue_time_us":175727}
I20260709 12:18:28.095162 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:28.099839 23994 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:18:28.087479 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 189806us
W20260709 12:18:28.104908 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 223426us
W20260709 12:18:28.098332 28525 consensus_meta.cc:287] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 12:18:28.110177 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:28.108661 23961 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:28.135344 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:28.110177 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:28.072155 28552 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.029552 28575 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.112684 24591 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:28.165233 23886 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:28.082511 28475 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:28.096987 28577 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:28.100208 27917 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:28.190096 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 76012.3us
I20260709 12:18:28.071550 27904 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.112761 28490 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:28.105400 28489 raft_consensus.cc:3055] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:28.082758 28553 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.053659 28351 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:28.242117 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 106920us
I20260709 12:18:28.097718 28420 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.097040 28339 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.248989 28489 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:28.249992 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 142188us
I20260709 12:18:28.190263 28348 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.117076 28337 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.251786 23887 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:28.085958 28554 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:28.252800 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 87679.6us
I20260709 12:18:28.166644 28578 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.240489 28583 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:28.239562 28388 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:28.139544 28525 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.270076 23987 raft_consensus.cc:606] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:28.238359 28395 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:18:28.273160 23987 raft_consensus.cc:614] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:28.277117 23992 raft_consensus.cc:2368] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:28.264314 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:28.106137 28576 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.282671 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:28.284483 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.285622 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.287231 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:28.292224 23887 leader_election.cc:336] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Timed out: RequestConsensusVote RPC to 127.22.48.2:43801 timed out after 1.745s (SENT)
I20260709 12:18:28.293207 23920 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:28.296649 23916 raft_consensus.cc:2410] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:18:28.263264 28580 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:28.254930 28585 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:28.297695 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.299472 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:28.262094 28475 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:28.268374 28548 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:28.337635 28548 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.338183 28548 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.337857 28475 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.340255 28548 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:28.238879 28552 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.306915 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.342672 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.343633 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:28.343791 28552 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:28.344580 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.345566 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.309604 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:28.335150 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 85550.3us
I20260709 12:18:28.346837 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:28.271137 28529 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.341495 28548 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.349129 28548 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.350703 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:28.352427 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:28.262537 28409 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:18:28.251675 27917 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.356807 23914 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:28.300849 28337 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:28.303475 28580 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:28.268410 28348 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.305698 28583 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:28.293147 28388 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.377816 28580 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.399020 27904 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.399251 28575 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.399732 28599 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:28.400277 28599 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.356179 28584 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:18:28.407639 28351 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.390579 28593 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.422766 28339 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:28.422640 28593 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.423666 28348 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.424587 28388 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.424877 28593 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:28.426038 28553 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:28.394325 28579 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
I20260709 12:18:28.445576 28577 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:28.447544 28344 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:28.448951 28536 log.cc:927] Time spent T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.935s	user 0.002s	sys 0.001s
I20260709 12:18:28.441133 28581 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.459286 28554 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:28.460418 27917 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.461329 28420 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:28.422032 28346 consensus_meta.cc:287] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.700s	user 0.005s	sys 0.002s
I20260709 12:18:28.470697 28599 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.475052 23912 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:28.479089 23989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2579) took 1930 ms. Trace:
W20260709 12:18:28.480383 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 96846.2us
W20260709 12:18:28.469755 28586 log.cc:927] Time spent T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 12:18:28.508100 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 64461.7us
I20260709 12:18:28.501127 23989 rpcz_store.cc:276] 0709 12:18:26.549001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.908690 (+359689us) service_pool.cc:224] Handling call
0709 12:18:26.908959 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.909245 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.909272 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.909682 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.148495 (+238813us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:27.341106 (+192611us) log.cc:844] Serialized 14 byte log entry
0709 12:18:27.346014 (+  4908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.346088 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:27.991344 (+645256us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b18004a0740. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb65522 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:28.001354 (+ 10010us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b18004a0740. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb65522 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:28.448419 (+447065us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:28.478816 (+ 30397us) raft_consensus.cc:1685] finished
0709 12:18:28.478846 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.479015 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4628,"prepare.queue_time_us":192335,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":8851,"raft.queue_time_us":12611,"raft.run_cpu_time_us":187,"raft.run_wall_time_us":13720,"spinlock_wait_cycles":222791552,"thread_start_us":238525,"threads_started":1,"wal-append.queue_time_us":443975}
I20260709 12:18:28.500315 27917 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:28.501250 28346 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.510401 23920 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8132db9882c041d1845d0a8815c39788"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:18:28.511097 23920 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:28.511552 23920 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:28.513027 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.521715 23887 leader_election.cc:400] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:28.523113 23887 leader_election.cc:400] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:28.523931 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.525559 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.509053 28427 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.510485 28583 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.474668 28581 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.527128 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.527607 23916 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:28.509595 28420 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.538493 23887 leader_election.cc:400] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:28.509235 28490 raft_consensus.cc:697] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:28.510643 28580 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.535836 23920 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.538823 23887 leader_election.cc:403] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:18:28.536659 28548 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:28.540845 28598 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:28.548547 28581 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:28.539340 28576 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.536751 28427 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:28.550423 28530 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 1.028s	user 0.003s	sys 0.009s
I20260709 12:18:28.551648 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2282) took 2172 ms. Trace:
I20260709 12:18:28.552016 24064 rpcz_store.cc:276] 0709 12:18:26.379433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.379582 (+   149us) service_pool.cc:224] Handling call
0709 12:18:26.379959 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:26.387516 (+  7557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:26.387548 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:26.387958 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.491226 (+1103268us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:27.491275 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.491343 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.549773 (+1058430us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:28.551368 (+  1595us) raft_consensus.cc:1685] finished
0709 12:18:28.551394 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.551588 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1436,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"spinlock_wait_cycles":57236608,"thread_start_us":1102810,"threads_started":1,"wal-append.queue_time_us":952509}
I20260709 12:18:28.529413 28475 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:28.528838 28344 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:28.514293 27917 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.540235 28247 raft_consensus.cc:3055] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:28.568004 23920 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:28.557880 28576 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:28.565598 28247 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:28.571028 28247 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.571601 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.572000 28247 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:28.572502 23920 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:28.573473 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.575829 24599 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:28.574136 23920 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:28.577116 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:28.577683 23920 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:28.579504 28388 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:28.580116 28388 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.584009 24065 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2301) took 1140 ms. Trace:
I20260709 12:18:28.584383 24065 rpcz_store.cc:276] 0709 12:18:27.443870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.483397 (+ 39527us) service_pool.cc:224] Handling call
0709 12:18:27.483798 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.518778 (+ 34980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.518823 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:27.518882 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:27.518929 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.583803 (+1064874us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b540021c0d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:28.583844 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.583957 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79836928}
I20260709 12:18:28.587633 28346 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:28.588891 28560 consensus_meta.cc:287] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.686s	user 0.003s	sys 0.007s
I20260709 12:18:28.589316 28560 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:28.547578 28420 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.593493 28580 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.593725 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 913) took 1688 ms. Trace:
I20260709 12:18:28.594058 24593 rpcz_store.cc:276] 0709 12:18:26.905346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.919202 (+ 13856us) service_pool.cc:224] Handling call
0709 12:18:26.919459 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:27.888924 (+969465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.593471 (+704547us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b54003bea54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:28.593634 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2228109184}
I20260709 12:18:28.595407 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:28.595714 24600 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:18:28.595896 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:28.596082 24600 pending_rounds.cc:85] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Aborting all ops after (but not including) 9
I20260709 12:18:28.553228 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.596561 24600 pending_rounds.cc:107] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:18:28.596899 24600 raft_consensus.cc:2889] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:28.597196 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44073us
I20260709 12:18:28.597893 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.596005 24069 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 7.
W20260709 12:18:28.599248 24598 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 1053) took 2066 ms (client timeout 1890 ms). Trace:
I20260709 12:18:28.596604 24061 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
W20260709 12:18:28.599694 24598 rpcz_store.cc:269] 0709 12:18:26.533067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.557955 (+ 24888us) service_pool.cc:224] Handling call
0709 12:18:28.593089 (+2035134us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400557654. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:28.599177 (+  6088us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855500032}
I20260709 12:18:28.556967 28427 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:28.601472 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:28.582100 28388 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:28.611714 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.612335 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:28.614801 24064 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:28.613576 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:28.637567 24066 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:28.616513 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:28.599309 28593 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.645561 23920 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:28.599290 28580 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:28.642231 24034 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.643306 24564 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:28.613519 28576 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:28.646509 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:28.653873 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:28.665122 27917 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:28.662714 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.687578 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:28.688169 23994 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:28.688524 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.601078 28603 consensus_queue.cc:1048] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:18:28.691648 27917 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:28.659857 28593 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.614074 28475 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:28.681023 24066 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:28.602386 28560 consensus_queue.cc:1059] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 12:18:28.600872 28555 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.693434 28560 raft_consensus.cc:3055] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:28.693811 28560 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:28.618116 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.694622 28560 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.695083 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.695874 28560 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:28.696297 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.696898 23917 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:28.697685 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:28.698449 28581 consensus_queue.cc:1175] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "ef0dd15ac654478b8371c22b8909240e" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
I20260709 12:18:28.699143 28388 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:28.604974 28600 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.646052 28346 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:18:28.700453 24064 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:28.685487 23989 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
W20260709 12:18:28.689245 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 50026us
I20260709 12:18:28.701541 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:28.700196 28600 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.702448 23989 raft_consensus.cc:2410] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:18:28.703223 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:28.703747 23989 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:28.704309 23989 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:28.705621 23989 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.707638 23989 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:28.708736 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:28.685986 28482 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:28.713426 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.723953 23994 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:28.723850 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:28.717876 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2541) took 1797 ms. Trace:
I20260709 12:18:28.719775 24594 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:28.714020 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:28.725484 23918 rpcz_store.cc:276] 0709 12:18:26.920490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.583336 (+662846us) service_pool.cc:224] Handling call
0709 12:18:27.583578 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:28.717040 (+1133462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.717072 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:28.717117 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:28.717147 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.717655 (+   508us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000aa5d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:28.717695 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.717822 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2606213504}
I20260709 12:18:28.726181 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:28.727463 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:28.728415 23918 raft_consensus.cc:2410] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:18:28.729202 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.724098 23989 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:28.730372 23918 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:28.725914 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:28.639314 28490 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.725082 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:28.734328 24594 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:28.731482 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.735721 23918 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:28.737938 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:28.738095 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.738754 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.739089 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.739427 23917 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:28.736627 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.745018 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.746644 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.741164 23918 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:28.748173 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.690462 28348 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.753958 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:28.754914 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:28.756650 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:28.757793 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:28.761441 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:28.735002 28397 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:28.733534 28507 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:28.762688 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:28.759294 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:28.742745 27917 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:28.779531 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:28.782294 24564 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:28.763293 28210 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:28.788151 28576 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:18:28.765172 28379 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:28.789145 28379 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:28.789542 28379 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:28.790784 28602 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:18:28.791630 28525 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:28.762748 28220 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:28.764889 28397 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.780448 27917 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:28.859227 23920 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:28.860630 23917 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:28.783192 28601 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:18:28.795226 28554 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:28.785512 28482 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:28.796240 28584 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:28.786371 28560 consensus_queue.cc:1059] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:18:28.874550 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:28.880134 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:28.876044 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:28.858445 27904 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.913481 27904 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:28.912185 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.914435 28584 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:28.915087 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.916575 28584 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:28.917783 28583 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.918370 28591 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:28.918406 28583 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.918927 28591 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:28.857959 28397 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:28.911882 28560 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:28.912290 28585 raft_consensus.cc:3055] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:28.912763 28578 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.861500 27917 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:28.937268 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.872517 28554 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.918073 28395 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:28.877722 28482 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.917826 28584 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:28.928601 28220 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:28.948408 28566 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:18:28.965001 23819 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43626 (request call id 197) took 23877 ms (client timeout 15000 ms). Trace:
I20260709 12:18:28.967108 28348 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:28.935237 28585 raft_consensus.cc:740] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:28.943917 28560 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:28.954521 28554 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:28.953967 28482 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:28.947022 28346 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:18:28.941735 28339 consensus_queue.cc:1059] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:18:28.963362 28220 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:28.969316 23819 rpcz_store.cc:269] 0709 12:18:05.087748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.088241 (+   493us) service_pool.cc:224] Handling call
0709 12:18:28.964893 (+23876652us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:21.564981 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:21.565829 (+   848us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:21.565887 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:18:21.565914 (+    27us) tablet.cc:662] Decoding operations
0709 12:18:21.568230 (+  2316us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:21.568370 (+   140us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:21.568411 (+    41us) tablet.cc:685] Acquiring locks for 23 operations
0709 12:18:21.572841 (+  4430us) tablet.cc:701] Row locks acquired
0709 12:18:21.572915 (+    74us) write_op.cc:260] PREPARE: finished
0709 12:18:21.573199 (+   284us) write_op.cc:270] Start()
0709 12:18:21.573381 (+   182us) write_op.cc:276] Timestamp: P: 1783599501573095 usec, L: 0
0709 12:18:21.573437 (+    56us) op_driver.cc:348] REPLICATION: starting
0709 12:18:21.574918 (+  1481us) log.cc:844] Serialized 8886 byte log entry
0709 12:18:21.800853 (+225935us) op_driver.cc:464] REPLICATION: finished
0709 12:18:21.812524 (+ 11671us) write_op.cc:301] APPLY: starting
0709 12:18:21.812606 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:21.911117 (+ 98511us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:21.926268 (+ 15151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:22.326652 (+400384us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:22.327579 (+   927us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=46
0709 12:18:22.327677 (+    98us) write_op.cc:312] APPLY: finished
0709 12:18:22.328409 (+   732us) log.cc:844] Serialized 158 byte log entry
0709 12:18:22.328649 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:22.328934 (+   285us) write_op.cc:454] Released schema lock
0709 12:18:22.329043 (+   109us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:22.363769 (+ 34726us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:22.399234 (+ 35465us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":947849,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":11348,"apply.run_cpu_time_us":10945,"apply.run_wall_time_us":537276,"num_ops":23,"prepare.queue_time_us":127179,"prepare.run_cpu_time_us":9004,"prepare.run_wall_time_us":47949,"raft.queue_time_us":95142,"raft.run_cpu_time_us":4634,"raft.run_wall_time_us":11815,"replication_time_us":227190,"thread_start_us":237650,"threads_started":4,"wal-append.queue_time_us":1093,"wal-append.run_cpu_time_us":78307,"wal-append.run_wall_time_us":1918546}]]}
I20260709 12:18:28.956489 28395 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:28.971982 28584 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.005967 28220 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:28.947618 28578 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.009645 28339 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:29.045210 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:29.056901 28425 raft_consensus.cc:3055] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:29.057516 28425 raft_consensus.cc:740] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:29.057736 28348 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:29.058396 28348 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.060384 28348 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.060689 23919 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:18:29.060824 28348 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:29.061282 28348 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.063149 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:29.063799 23991 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:29.067786 28348 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:29.076035 23991 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:29.075510 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:29.078806 27904 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:29.079320 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:29.085472 23960 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:29.087044 23960 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:29.088516 28597 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:29.088913 28597 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:29.089260 28597 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:29.090765 28420 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:29.091315 28420 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:18:29.091437 23886 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.091686 28420 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:29.092056 28420 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:29.094874 28351 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:29.095224 28564 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:29.096745 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.098091 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:29.104211 24596 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:29.104496 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:29.099233 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.100008 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.106932 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:29.109141 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.110770 24062 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:29.116748 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:29.119247 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:29.119999 23991 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:29.120067 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.120203 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:29.122767 23912 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:29.097681 28583 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:29.125558 23960 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:29.128990 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:29.129769 23912 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
W20260709 12:18:29.131604 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 251519us
I20260709 12:18:29.111371 28591 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.136930 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.138234 23960 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:29.078169 28379 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.044241 28560 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.149891 24566 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:29.107472 28339 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.143141 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:29.142050 28486 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:29.151554 24036 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:29.038122 28585 consensus_queue.cc:260] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.156453 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:29.207842 24600 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 1058) took 1195 ms. Trace:
W20260709 12:18:29.207835 28622 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:29.164777 28601 raft_consensus.cc:2804] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:29.465108 23887 leader_election.cc:336] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Timed out: RequestConsensusVote RPC to 127.22.48.2:43801 timed out after 1.576s (SENT)
W20260709 12:18:29.208353 28621 log.cc:927] Time spent T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:18:29.126659 28425 consensus_queue.cc:260] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.144171 28351 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:29.380435 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 297549us
I20260709 12:18:29.466233 23996 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:29.213058 28486 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:29.467123 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:29.468021 24070 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:29.469074 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.501240 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:29.501926 24070 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:29.469348 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.470186 28630 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.470360 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:29.473372 28578 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.473999 28379 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:29.475590 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 308036us
I20260709 12:18:29.476573 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:29.478099 24067 raft_consensus.cc:1240] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
W20260709 12:18:29.465163 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 291633us
W20260709 12:18:29.479745 23990 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 2279) took 2896 ms (client timeout 1745 ms). Trace:
I20260709 12:18:29.480355 28395 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:29.483124 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 326719us
I20260709 12:18:29.489038 28330 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.515740 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:29.485172 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 333668us
I20260709 12:18:29.479600 24600 rpcz_store.cc:276] 0709 12:18:28.012711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.015320 (+  2609us) service_pool.cc:224] Handling call
0709 12:18:28.595386 (+580066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:28.597303 (+  1917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.207521 (+610218us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400557650. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:29.207743 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333372160}
I20260709 12:18:29.464900 28369 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:29.504274 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.504344 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.464006 28475 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:29.466952 28348 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.500690 24062 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:29.465811 28555 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:29.508292 28490 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:29.488090 28247 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:18:29.493399 28619 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.396s	user 0.004s	sys 0.008s
W20260709 12:18:29.509763 23990 rpcz_store.cc:269] 0709 12:18:26.570150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.584860 (+ 14710us) service_pool.cc:224] Handling call
0709 12:18:29.202939 (+2618079us) spinlock_profiling.cc:243] Waited 634 ms on lock 0x7b54002ab2d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:29.467019 (+264080us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1458484608}
I20260709 12:18:29.505448 28351 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:29.477063 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.488169 28629 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:29.519115 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:29.520280 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.492429 28627 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.510924 28578 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.525384 24070 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:29.514395 28507 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:18:29.522580 28555 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.506353 28486 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:29.499956 28601 raft_consensus.cc:697] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:29.474148 28220 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.545625 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2736) took 1018 ms. Trace:
I20260709 12:18:29.546125 23918 rpcz_store.cc:276] 0709 12:18:28.527099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.752333 (+225234us) service_pool.cc:224] Handling call
0709 12:18:28.752689 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.753117 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.753169 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.759932 (+  6763us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.926887 (+166955us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:28.926941 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.927069 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.545384 (+618315us) raft_consensus.cc:1685] finished
0709 12:18:29.545406 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.545552 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1828,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":2821,"thread_start_us":132290,"threads_started":1,"wal-append.queue_time_us":219746}
I20260709 12:18:29.524403 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:29.535851 24062 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:29.538456 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.548633 24063 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:29.549638 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.539839 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.551546 24069 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:29.522850 28477 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.541618 24070 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:18:29.521473 28369 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:29.523974 28395 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:29.535648 28247 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:29.531895 28351 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:29.557088 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:29.525779 28330 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.538988 28627 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:29.562808 28626 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:18:29.564237 28627 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:29.565836 28482 consensus_meta.cc:287] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
W20260709 12:18:29.567317 27917 consensus_meta.cc:287] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.002s
I20260709 12:18:29.567690 27917 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.568485 28597 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.569577 23994 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:29.510756 28630 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.541541 28578 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:29.571110 28397 consensus_meta.cc:287] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.628s	user 0.012s	sys 0.000s
I20260709 12:18:29.571485 28397 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.572230 28578 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.528388 28490 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.573125 28630 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.573410 28397 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:29.574838 28490 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:29.575511 28555 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:29.527033 28348 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.576515 28220 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.577587 28348 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.577378 28369 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.577852 28330 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.558660 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.523809 28475 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.561650 28395 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:29.578584 28533 log.cc:927] Time spent T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 2.061s	user 0.005s	sys 0.000s
I20260709 12:18:29.561412 28420 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.579110 24062 raft_consensus.cc:1240] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:29.578691 24066 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:29.581702 24035 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:29.585793 24595 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 1239) took 1510 ms. Trace:
W20260709 12:18:29.580888 28554 consensus_meta.cc:287] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260709 12:18:29.607501 24595 rpcz_store.cc:276] 0709 12:18:28.075048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.241747 (+166699us) service_pool.cc:224] Handling call
0709 12:18:28.249147 (+  7400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:28.342243 (+ 93096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.342294 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:28.342349 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:28.342390 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.585560 (+1243170us) spinlock_profiling.cc:243] Waited 92.8 ms on lock 0x7b54004f0e54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:29.585604 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.585727 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213512448}
W20260709 12:18:29.584460 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.611459 28330 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:29.614015 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.614564 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.615314 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.615940 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.557194 28339 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.618726 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.620142 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.593477 24069 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:29.578470 28369 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:29.594007 24063 raft_consensus.cc:1240] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:29.561477 28477 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.595538 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.597967 24064 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:29.622556 24068 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:29.616940 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:29.624588 24594 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:29.594430 27917 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:29.624948 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.617010 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:29.617887 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.617977 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.629608 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.631249 24595 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:18:29.632320 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 116688us
I20260709 12:18:29.633036 24566 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:29.634792 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:29.637991 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.638753 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.641053 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.566222 28482 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.643085 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:29.644914 24594 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:29.645615 24593 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:29.647387 24593 raft_consensus.cc:2410] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 11 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:29.624913 28597 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.656302 24600 raft_consensus.cc:1240] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:29.658680 28623 log.cc:927] Time spent T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:18:29.617849 28554 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.626580 28601 consensus_queue.cc:237] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.684551 28554 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:29.693256 28620 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.651s	user 0.000s	sys 0.002s
W20260709 12:18:29.694655 28633 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.224s	user 0.000s	sys 0.002s
W20260709 12:18:29.695366 28625 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.223s	user 0.001s	sys 0.001s
W20260709 12:18:29.696213 28634 log.cc:927] Time spent T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 12:18:29.731876 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.735826 23813 catalog_manager.cc:5697] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 4 to 9, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 9 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:29.738572 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:29.741561 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:29.742713 23813 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 4 to 13. New cstate: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:29.745167 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:29.747464 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2550) took 1078 ms. Trace:
I20260709 12:18:29.747329 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:29.751703 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2537) took 2832 ms. Trace:
I20260709 12:18:29.749982 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 738) took 1061 ms. Trace:
I20260709 12:18:29.761013 23920 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:29.759737 23921 rpcz_store.cc:276] 0709 12:18:26.919450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.345659 (+426209us) service_pool.cc:224] Handling call
0709 12:18:27.522765 (+177106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.523166 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.523205 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.523776 (+   571us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.201629 (+1677853us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b18002d6c40. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:18:29.750570 (+548941us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:29.750686 (+   116us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.750864 (+   178us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.750942 (+    78us) raft_consensus.cc:1685] finished
0709 12:18:29.750959 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.751389 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2910,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":2183,"spinlock_wait_cycles":2722048,"thread_start_us":286095,"threads_started":1,"wal-append.queue_time_us":2120633}
I20260709 12:18:29.759874 23919 rpcz_store.cc:276] 0709 12:18:28.688625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.062198 (+373573us) service_pool.cc:224] Handling call
0709 12:18:29.067133 (+  4935us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.067670 (+   537us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:18:29.068637 (+   967us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.556489 (+487852us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.556538 (+    49us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:29.556584 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.556658 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.695860 (+139202us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:29.749659 (+ 53799us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2598,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":16466,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"spinlock_wait_cycles":2582272,"thread_start_us":487210,"threads_started":1,"wal-append.queue_time_us":560685}
I20260709 12:18:29.763870 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2549) took 1095 ms. Trace:
I20260709 12:18:29.765128 23920 rpcz_store.cc:276] 0709 12:18:28.668214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.859997 (+191783us) service_pool.cc:224] Handling call
0709 12:18:29.760505 (+900508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.761842 (+  1337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.763188 (+  1346us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54002c4550. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:29.763785 (+   597us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2070020352}
W20260709 12:18:29.763873 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 170273us
I20260709 12:18:29.767635 23993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 2308) took 1116 ms. Trace:
I20260709 12:18:29.769518 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35252 (request call id 44) took 2803 ms. Trace:
I20260709 12:18:29.768129 23993 rpcz_store.cc:276] 0709 12:18:28.651426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.652212 (+   786us) service_pool.cc:224] Handling call
0709 12:18:28.652514 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.711509 (+ 58995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.711536 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.712001 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.786863 (+ 74862us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:28.859006 (+ 72143us) log.cc:844] Serialized 14 byte log entry
0709 12:18:28.859205 (+   199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.859274 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.686674 (+827400us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b18003367c0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:29.766842 (+ 80168us) raft_consensus.cc:1685] finished
0709 12:18:29.767013 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.767343 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74249,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":1909,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":9018,"spinlock_wait_cycles":33437952,"thread_start_us":133044,"threads_started":2,"wal-append.queue_time_us":151732}
I20260709 12:18:29.770931 23990 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:29.773561 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:29.783461 23992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 2289) took 2002 ms (client timeout 1576 ms). Trace:
W20260709 12:18:29.784005 23992 rpcz_store.cc:269] 0709 12:18:27.781327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.781453 (+   126us) service_pool.cc:224] Handling call
0709 12:18:29.782930 (+2001477us) spinlock_profiling.cc:243] Waited 495 ms on lock 0x7b54000677d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:29.783191 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137720704}
I20260709 12:18:29.784561 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:29.784770 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:29.750180 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:29.785745 23989 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:29.749284 23912 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:29.791575 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:29.753436 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 727) took 1474 ms. Trace:
I20260709 12:18:29.745862 23813 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:29.794449 23914 rpcz_store.cc:276] 0709 12:18:28.278839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.283612 (+  4773us) service_pool.cc:224] Handling call
0709 12:18:28.283987 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:28.359272 (+ 75285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.752756 (+1393484us) spinlock_profiling.cc:243] Waited 72.6 ms on lock 0x7b540017a054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:29.753206 (+   450us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166907264}
I20260709 12:18:29.796382 24035 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:29.797010 23914 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:18:29.797498 23914 pending_rounds.cc:85] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 8
I20260709 12:18:29.797851 23914 pending_rounds.cc:107] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:18:29.774802 23995 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:29.799497 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:29.799937 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:29.800618 23919 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2566) took 1072 ms. Trace:
I20260709 12:18:29.801097 23919 rpcz_store.cc:276] 0709 12:18:28.728462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.799215 (+1070753us) service_pool.cc:224] Handling call
0709 12:18:29.799737 (+   522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.800138 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.800181 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.800263 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:29.800345 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.800415 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.800529 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:29.804319 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:29.775292 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 2298) took 1925 ms. Trace:
I20260709 12:18:29.806428 23996 rpcz_store.cc:276] 0709 12:18:27.850116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.850240 (+   124us) service_pool.cc:224] Handling call
0709 12:18:29.466016 (+1615776us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.499896 (+ 33880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.774879 (+274983us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54002ab2d0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:29.775125 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3633044352}
I20260709 12:18:29.748580 23917 rpcz_store.cc:276] 0709 12:18:28.668482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.861456 (+192974us) service_pool.cc:224] Handling call
0709 12:18:28.861814 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.862081 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.862119 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.862633 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.043929 (+181296us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:29.043963 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.044028 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.746568 (+702540us) raft_consensus.cc:1685] finished
0709 12:18:29.746674 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.747158 (+   484us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":181024,"threads_started":1,"wal-append.queue_time_us":637372}
I20260709 12:18:29.809232 24069 raft_consensus.cc:3055] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:29.809616 24069 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:18:29.775863 23916 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56870 (request call id 731) took 1495 ms (client timeout 1955 ms). Trace:
W20260709 12:18:29.810477 23916 rpcz_store.cc:269] 0709 12:18:28.280120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.309332 (+ 29212us) service_pool.cc:224] Handling call
0709 12:18:29.760241 (+1450909us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54002c4554. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:29.775574 (+ 15333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415909632}
I20260709 12:18:29.810927 24069 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.812718 24069 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:29.812856 23916 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:18:29.781795 23990 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:29.785629 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:29.769964 23987 rpcz_store.cc:276] 0709 12:18:26.966073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:26.966212 (+   139us) service_pool.cc:224] Handling call
0709 12:18:29.769014 (+2802802us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000677d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c4c853 00007f75c5c1a60a 00007f75bf1a07d4 00007f75bf1a0762 00007f75bf1a0691 00007f75bf1a060c 00007f75bf19f8c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:29.769204 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2996986240}
I20260709 12:18:29.798182 23914 raft_consensus.cc:2889] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:29.797273 23813 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:29.824437 23912 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 740) took 1131 ms. Trace:
I20260709 12:18:29.830802 23912 rpcz_store.cc:276] 0709 12:18:28.689099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.793090 (+1103991us) service_pool.cc:224] Handling call
0709 12:18:29.793781 (+   691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.794222 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.794252 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.820669 (+ 26417us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:29.820732 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.820809 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.820945 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:29.838722 23989 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:29.842751 28560 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:29.844756 28560 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:29.845496 28560 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:29.845872 28560 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:29.846371 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 50394us
I20260709 12:18:29.850704 28578 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.851775 28578 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.850687 28427 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:29.850867 28475 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:29.860481 28477 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.863523 27917 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.864470 27917 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.853551 28560 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:29.868634 24596 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:29.871270 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 744) took 1171 ms. Trace:
I20260709 12:18:29.874651 23914 rpcz_store.cc:276] 0709 12:18:28.690797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.795913 (+1105116us) service_pool.cc:224] Handling call
0709 12:18:29.796432 (+   519us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.862017 (+ 65585us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.862210 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:29.880748 28397 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:29.881091 28577 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:29.881551 28397 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:29.882266 28506 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.307s	user 0.015s	sys 0.028s
W20260709 12:18:29.882802 28506 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.369s	user 0.015s	sys 0.028s
I20260709 12:18:29.894547 23960 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:29.896974 23886 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:29.898455 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:29.899588 28482 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:29.900493 28220 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:29.902456 28379 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:29.903398 28529 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.896816 28348 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:29.845912 28409 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:18:29.926071 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.905084 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:29.908430 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:29.926113 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2588) took 1004 ms. Trace:
I20260709 12:18:29.929468 23917 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:29.909946 28578 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.905249 28643 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:29.930332 28337 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:18:29.969244 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 224354us
I20260709 12:18:29.917567 28627 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.972208 27904 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:29.927004 28395 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:29.974509 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 80404.1us
I20260709 12:18:29.923043 28601 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:29.928246 28420 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:29.982409 28477 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:29.988454 28477 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:29.988112 28643 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:29.989086 28477 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:29.906250 28529 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:29.996062 28354 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:18:29.997713 23805 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 10cd478aa7e9411bba254e94713f91de with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 71a48f59ff764d249519c6a53ec57f02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:30.002007 28601 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.002827 28601 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.005296 28601 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:30.005836 28601 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:29.931059 23813 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 4 to 11, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.006469 27904 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.008031 23813 catalog_manager.cc:5697] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 8, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 8 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.009027 27904 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:29.928455 28390 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:30.015606 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:29.938723 23988 rpcz_store.cc:276] 0709 12:18:28.921840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.773716 (+851876us) service_pool.cc:224] Handling call
0709 12:18:29.774213 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.775224 (+  1011us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:29.775768 (+   544us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.925418 (+149650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:29.925494 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:29.925571 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.925691 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.925852 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101583,"prepare.queue_time_us":47255,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":10129,"raft.queue_time_us":102683,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":163,"spinlock_wait_cycles":12032,"thread_start_us":46944,"threads_started":1}
I20260709 12:18:30.017417 23914 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:30.015515 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2552) took 1342 ms. Trace:
W20260709 12:18:30.022792 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.014672 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:30.010089 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 49758.1us
I20260709 12:18:30.015175 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.055145 24069 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:29.926692 28628 consensus_queue.cc:1059] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 12:18:30.052142 23987 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:30.060652 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:30.010672 28643 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.018357 27917 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.024967 28337 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:30.024071 23915 rpcz_store.cc:276] 0709 12:18:28.673420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.918696 (+245276us) service_pool.cc:224] Handling call
0709 12:18:28.918985 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.919287 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.919313 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.919701 (+   388us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.385181 (+465480us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:29.476948 (+ 91767us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.979651 (+502703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.015118 (+ 35467us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.015181 (+    63us) raft_consensus.cc:1685] finished
0709 12:18:30.015197 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.015362 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108486,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":96558,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":8182528,"thread_start_us":866712,"threads_started":2,"wal-append.queue_time_us":588086}
I20260709 12:18:30.027068 28601 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.073483 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.079067 24069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
W20260709 12:18:30.080763 28486 consensus_meta.cc:287] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.525s	user 0.014s	sys 0.002s
I20260709 12:18:30.081159 24069 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:30.081636 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:30.081408 28486 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.084064 28486 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.086481 23993 raft_consensus.cc:1240] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:30.017060 28395 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 12:18:30.086932 28357 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.410s	user 0.005s	sys 0.039s
I20260709 12:18:30.087177 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45136 (request call id 2551) took 1418 ms. Trace:
I20260709 12:18:30.087013 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:30.088886 28584 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.089776 28600 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.079581 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.098870 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:30.091024 23987 raft_consensus.cc:1240] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:30.099267 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:30.099741 23914 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:30.099989 23912 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:30.095216 23913 rpcz_store.cc:276] 0709 12:18:28.668718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.906630 (+237912us) service_pool.cc:224] Handling call
0709 12:18:28.907087 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.924745 (+ 17658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.924792 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.925322 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.402449 (+477127us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:29.694135 (+291686us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:29.913486 (+219351us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.066160 (+152674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.075143 (+  8983us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.079587 (+  4444us) raft_consensus.cc:1685] finished
0709 12:18:30.086844 (+  7257us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.087024 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150608,"prepare.queue_time_us":130086,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":101101,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":21384,"spinlock_wait_cycles":11550592,"thread_start_us":840773,"threads_started":2,"wal-append.queue_time_us":545235}
W20260709 12:18:30.102715 28247 consensus_meta.cc:287] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.002s
I20260709 12:18:30.103204 28247 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:30.010182 23813 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 9, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 9 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
W20260709 12:18:30.105597 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 197386us
I20260709 12:18:30.106575 23961 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:30.090744 28337 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.105904 23813 catalog_manager.cc:5697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:30.107915 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 1057) took 2095 ms. Trace:
I20260709 12:18:30.108341 24592 rpcz_store.cc:276] 0709 12:18:28.012447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.015245 (+  2798us) service_pool.cc:224] Handling call
0709 12:18:28.028901 (+ 13656us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.099272 (+ 70371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.107444 (+2008172us) spinlock_profiling.cc:243] Waited 54.2 ms on lock 0x7b54005d3c54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:30.107701 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124589952}
W20260709 12:18:30.090981 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 457853us
I20260709 12:18:30.087108 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.096728 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:30.112021 24599 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 1059) took 2098 ms (client timeout 2088 ms). Trace:
W20260709 12:18:30.112478 24599 rpcz_store.cc:269] 0709 12:18:28.012989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.015687 (+  2698us) service_pool.cc:224] Handling call
0709 12:18:30.111594 (+2095907us) spinlock_profiling.cc:243] Waited 521 ms on lock 0x7b54004713d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:30.111773 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1198864640}
I20260709 12:18:30.115904 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.116178 28649 consensus_queue.cc:1059] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:30.118795 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:30.121939 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.122855 24593 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:30.125157 28397 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.089804 28529 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.125943 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.086498 28581 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:18:30.127300 28357 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.510s	user 0.005s	sys 0.039s
I20260709 12:18:30.127152 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:30.127722 28357 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:30.129271 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:30.130707 28614 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:30.131059 23987 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:30.097126 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 48566us
I20260709 12:18:30.055460 28351 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.132499 28480 raft_consensus.cc:3055] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:30.133077 28480 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:30.127216 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.134604 28351 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.069970 28627 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.135214 28499 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.136996 28627 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:30.137420 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.106693 23917 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:30.108144 23813 catalog_manager.cc:5697] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:30.131210 28614 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:30.130023 28584 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:30.091212 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:30.138230 23962 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.096994 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.091588 24596 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:30.098649 28601 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:30.132550 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.141122 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:30.141633 23993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2586) took 1220 ms. Trace:
I20260709 12:18:30.143014 23996 raft_consensus.cc:1240] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:30.151690 23993 rpcz_store.cc:276] 0709 12:18:28.921393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.771778 (+850385us) service_pool.cc:224] Handling call
0709 12:18:29.772492 (+   714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.103266 (+330774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.140928 (+ 37662us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400310454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:30.141443 (+   515us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721611520}
I20260709 12:18:30.143631 28560 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.144296 24591 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:30.144626 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.144941 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:30.156632 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 80903.3us
I20260709 12:18:30.151645 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.131027 28421 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:30.129415 28357 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.159315 23995 raft_consensus.cc:2393] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:30.163321 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.163491 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:30.157665 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.162314 24593 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
W20260709 12:18:30.166981 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.161429 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:30.161479 24564 leader_election.cc:336] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.955s (SENT)
I20260709 12:18:30.170787 24594 raft_consensus.cc:2393] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:30.152307 28614 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.174657 24591 raft_consensus.cc:2410] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:18:30.173620 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.170086 27904 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:30.155112 28584 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:30.159790 28421 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:30.177155 23992 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:30.166805 28486 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:30.182121 28390 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:30.182380 28486 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:30.182674 28390 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:30.183988 28486 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.184079 28390 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.179872 28503 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:30.187101 24600 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:30.189764 23960 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:30.192104 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:30.193851 28351 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:30.194389 28351 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:30.194660 28420 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:30.194890 28351 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.195250 28420 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.195700 28420 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.180449 28593 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.180299 28489 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:30.181674 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 49389.5us
W20260709 12:18:30.197777 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.198959 24035 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:30.202435 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.202606 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 745) took 1321 ms. Trace:
I20260709 12:18:30.207952 23921 rpcz_store.cc:276] 0709 12:18:28.875441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.801181 (+925740us) service_pool.cc:224] Handling call
0709 12:18:29.815323 (+ 14142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.891374 (+ 76051us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.891405 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:30.018981 (+127576us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.078040 (+ 59059us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:30.078080 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.078149 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.196814 (+118665us) raft_consensus.cc:1685] finished
0709 12:18:30.196837 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.196985 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11585,"raft.queue_time_us":30773,"raft.run_cpu_time_us":278,"raft.run_wall_time_us":283,"thread_start_us":111746,"threads_started":2,"wal-append.queue_time_us":171718}
I20260709 12:18:30.177524 28584 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.134155 28480 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.223374 28560 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.223151 28477 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.224599 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2759) took 1117 ms. Trace:
I20260709 12:18:30.225975 28388 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:30.231544 28482 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:30.239909 28482 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:30.242784 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 80853.7us
I20260709 12:18:30.244144 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:30.244822 28388 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.245368 28388 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:30.245415 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 107385us
I20260709 12:18:30.250032 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:30.250938 28100 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:30.244855 24070 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.251072 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:30.251667 28100 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.253939 28100 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.231292 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.255556 23915 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:18:30.256258 28556 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:30.256773 28503 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:30.201256 28390 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.257434 28503 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.260301 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.227185 28421 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.261528 28421 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.243268 23918 rpcz_store.cc:276] 0709 12:18:29.107474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.830665 (+723191us) service_pool.cc:224] Handling call
0709 12:18:29.879420 (+ 48755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:29.938729 (+ 59309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:29.938776 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:29.990668 (+ 51892us) log.cc:844] Serialized 26 byte log entry
0709 12:18:30.057373 (+ 66705us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:30.057414 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.057680 (+   266us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:30.224368 (+166688us) raft_consensus.cc:1685] finished
0709 12:18:30.224390 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.224540 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39326,"raft.queue_time_us":26008,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":22488,"thread_start_us":66292,"threads_started":1,"wal-append.queue_time_us":227865}
I20260709 12:18:30.267221 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2319) took 1170 ms. Trace:
I20260709 12:18:30.267375 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:30.242919 28482 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.274530 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:30.268641 24067 rpcz_store.cc:276] 0709 12:18:29.096399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.101906 (+  5507us) service_pool.cc:224] Handling call
0709 12:18:29.104902 (+  2996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:29.514663 (+409761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.266773 (+752110us) spinlock_profiling.cc:243] Waited 65.2 ms on lock 0x7b54002d3f54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:30.267046 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150050048}
I20260709 12:18:30.267603 28583 consensus_queue.cc:1059] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:18:30.234542 28383 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 12:18:30.277812 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 116418us
I20260709 12:18:30.279228 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:30.280231 24061 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:30.281840 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.285595 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.286077 28583 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.286787 28489 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.287092 28583 consensus_queue.cc:1059] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:30.288393 28593 raft_consensus.cc:3055] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:30.288846 28593 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:30.290122 28593 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.290479 23813 catalog_manager.cc:5697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 10, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 10 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:30.291790 28593 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:30.293184 23813 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.294756 28441 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.295307 28441 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.297534 28441 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.299301 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:30.299368 24594 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:30.300556 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:30.270430 28600 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:18:30.303782 23886 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:30.304587 28383 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:30.305491 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.307132 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.308539 23887 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.309535 28560 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:30.309957 28560 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:30.310372 28560 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.310947 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.311089 28425 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:30.312141 28578 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:30.313230 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.313894 24596 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
W20260709 12:18:30.314567 28667 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:18:30.315107 28557 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:30.315577 28346 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:30.315899 23987 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
W20260709 12:18:30.316948 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 70749.8us
I20260709 12:18:30.322890 28585 raft_consensus.cc:3060] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.326706 24035 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:30.327491 28503 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.327987 28210 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:30.328521 28210 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:30.328899 28627 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.329370 28627 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.329741 28627 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.333120 23991 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37420 (request call id 2594) took 1319 ms. Trace:
I20260709 12:18:30.333520 23991 rpcz_store.cc:276] 0709 12:18:29.014036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.123866 (+109830us) service_pool.cc:224] Handling call
0709 12:18:30.285260 (+1161394us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b5800137798. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bdb2db71 00007f75bdb2da22 00007f75c6a468d9 00007f75c5ba0ee0 00007f75c5c6a0ab 00007f75c5c6a131 00007f75c5c180a0 00007f75c5c17984 00007f75bf1926d4 00007f75bf192662
0709 12:18:30.333058 (+ 47798us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9177472}
I20260709 12:18:30.334689 28477 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.336453 23962 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:30.340904 28600 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:30.341565 28600 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:30.343739 28480 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.314046 28578 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:30.329631 28210 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.352195 28210 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:30.353633 28329 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:30.358807 28329 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.365021 28329 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:30.357149 28388 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.357937 28100 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.364552 23813 catalog_manager.cc:5697] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 4 to 6, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 6 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:30.373555 28584 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.355474 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2596) took 1233 ms. Trace:
I20260709 12:18:30.401067 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.338192 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.389217 24070 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
I20260709 12:18:30.401197 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.403364 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.406106 23996 rpcz_store.cc:276] 0709 12:18:29.121655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.807617 (+685962us) service_pool.cc:224] Handling call
0709 12:18:29.808016 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.159620 (+351604us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.355171 (+195551us) spinlock_profiling.cc:243] Waited 330 ms on lock 0x7b540036f954. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:30.355401 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760076544}
I20260709 12:18:30.418013 24596 raft_consensus.cc:2393] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:30.428464 23993 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
W20260709 12:18:30.428676 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 118672us
W20260709 12:18:30.431928 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 93851.5us
I20260709 12:18:30.420776 28583 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.429342 28395 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.449066 28395 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.449096 24036 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:30.454594 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 189309us
I20260709 12:18:30.455379 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:30.457093 24036 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.457945 28628 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.438606 28600 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.458580 28506 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:30.460623 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.461930 24036 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.458505 28329 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:30.390929 28614 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:30.478689 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.504534 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.482424 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:30.482852 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 47605.6us
I20260709 12:18:30.509325 28482 consensus_queue.cc:1059] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:30.509631 24566 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:30.483588 24036 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.484282 28506 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:30.510231 28482 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:30.510686 28487 raft_consensus.cc:3055] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:30.510996 28506 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.511222 28487 raft_consensus.cc:740] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:30.484823 28628 consensus_queue.cc:1059] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:30.511631 24036 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.423210 28100 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.512360 28487 consensus_queue.cc:260] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.513764 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.514565 28629 raft_consensus.cc:3055] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:30.514964 28629 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:30.515329 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.515995 24594 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:30.515885 28629 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.517176 28629 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.517479 23886 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:30.518477 28348 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:30.518548 28337 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.518872 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.519297 28100 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.500022 28388 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:30.519841 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.501974 24597 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:30.520378 28477 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.520422 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:30.519126 28339 consensus_queue.cc:1059] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:30.521564 28339 raft_consensus.cc:3055] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:30.521564 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.521965 28339 raft_consensus.cc:740] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:30.522903 28339 consensus_queue.cc:260] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.524158 28339 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.527722 28395 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.528326 28395 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:30.528666 28395 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:30.519136 28337 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.529105 28395 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:30.529256 28337 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.530706 28628 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.531502 28560 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.532598 23912 raft_consensus.cc:1240] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:30.533723 28560 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.536180 28420 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.539295 28576 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.539434 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.540107 28329 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.540134 24597 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:30.540597 28329 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.541064 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.541534 28576 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:30.541926 28576 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:30.542263 28576 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:30.544173 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 61907.6us
W20260709 12:18:30.546619 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.547186 23961 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:30.527724 24035 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:30.514034 28487 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:30.498684 28627 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:30.557912 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.568969 28578 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:30.577854 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.499157 28351 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.573313 28556 raft_consensus.cc:3055] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:30.557679 28583 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.549283 28420 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.581789 28556 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:30.583267 28555 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:30.583844 28555 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.584009 28556 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.585309 28556 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.585999 28555 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.586422 28662 raft_consensus.cc:2804] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:30.606323 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:30.587262 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:30.587741 28583 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.589216 28388 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:30.589891 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.602154 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:30.612396 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.614032 28329 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.614466 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.616079 23988 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:30.616544 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:30.617686 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:30.618062 24566 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:30.618760 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:30.619427 23921 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:30.619580 28657 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:30.620004 28657 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:30.620263 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:30.558116 28560 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:18:30.621404 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:30.622458 28578 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.623472 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.595880 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:30.625077 28506 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:30.625185 28337 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.625855 28339 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:30.600207 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:30.626678 23918 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.596145 28584 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.627130 23918 raft_consensus.cc:2368] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12.
W20260709 12:18:30.603263 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.550406 28100 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:18:30.549508 28395 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.628597 28627 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.629164 28627 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:30.629290 28395 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.629643 28627 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.587030 28390 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.620407 28657 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.625617 28506 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.647893 28390 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.649712 28506 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:30.650838 23996 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:30.601821 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:30.575075 28247 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:18:30.652745 28348 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:30.653355 28348 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.656239 24067 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
W20260709 12:18:30.657529 28681 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.094s	user 0.003s	sys 0.000s
I20260709 12:18:30.658390 28627 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:30.659750 28678 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:18:30.660355 28100 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:30.660588 28351 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.660853 28100 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:30.649971 28390 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.590695 23920 raft_consensus.cc:2468] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:30.636226 28329 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.664358 23996 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:30.664655 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.643260 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.643648 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:30.621531 23813 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 9, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 9 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.631068 28388 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.631207 28583 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.646090 23987 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:30.666694 24593 raft_consensus.cc:2393] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 8: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:30.636994 28662 raft_consensus.cc:697] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 14 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:30.646752 23989 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:30.666610 28388 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.685945 23962 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:30.691646 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 89603.2us
I20260709 12:18:30.693342 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.677192 28581 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:30.701361 23991 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:30.661897 28100 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.678678 28348 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:30.711011 24565 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.698652 28581 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.700101 28503 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:30.726811 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.747829 28421 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:30.727849 28659 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:18:30.748878 28659 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:30.749394 28659 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:30.720410 28247 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:18:30.729379 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.733968 23920 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2756) took 1649 ms. Trace:
I20260709 12:18:30.751940 23920 rpcz_store.cc:276] 0709 12:18:29.084193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.784066 (+699873us) service_pool.cc:224] Handling call
0709 12:18:30.733777 (+949711us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400224054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:30.733884 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1851588992}
I20260709 12:18:30.753286 28659 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.754832 28659 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:30.737022 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 201897us
I20260709 12:18:30.758797 24036 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.759934 28329 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:30.759814 28397 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:18:30.760838 28329 consensus_queue.cc:1059] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:30.761912 28329 raft_consensus.cc:3055] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:30.743090 28680 log.cc:927] Time spent T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:18:30.704921 28489 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:30.685420 28339 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.765709 23996 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:30.766145 28339 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:30.767222 28628 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:30.766808 28662 consensus_queue.cc:237] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.767485 28649 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:18:30.769992 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.744195 28614 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:30.748181 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.748942 28421 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:18:30.749495 28677 log.cc:927] Time spent T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:18:30.760356 24036 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:30.742215 24591 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:30.728178 28482 consensus_queue.cc:1059] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:30.773772 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:30.739948 23813 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 11, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:30.727039 23887 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:30.773363 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 96111us
I20260709 12:18:30.791541 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.792282 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.795096 24595 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:30.779399 23991 raft_consensus.cc:1240] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:18:30.762236 28329 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:30.772567 28421 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:30.777374 28489 consensus_queue.cc:1059] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:18:30.797871 23813 catalog_manager.cc:5697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 12, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 12 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:30.788146 23960 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:30.793018 24592 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:30.811985 23987 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:30.815834 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:30.816769 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:30.814117 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:30.770555 28581 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.821669 23916 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:30.832230 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:30.833004 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.835947 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.839314 23988 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
W20260709 12:18:30.840742 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 113812us
I20260709 12:18:30.847651 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:30.825873 28649 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:30.826911 28585 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:30.809938 28560 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:18:30.852377 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.856022 23995 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:30.857899 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.848028 28477 raft_consensus.cc:3055] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:30.866264 28477 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:30.840544 28339 consensus_queue.cc:1059] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
W20260709 12:18:30.863940 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 75916.7us
I20260709 12:18:30.873103 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.875052 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:30.862958 28576 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.878942 28477 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.880308 28576 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.867245 28657 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.881525 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.882311 28599 consensus_queue.cc:1059] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:30.882915 28657 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:30.884024 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:30.886626 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:30.874396 28329 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.889810 28329 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.895519 27904 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:30.895794 23962 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.897364 27904 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:30.898078 28383 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:30.898334 28599 consensus_queue.cc:1059] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:30.898805 28383 raft_consensus.cc:3055] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:30.899226 28383 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:30.899296 27904 raft_consensus.cc:3055] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:30.899709 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:30.899942 27904 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:30.900137 28383 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.901389 28383 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.901150 27904 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.902524 27904 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.905830 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:30.906774 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:30.907691 24066 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:30.849812 28247 consensus_queue.cc:1059] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:18:30.908969 28247 raft_consensus.cc:3055] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:30.908740 28583 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.909334 28247 raft_consensus.cc:740] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:30.910385 23993 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.910176 28247 consensus_queue.cc:260] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.910892 23993 raft_consensus.cc:2368] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 13.
I20260709 12:18:30.906833 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:30.918980 23914 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:18:30.872932 28682 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:30.925505 28100 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.927771 24067 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:30.862635 28585 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:30.933476 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:30.939499 24070 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:30.911370 28247 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:30.941284 24067 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:30.949613 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:30.942219 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:30.938001 28583 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.950485 23962 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:30.962984 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:30.963877 24593 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:30.972049 28649 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.972543 28649 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:30.976097 28585 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:30.951160 28578 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:30.989324 28480 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:30.990033 28480 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:30.990557 28480 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.995314 28659 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.995820 28659 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.996687 28388 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:30.997905 28659 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:30.998449 28556 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.999460 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:30.941491 28581 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.007266 28477 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.007287 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.008854 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.009604 23988 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 13: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:31.009757 23920 raft_consensus.cc:2393] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 11: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:31.011739 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:31.013041 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.013559 28581 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.016137 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.016834 23988 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:31.018757 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.006050 24064 raft_consensus.cc:2410] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:18:31.019644 28390 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.026474 28556 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:31.033391 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 67258.3us
I20260709 12:18:31.004545 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:31.030683 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.036744 23913 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:31.039389 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:31.029806 24065 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:31.044365 23960 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:31.005232 28480 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.049232 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.051496 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:31.056735 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.057610 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.058394 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:31.034770 28556 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:31.078299 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.073724 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:31.081393 23920 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.083711 28348 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:31.084332 28348 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.045845 28395 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.096525 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.091024 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.099042 24068 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:31.095218 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:31.043035 28578 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:31.118759 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.119131 24592 raft_consensus.cc:2410] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:18:31.119123 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:31.120011 23918 raft_consensus.cc:3060] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.061069 28420 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:31.114416 27904 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:31.122673 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:31.126330 23805 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 10cd478aa7e9411bba254e94713f91de with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 71a48f59ff764d249519c6a53ec57f02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:31.126577 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.126905 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.127377 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.127619 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.132803 23914 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:31.087809 28480 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.132285 23920 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:31.134541 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.135221 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.045696 28599 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:18:31.136348 23887 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.140920 23917 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:31.103487 28210 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:31.140259 23915 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:31.108767 28578 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:31.151238 28578 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.153311 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:31.137516 24066 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:31.154677 28397 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:31.155773 28421 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.157153 28421 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.157255 24070 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:18:31.158129 28329 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.158720 28329 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.160743 28578 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.138509 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.148341 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:31.163902 23913 raft_consensus.cc:1275] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:31.150740 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.142966 28584 raft_consensus.cc:2764] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:18:31.143133 28581 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:31.154678 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:31.171401 24064 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.146962 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.172480 24065 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:31.172808 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:31.175225 23920 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:31.108381 28576 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.176467 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.186134 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.188886 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.189998 23918 raft_consensus.cc:2468] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
I20260709 12:18:31.201248 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.138329 28420 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:31.204717 23917 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:31.171392 28348 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:31.206379 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:31.211516 28649 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.217568 24063 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:31.143565 28390 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:31.138144 27904 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.233619 23914 raft_consensus.cc:2368] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 12. Current term is 13.
I20260709 12:18:31.226215 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.221848 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:31.167162 28480 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.247833 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.249460 23887 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:31.250949 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:31.227610 28100 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:31.204075 28576 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.252089 28555 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.228680 28210 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.244419 28556 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:31.254033 28581 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:31.251781 28397 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:31.282948 28555 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:31.283382 28555 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:31.283783 28555 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.262993 28100 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:31.270318 28556 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.321300 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:31.322958 23989 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:31.272220 28629 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.324636 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.351644 23992 raft_consensus.cc:2410] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:18:31.351488 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.324590 28556 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.324900 28100 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.329530 28329 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:31.333268 28555 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.341225 28578 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.253993 28390 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.354216 24070 raft_consensus.cc:1240] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:31.354533 24035 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:31.359968 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 409526us
I20260709 12:18:31.361440 23988 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:31.369521 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:31.370702 23962 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:31.371794 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:31.372510 24592 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.320593 28487 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.386425 28268 consensus_queue.cc:1059] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:18:31.387269 28268 consensus_queue.cc:1243] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer a46beb8868d749fdbaa732dd1ef6b89b log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:31.388629 28485 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:18:31.391587 28441 raft_consensus.cc:3055] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:31.391990 28441 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:31.392889 28441 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.321077 28420 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.395146 28337 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:31.397656 28683 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:18:31.398769 28210 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:31.399608 28348 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.400121 28348 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.400792 28649 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:31.401785 24070 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:31.402235 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.402927 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.403110 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.405910 28649 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:31.410774 28685 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
W20260709 12:18:31.414485 28687 log.cc:927] Time spent T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:18:31.414774 28421 raft_consensus.cc:3055] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:31.417816 28421 raft_consensus.cc:740] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:31.420534 28421 consensus_queue.cc:260] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.381543 28487 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.431696 28441 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.433020 27904 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.441380 23991 raft_consensus.cc:1240] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.412882 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:31.441882 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:31.443336 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 72710.9us
I20260709 12:18:31.443665 24036 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:31.444204 23962 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:31.445305 28480 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:31.463562 23988 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.463971 28339 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.425942 28388 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.468595 24592 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:31.451181 28421 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.463472 28603 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:31.494218 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.484562 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:31.497262 24036 leader_election.cc:400] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 13.
I20260709 12:18:31.497910 24036 leader_election.cc:403] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:31.486661 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.491514 23960 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:31.491827 23921 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:18:31.500168 23921 pending_rounds.cc:85] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 6
I20260709 12:18:31.500444 23921 pending_rounds.cc:107] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:18:31.500690 23921 raft_consensus.cc:2889] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:31.500175 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.501616 23916 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:31.502583 23990 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 14: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:31.504556 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:31.476444 28210 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:31.470366 28560 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:31.509613 23994 raft_consensus.cc:2393] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:31.482518 28578 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:31.512312 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:31.551828 24592 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 14: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:31.512610 23962 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:31.552141 23961 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:31.495317 28383 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:31.506743 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 331804us
I20260709 12:18:31.476270 28629 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:18:31.501641 28555 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:31.519423 24566 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:31.562525 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 78976.8us
I20260709 12:18:31.563299 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.517071 28628 raft_consensus.cc:3055] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:18:31.567360 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 54846.1us
I20260709 12:18:31.511492 28210 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:31.516717 28485 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.578639 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:31.578848 28576 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.580016 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:31.581208 28210 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.565200 28560 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.581278 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.588430 28560 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:31.589150 28657 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.590525 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.591219 28659 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.591638 28600 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:31.591202 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:31.592289 28629 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 13
I20260709 12:18:31.592782 24594 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 13: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:18:31.593828 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 102380us
I20260709 12:18:31.594558 28612 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:31.595072 28612 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:31.595096 24564 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.595963 28659 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:31.596369 28659 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.596073 28612 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.596732 28659 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.574453 28390 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.598568 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:31.600515 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:31.602124 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:31.604372 28348 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.604919 28485 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.577406 28628 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:31.607658 28628 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.609056 28628 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.569288 28337 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:18:31.613930 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 363036us
I20260709 12:18:31.615289 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:31.570706 28603 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:31.616568 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:31.617085 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:31.576344 28351 raft_consensus.cc:2804] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:31.618950 24597 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:31.616276 24594 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:31.623716 28351 raft_consensus.cc:697] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:31.615267 27904 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.599534 28487 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.624898 28576 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:31.624732 28351 consensus_queue.cc:237] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.626295 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:31.576056 28480 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:18:31.627749 28477 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:31.566045 28578 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.628429 28581 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.630028 28578 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.635007 24064 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:31.637766 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:31.638588 24597 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:31.643896 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:31.642704 28329 raft_consensus.cc:2764] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:18:31.618569 28268 consensus_queue.cc:1048] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:18:31.652832 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.653091 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:31.653484 23994 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:31.653826 23991 raft_consensus.cc:2393] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 14: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:31.654394 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.649842 28388 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:31.655591 28555 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:31.656051 28555 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.656714 28555 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:31.656010 28603 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.609815 28659 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.669581 24564 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:31.671043 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.671437 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.675340 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:31.676359 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:31.676617 23918 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:31.676802 24564 leader_election.cc:400] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 12. Current term is 13.
I20260709 12:18:31.677165 24564 leader_election.cc:403] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:18:31.679816 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.650925 28339 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.683295 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:31.683902 24593 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.684299 24034 leader_election.cc:400] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12.
I20260709 12:18:31.684967 23920 raft_consensus.cc:1240] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:31.685483 24599 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:31.615231 28657 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:18:31.687554 23887 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:31.687695 24594 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:18:31.675004 28581 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:31.688488 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:31.735014 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:31.737883 24592 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:31.736217 24064 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:31.740561 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.752416 24070 raft_consensus.cc:2393] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:18:31.755719 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 160071us
I20260709 12:18:31.758832 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:31.760035 23916 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:18:31.767635 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.680974 28560 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:31.650444 28337 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.689086 28397 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.769616 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:31.770766 24065 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:31.773175 24067 raft_consensus.cc:1275] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:18:31.789146 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 104964us
I20260709 12:18:31.788476 28698 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 12. Current term is 13.
I20260709 12:18:31.793249 28337 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:31.753124 28581 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.773002 28420 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.780054 28585 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:31.777271 28649 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:31.855228 28585 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:31.809101 28482 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:31.855872 28482 consensus_queue.cc:1243] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer a46beb8868d749fdbaa732dd1ef6b89b log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:31.856165 28585 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.799089 28659 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:31.811532 28489 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:31.857671 28489 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:31.797361 28581 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:31.796756 28556 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.823493 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:31.859578 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 57097us
I20260709 12:18:31.860414 28556 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:31.861106 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.832854 28599 consensus_queue.cc:1059] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:18:31.862926 28599 raft_consensus.cc:3055] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:31.862865 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:31.863481 28599 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:31.863689 23991 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.864398 28599 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.866518 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.835112 28210 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:31.838002 28688 log.cc:927] Time spent T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:18:31.788031 28600 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:18:31.831604 28555 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:31.795984 28578 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:31.841645 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54373us
W20260709 12:18:31.847765 28701 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:18:31.796267 28576 raft_consensus.cc:476] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Not starting pre-election -- already a leader
I20260709 12:18:31.795404 27904 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:31.850322 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:31.851931 28503 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:31.854516 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:31.861261 28388 raft_consensus.cc:2764] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:18:31.832438 28704 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:31.867054 28686 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:31.869444 28420 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.871476 28489 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.872480 23991 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:31.928398 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:31.872537 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:31.833740 28629 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 13.
I20260709 12:18:31.875609 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:31.881501 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 311097us
W20260709 12:18:31.935436 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 59911us
I20260709 12:18:31.882333 24593 raft_consensus.cc:2468] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:31.899614 24597 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:31.905045 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.906462 23915 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:31.907261 24065 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.898883 27904 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:31.906950 28503 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:31.929765 24070 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:31.949574 23916 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:31.936095 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:31.896200 28100 consensus_meta.cc:287] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.002s
I20260709 12:18:31.945509 24061 pending_rounds.cc:85] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 9
I20260709 12:18:31.956653 24061 pending_rounds.cc:107] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:18:31.905637 28581 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:31.955776 24035 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.956914 24061 raft_consensus.cc:2889] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:31.894407 28711 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:31.960669 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.964454 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.976318 24068 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:31.976544 24062 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:31.977273 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.977891 24069 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:31.980509 24035 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:31.937196 28556 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:31.988448 23962 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:31.989317 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.990850 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.896291 28578 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:31.989409 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 301916us
I20260709 12:18:31.992959 23887 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:31.993470 23996 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:31.983911 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:31.994402 23988 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:31.949023 27904 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:31.999231 23994 raft_consensus.cc:2393] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:31.951009 28600 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.965602 28388 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:32.008487 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:31.978504 28337 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:32.008170 24070 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:31.988535 28629 raft_consensus.cc:2804] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:31.999549 28390 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:32.023061 24068 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:32.024091 24068 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:32.024272 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.026259 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:32.004321 28397 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:32.034927 28337 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.016532 28600 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.037074 28337 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.037227 28600 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.022004 28351 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:32.037925 28351 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:32.038399 28716 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:32.038858 28351 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:31.985385 28581 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.042093 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:31.984148 28100 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.042974 28581 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:32.025439 28390 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:32.043841 28390 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.044168 28100 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:32.045023 23921 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:32.047236 28210 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:32.004281 28704 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:32.028415 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:32.030452 24069 raft_consensus.cc:2393] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:32.032622 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.052798 23994 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:32.053108 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.015977 28556 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:32.053944 23913 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:32.062740 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:32.063789 23913 raft_consensus.cc:2393] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:32.074602 24065 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:32.084692 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.049628 28629 raft_consensus.cc:697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:32.084046 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.060892 28599 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:32.092182 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 103810us
W20260709 12:18:32.008749 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 332037us
I20260709 12:18:32.055186 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:32.097699 23886 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:32.078672 28420 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:32.100139 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:32.099455 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 127235us
I20260709 12:18:32.104382 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.113144 23960 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:32.123623 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.128307 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:32.128793 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:32.129154 24594 raft_consensus.cc:2393] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:32.130473 24564 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:32.128851 28612 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:32.132334 28612 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.132738 28612 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:18:32.138504 28724 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:18:32.139233 28329 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:32.139707 28717 log.cc:927] Time spent T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:18:32.139859 28329 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.140607 28629 consensus_queue.cc:237] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.141861 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:32.142868 28555 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.143560 28726 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:32.144286 28718 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:18:32.146863 23805 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 10cd478aa7e9411bba254e94713f91de with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 71a48f59ff764d249519c6a53ec57f02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:32.134461 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:32.159126 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 54845.6us
I20260709 12:18:32.108655 28397 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:32.117184 28576 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:32.166429 28585 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:32.165580 28555 consensus_queue.cc:1059] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:18:32.170364 28482 consensus_queue.cc:1048] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:32.171032 23962 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:32.163177 28723 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:18:32.175014 28721 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:32.176616 28390 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.108608 28581 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:18:32.178303 28662 consensus_queue.cc:1059] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
W20260709 12:18:32.179001 28701 log.cc:927] Time spent T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.178s	user 0.003s	sys 0.006s
W20260709 12:18:32.180270 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.179898 27904 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.258859 28732 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 12:18:32.259701 27904 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:32.185443 28628 consensus_meta.cc:287] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.005s
I20260709 12:18:32.101027 28603 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:18:32.187737 24036 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:32.150615 28657 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.262305 28657 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.189769 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:32.164551 28726 raft_consensus.cc:3060] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.270895 28657 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:32.271339 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:32.272135 23921 raft_consensus.cc:2368] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15.
I20260709 12:18:32.166004 28576 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:32.273324 28576 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:32.276662 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 88991us
I20260709 12:18:32.276990 28482 raft_consensus.cc:3055] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:32.277421 28482 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:32.277626 28628 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:32.278051 28628 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.278424 28628 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.278337 28482 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.281365 28716 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:32.281983 28390 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.281903 28716 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.283126 28268 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:32.283588 28268 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:32.284224 28716 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.284535 28268 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.286451 28723 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.287142 28723 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.288259 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:32.288991 24597 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:32.289206 28723 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:32.249130 28329 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:32.290110 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:32.250418 23914 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:32.245342 28397 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:32.292569 28397 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.247151 28600 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:32.295315 28600 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:32.295703 28600 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:32.256629 28585 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:32.257331 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 2375) took 1250 ms. Trace:
I20260709 12:18:32.158350 28556 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.304450 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:32.301895 24035 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:32.305045 24597 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:32.244160 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 73725.7us
I20260709 12:18:32.276198 23988 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:32.300565 28348 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:32.302349 24066 rpcz_store.cc:276] 0709 12:18:31.006677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.154987 (+148310us) service_pool.cc:224] Handling call
0709 12:18:31.155308 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:31.175021 (+ 19713us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:31.175057 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:31.205517 (+ 30460us) log.cc:844] Serialized 26 byte log entry
0709 12:18:31.464865 (+259348us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:31.493943 (+ 29078us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.500610 (+  6667us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.500746 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:31.847136 (+346390us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:32.178769 (+331633us) spinlock_profiling.cc:243] Waited 3.98 ms on lock 0x7b24001ef6c8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bd9eb9c4 00007f75bd9e9acb 00007f75bdba4dc9 00007f75bdba4a55 00007f75bdba409d 00007f75c07d610e 00007f75c07ed88c 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221
0709 12:18:32.257112 (+ 78343us) raft_consensus.cc:1685] finished
0709 12:18:32.257134 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.257271 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11816,"prepare.queue_time_us":29632,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":103696,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":14676,"spinlock_wait_cycles":19465856,"thread_start_us":258946,"threads_started":1,"wal-append.queue_time_us":422020}
W20260709 12:18:32.312885 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 151956us
I20260709 12:18:32.286020 28268 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.321803 24062 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:18:32.322057 28737 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.071s	user 0.001s	sys 0.001s
I20260709 12:18:32.307857 28578 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:32.315726 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:32.325685 24065 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:32.316069 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:32.307785 28348 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.310238 28739 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:32.327137 28739 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:32.327567 28739 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.328435 28348 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.330940 23960 leader_election.cc:400] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15.
I20260709 12:18:32.332533 23960 leader_election.cc:403] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:18:32.334079 28482 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.321612 28503 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.335493 28503 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:32.336839 28348 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.331890 28487 consensus_queue.cc:1059] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:32.337301 28348 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.331463 23990 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:32.338132 28734 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.338629 28734 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.339932 28348 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:32.340773 28734 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.341804 28487 raft_consensus.cc:3055] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:32.342196 28487 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:32.343333 24597 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:32.343051 28487 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.313853 23887 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:32.344648 28100 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:32.348311 24070 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:32.348690 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.349900 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:32.350210 23886 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:32.350644 24592 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:32.354749 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:32.359647 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.360244 23913 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:32.357272 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:32.364435 23917 raft_consensus.cc:1240] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:32.367980 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.368309 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.369289 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:32.369484 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.368045 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.373456 24595 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:32.374974 24035 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:32.371539 24564 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:32.379616 24067 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:18:32.382988 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.383122 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:32.383651 23919 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
W20260709 12:18:32.417943 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 46474.6us
I20260709 12:18:32.418255 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:32.418882 24064 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:32.421327 24070 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:32.364095 28395 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:32.427474 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 67634.1us
I20260709 12:18:32.355230 28578 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:32.432096 23914 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:32.426132 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.363037 28348 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:32.369055 28704 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:32.370517 28100 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:32.380633 28730 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:32.435120 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0740227aa014467da8e8269927b1cfda"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:32.441874 23990 raft_consensus.cc:606] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:32.379377 28329 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:32.438432 23960 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:32.417371 28351 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:32.425118 28268 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:32.432147 28487 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:32.458901 28725 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:32.459481 28725 raft_consensus.cc:697] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:32.453153 28268 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.460065 28268 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:32.460443 28725 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.462963 28612 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.444795 28584 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.466814 28584 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.469017 28584 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.471549 28576 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.450297 23962 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:32.474967 23962 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:32.479908 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:32.480602 23921 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.384217 28706 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:18:32.438964 28704 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:32.506788 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.508697 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:32.466131 28612 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.509472 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:32.510398 28329 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:32.451453 28100 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 15 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:32.517452 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.506414 28581 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.522668 28581 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.524698 28581 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:32.525178 28329 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.527361 28329 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:32.455628 28351 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.529554 28351 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:32.503931 28704 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.484982 28693 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:32.493443 28599 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:32.556373 23921 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:32.445412 28578 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.455706 28614 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:18:32.582326 24566 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.584017 24036 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:32.433151 28585 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.589661 24592 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:32.548612 28693 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.595368 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:32.599308 24593 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:32.565276 28599 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.600303 24597 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:32.600436 28599 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:32.606587 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.609359 28743 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:18:32.610080 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.558367 28726 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:32.610666 28734 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:18:32.616492 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.617565 24595 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:32.621847 23886 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:32.503275 28720 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:32.630594 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:32.631801 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.632388 24595 raft_consensus.cc:2368] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15.
I20260709 12:18:32.592221 28388 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:32.632784 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:32.589936 28728 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:32.637034 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.635248 23994 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:32.636448 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.636109 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:32.633323 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 128945us
I20260709 12:18:32.638603 23988 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:32.637035 23990 raft_consensus.cc:2393] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 8: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:32.615787 28693 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.670727 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.672576 23987 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:32.633772 28337 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:32.678483 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:32.687812 24597 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:32.688254 23992 raft_consensus.cc:3060] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:32.685171 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:32.689410 24063 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:32.693750 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:32.694445 24593 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:32.694810 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:32.695609 24597 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:32.701203 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:32.701973 24595 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:32.632989 28268 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.671866 28388 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:32.712738 28726 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:32.721809 23994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8132db9882c041d1845d0a8815c39788"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:32.725584 23921 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:32.728981 24564 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.731539 24597 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:32.734927 23918 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:32.735904 24034 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.701275 28337 raft_consensus.cc:697] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:32.740149 28750 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:18:32.743237 28489 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:32.746481 28348 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:32.750828 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:32.755046 23992 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:32.640455 28100 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.761332 23921 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:32.803246 28762 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:32.803985 28762 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.804417 28762 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:32.738337 28728 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:32.762217 28603 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.772958 28612 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.713279 28726 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.747957 28723 consensus_queue.cc:1059] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
W20260709 12:18:32.927065 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 176316us
I20260709 12:18:32.928167 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.930342 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:32.938071 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:32.881395 28339 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.970331 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.882855 28603 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.978919 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:32.979602 23988 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:32.980600 23989 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2638) took 1004 ms. Trace:
I20260709 12:18:32.893738 28612 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:32.937484 28725 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:32.976866 28753 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
W20260709 12:18:32.977415 28755 log.cc:927] Time spent T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:18:32.980473 28600 consensus_meta.cc:287] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.000s
I20260709 12:18:32.980994 23989 rpcz_store.cc:276] 0709 12:18:31.976700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.987928 (+ 11228us) service_pool.cc:224] Handling call
0709 12:18:32.003474 (+ 15546us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:32.022507 (+ 19033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.022537 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:32.347980 (+325443us) spinlock_profiling.cc:243] Waited 904 us on lock 0x7b2c00000e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:18:32.348427 (+   447us) log.cc:844] Serialized 52 byte log entry
0709 12:18:32.450848 (+102421us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:32.450883 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.450944 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:32.974857 (+523913us) raft_consensus.cc:1685] finished
0709 12:18:32.974878 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.980535 (+  5657us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18632,"raft.queue_time_us":19096,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":22171,"spinlock_wait_cycles":2078464,"thread_start_us":102091,"threads_started":1,"wal-append.queue_time_us":243520}
I20260709 12:18:32.975205 28761 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.991700 28761 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.989871 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:32.996172 28585 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:32.996510 28686 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:32.997112 28686 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:32.997604 28686 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.967830 28339 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:32.976980 28337 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.001735 28339 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:32.988996 28725 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.005285 28725 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:33.012081 23993 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:32.994036 28761 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:33.017397 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 268047us
I20260709 12:18:33.019240 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:33.024029 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:33.024641 23988 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:33.024900 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:33.023828 28555 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:32.939193 28388 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.022878 28603 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:33.026512 28555 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.029081 23993 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:18:33.033288 28395 consensus_meta.cc:287] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.597s	user 0.009s	sys 0.001s
I20260709 12:18:33.033761 28395 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15.
W20260709 12:18:33.029277 28628 consensus_meta.cc:287] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.003s
I20260709 12:18:33.034425 28763 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:18:33.034957 28739 consensus_meta.cc:287] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.707s	user 0.006s	sys 0.004s
I20260709 12:18:33.034838 28628 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.035478 28739 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.036806 23961 leader_election.cc:400] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15.
I20260709 12:18:33.037774 28628 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.037588 28603 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:33.039084 24064 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 14: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:33.039059 28686 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:33.039987 23961 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:33.040961 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:33.041750 28759 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:33.042137 28759 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:33.042565 28759 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:33.043910 28739 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.047086 23961 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:33.050773 28763 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:33.051386 28763 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:33.052693 28268 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:33.054770 28763 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.058343 28603 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:33.058807 28603 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.059219 28603 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:33.056237 28693 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.062331 23987 raft_consensus.cc:2368] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
I20260709 12:18:33.067034 23990 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:33.076720 28487 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:33.077064 28726 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:33.077194 23996 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 15.
I20260709 12:18:33.078373 28726 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.078850 28726 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.080497 28761 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:33.080855 28726 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.081038 28761 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.081837 28420 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:18:33.082698 24066 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:33.081779 28693 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.009742 28600 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.083953 23994 raft_consensus.cc:606] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:33.084342 23994 raft_consensus.cc:614] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:33.085040 28600 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:33.085722 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:33.086345 24592 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 7.
I20260709 12:18:33.086602 23995 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:33.087587 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:33.087890 23886 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:33.088614 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:33.089311 24592 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:33.093966 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:33.095799 24593 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:33.096746 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:33.099694 23993 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:33.100297 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:33.102138 24599 raft_consensus.cc:1275] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:33.102269 23918 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.099139 23913 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
W20260709 12:18:33.105718 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 167755us
I20260709 12:18:33.057763 28762 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.110981 23920 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:33.111325 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:33.142642 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:33.155650 24065 raft_consensus.cc:2393] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:33.147871 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:33.081827 28578 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:33.156279 24067 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:33.103330 28726 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:33.156821 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:33.159283 24599 raft_consensus.cc:3060] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:33.159827 24066 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:33.166288 28762 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:33.161087 28726 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.167205 28726 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.168789 28603 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.171587 28555 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.161583 28585 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:18:33.145107 28662 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:18:33.161981 28704 consensus_meta.cc:287] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.003s
I20260709 12:18:33.185523 28704 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.221120 24599 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
W20260709 12:18:33.162177 28599 consensus_meta.cc:287] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.561s	user 0.012s	sys 0.000s
I20260709 12:18:33.294446 23918 raft_consensus.cc:2468] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:33.354239 23993 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:33.356070 24566 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:33.377843 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:33.378805 24594 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:33.154150 28686 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260709 12:18:33.214841 28614 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.435074 28614 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:33.385350 28771 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:18:33.386570 28698 raft_consensus.cc:2804] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:33.449470 28698 raft_consensus.cc:697] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:33.450745 28698 consensus_queue.cc:237] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.455111 28704 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.297919 28599 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.517462 24598 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:33.458557 28693 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.564338 28762 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:33.461817 28420 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.512965 28268 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:33.590348 28704 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:33.593851 28765 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.597379 28765 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.598109 28704 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.572626 28603 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.464191 28759 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.582571 28768 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:33.611208 28768 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.603140 28268 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.613363 28768 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:33.614753 28268 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:33.570957 28762 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.574931 28693 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.580837 28420 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:33.622920 28732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.009s
I20260709 12:18:33.652871 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2365) took 1162 ms. Trace:
I20260709 12:18:33.653292 24064 rpcz_store.cc:276] 0709 12:18:32.489062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.489230 (+   168us) service_pool.cc:224] Handling call
0709 12:18:33.651605 (+1162375us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b5400266454. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:33.651764 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1205326592}
I20260709 12:18:33.637702 28614 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.685075 28765 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.688318 28390 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.689023 28390 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.689823 28599 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.630900 28726 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.700603 28726 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.701174 28612 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.702059 28420 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.705233 28576 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.705933 28693 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.705988 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:33.711488 28727 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:33.711898 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:33.712713 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:33.713193 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:33.713876 23996 raft_consensus.cc:2393] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:33.714624 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:33.714927 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:33.715241 23996 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:33.715883 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:33.716133 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:33.716488 23992 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:33.716645 23989 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:33.717558 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:33.652504 28704 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:33.719307 28761 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.720402 28487 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:33.720978 28487 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.722815 28728 raft_consensus.cc:3055] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:33.723176 28728 raft_consensus.cc:740] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:33.723337 28487 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:33.724002 28728 consensus_queue.cc:260] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.725333 28728 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:33.694152 28390 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.696219 28762 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.697363 28759 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.711898 28727 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:33.645859 28732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.005s	sys 0.009s
I20260709 12:18:33.731894 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:33.732399 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:33.750885 23960 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:33.753571 23990 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:33.760869 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:33.761637 24598 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:33.763790 24591 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:33.738999 28686 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.751096 28704 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:33.774811 28770 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.781020 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:33.791646 23961 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:33.793929 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:33.794319 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:33.794888 24595 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 7.
I20260709 12:18:33.798261 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:33.799011 24595 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:33.801612 24598 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:18:33.804857 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:33.805545 24598 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.767305 28614 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:33.859236 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 67664.6us
I20260709 12:18:33.767551 28761 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.770829 28390 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.770555 28732 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:33.772770 28759 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:33.950011 28759 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.952327 28759 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:33.782790 28693 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.953001 28693 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:33.955121 28693 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:33.957937 28337 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:33.958441 24594 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:33.958889 28762 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:33.862496 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:33.802670 28420 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:18:33.860381 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 56808.6us
I20260709 12:18:33.949083 28732 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.854707 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:33.958572 28337 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.770726 28716 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.008425 24595 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:34.013218 24599 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:33.775403 28770 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:33.772329 28388 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:33.864503 28329 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:34.068910 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:34.069479 24591 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:34.071098 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:33.769757 28584 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.039170 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:34.037426 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.050077 24598 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:18:34.020300 23886 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:33.890729 28599 raft_consensus.cc:2804] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:33.776446 28686 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.060925 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 2346) took 1036 ms. Trace:
I20260709 12:18:34.062418 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.080132 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.076967 24594 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:34.084239 23920 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:34.089048 24595 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
W20260709 12:18:34.081074 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 60882us
I20260709 12:18:33.785876 28704 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.033536 28420 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.018998 28754 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.083254 23995 rpcz_store.cc:276] 0709 12:18:33.023989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.024110 (+   121us) service_pool.cc:224] Handling call
0709 12:18:33.024417 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:33.086997 (+ 62580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.060688 (+973691us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b540019d2d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:34.060863 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142573824}
I20260709 12:18:34.100231 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.108762 24592 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:34.103276 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:34.103901 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.110522 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:34.110212 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.112679 23918 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:34.109632 23914 raft_consensus.cc:3060] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.116850 24599 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:34.007571 28390 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.109633 28576 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:34.119069 28576 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.119462 28576 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.119153 28329 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.120152 28390 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.120850 28390 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:34.121315 28390 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.121834 28329 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.122197 28555 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:34.122701 28555 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.109910 28599 raft_consensus.cc:697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:34.110345 24600 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:34.123966 28337 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.124612 28555 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.125403 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.126513 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.127141 23915 raft_consensus.cc:2368] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 7. Current term is 8.
I20260709 12:18:33.890219 28614 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.097594 28584 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.130587 28584 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.131065 28560 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:34.133756 23886 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:34.123992 28599 consensus_queue.cc:237] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.135653 28765 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:34.137266 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.138044 23921 raft_consensus.cc:2468] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:34.140676 23912 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:33.948699 28761 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.144913 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.156865 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.157959 23912 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:34.080955 28783 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:34.108083 28420 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.153497 28337 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:34.080488 28397 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:34.172638 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:33.861308 28727 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.118032 28698 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.110201 28706 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:34.199609 23915 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:34.068064 28716 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.177778 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.146402 28329 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:34.095503 28762 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.085525 28388 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.151717 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:34.097088 28593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.003s	sys 0.019s
W20260709 12:18:34.201678 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 340863us
I20260709 12:18:34.180895 28603 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:34.216003 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 424825us
I20260709 12:18:34.228575 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:34.195623 28100 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:34.198540 28337 raft_consensus.cc:697] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:34.217131 28593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.003s	sys 0.019s
I20260709 12:18:34.143846 28754 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:34.288022 24036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.011s	sys 0.022s
I20260709 12:18:34.280820 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.291531 23995 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
W20260709 12:18:34.293159 24036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.011s	sys 0.022s
I20260709 12:18:34.177850 28783 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.306587 24063 raft_consensus.cc:1275] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:34.196362 28397 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.198395 28698 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.231186 28603 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.318651 23990 raft_consensus.cc:606] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:34.320300 24065 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:34.225199 28329 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:34.322690 24563 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.010s	sys 0.023s
I20260709 12:18:34.326897 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.328720 24063 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:34.204314 28706 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.351845 24599 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:34.330034 24563 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.010s	sys 0.023s
I20260709 12:18:34.359485 23913 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2852) took 1254 ms. Trace:
I20260709 12:18:34.331151 28802 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:34.339041 28782 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:18:34.340653 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:18:34.341635 28728 consensus_meta.cc:287] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.002s
I20260709 12:18:34.342031 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:34.409543 24069 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:34.411693 28390 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.412286 28390 consensus_queue.cc:1048] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:34.345563 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:34.414758 24067 raft_consensus.cc:2393] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:34.414462 28337 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:34.415544 28786 log.cc:927] Time spent T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:18:34.415642 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.416821 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.417351 24067 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:34.417733 28706 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.418823 24063 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:34.346827 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.387452 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.388525 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.420374 24068 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:34.393078 23988 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.422125 23921 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:34.244477 28100 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:34.403512 23805 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 10cd478aa7e9411bba254e94713f91de with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 71a48f59ff764d249519c6a53ec57f02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:34.418072 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.404878 28802 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:34.406002 28784 log.cc:927] Time spent T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:18:34.406850 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.408795 24036 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:34.414606 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.431103 24065 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:34.386248 28804 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:34.426065 24069 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:34.434201 24067 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:34.362779 28766 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.446038 23914 raft_consensus.cc:2468] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:34.447674 24599 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:34.372648 23913 rpcz_store.cc:276] 0709 12:18:33.104922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.105043 (+   121us) service_pool.cc:224] Handling call
0709 12:18:33.105389 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:33.105740 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.105776 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:33.109328 (+  3552us) log.cc:844] Serialized 52 byte log entry
0709 12:18:33.623825 (+514497us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:34.079834 (+456009us) log.cc:844] Serialized 14 byte log entry
0709 12:18:34.359092 (+279258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.359193 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.359252 (+    59us) raft_consensus.cc:1685] finished
0709 12:18:34.359271 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.359422 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65451,"prepare.queue_time_us":569979,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4406,"raft.queue_time_us":106020,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":20524,"thread_start_us":1030257,"threads_started":3,"wal-append.queue_time_us":494371}
I20260709 12:18:34.418394 28732 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.455760 23988 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:34.452035 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:34.452962 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.457844 23989 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 9: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:34.454785 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.458505 23995 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:34.371191 28593 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:18:34.433421 28804 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:34.432971 28388 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.475318 24063 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:34.448177 28704 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:34.454071 23961 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:34.489372 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.455638 28761 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.456784 28770 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:34.491765 24591 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:34.492954 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.493116 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.494239 24593 raft_consensus.cc:2410] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:18:34.495721 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.476064 28599 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:34.467361 28585 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.475494 28804 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:34.502245 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.006s	sys 0.021s
I20260709 12:18:34.450726 28766 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:34.504597 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 50621.9us
W20260709 12:18:34.505159 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.006s	sys 0.021s
I20260709 12:18:34.526479 23961 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:34.490458 28657 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.491982 27904 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:34.532544 23961 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:34.502992 28388 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:34.535849 23989 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:18:34.534736 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 210256us
I20260709 12:18:34.534423 23961 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:34.505030 28732 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:34.505849 28762 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.555116 23961 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:34.533567 28716 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:34.503474 28599 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.635673 24593 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:34.505086 28585 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.552090 28388 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.652511 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.549571 28759 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:34.535631 28795 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:18:34.656409 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 208663us
I20260709 12:18:34.674177 23960 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:34.668164 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 516487us
I20260709 12:18:34.536942 28657 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.537113 27904 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.550292 28793 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:34.560158 28383 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:34.557312 28732 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.632613 28792 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:34.637723 28698 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.641722 28716 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.709388 28698 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:34.709452 28716 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.711066 28698 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.711534 28698 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.712350 28716 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.712977 28716 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:34.714111 28698 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.714800 28698 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:18:34.714990 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.549s (SENT) [suppressed 28 similar messages]
I20260709 12:18:34.715329 28698 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.717299 28698 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:34.693727 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 142353us
I20260709 12:18:34.700975 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:34.560585 28704 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.566310 28584 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:34.645891 28397 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.562362 28754 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.658490 28388 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:34.719684 24597 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:34.713562 28716 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.675664 24036 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:34.674872 28603 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:34.728843 28799 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:18:34.729725 28815 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:34.705163 28383 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.720223 28732 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.736950 28599 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.738855 28585 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.744448 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 2402) took 1636 ms. Trace:
W20260709 12:18:34.745034 28789 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:18:34.747130 28583 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:34.750598 28420 consensus_meta.cc:287] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.568s	user 0.006s	sys 0.005s
I20260709 12:18:34.750923 28657 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.752452 28802 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.703667 28329 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:34.722924 28100 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.754330 28766 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.755230 28390 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:18:34.758807 28576 consensus_meta.cc:287] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 12:18:34.705724 28759 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:34.827847 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 153643us
I20260709 12:18:34.678646 28783 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:34.727023 28395 raft_consensus.cc:993] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:34.790911 24593 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:18:34.796072 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.863433 23960 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:34.863874 23988 raft_consensus.cc:2393] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 11: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:34.864357 28824 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:34.800190 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.865180 23991 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 8.
I20260709 12:18:34.797178 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.803061 23992 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:34.681084 28337 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:18:34.803401 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:34.804517 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 128915us
I20260709 12:18:34.869132 28759 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.763325 28556 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:34.870523 28556 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.803615 28698 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:34.817430 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 102467us
I20260709 12:18:34.812167 24062 rpcz_store.cc:276] 0709 12:18:33.108077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.108225 (+   148us) service_pool.cc:224] Handling call
0709 12:18:33.108576 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:33.138544 (+ 29968us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.138591 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:34.061458 (+922867us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b2c000dbec8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:18:34.083029 (+ 21571us) log.cc:844] Serialized 26 byte log entry
0709 12:18:34.534815 (+451786us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:34.534872 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.534969 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.744079 (+209110us) raft_consensus.cc:1685] finished
0709 12:18:34.744112 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.744375 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29506,"raft.queue_time_us":34592,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9565,"spinlock_wait_cycles":10293120,"thread_start_us":366017,"threads_started":1,"wal-append.queue_time_us":543472}
I20260709 12:18:34.810990 28383 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:34.806358 28797 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:34.720386 28792 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.811853 28584 raft_consensus.cc:697] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:34.827204 28734 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.805369 28704 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.822820 28583 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.859910 23996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:34.906458 23996 raft_consensus.cc:606] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:34.906843 23996 raft_consensus.cc:614] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:34.706590 28793 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:34.827307 28820 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:18:34.884482 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.883090 28696 raft_consensus.cc:1081] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:34.883265 28698 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.894573 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2859) took 1189 ms. Trace:
I20260709 12:18:34.861562 28576 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.900561 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.901894 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.826930 28420 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.908103 28583 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.911386 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.912322 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.918483 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.931999 23916 rpcz_store.cc:276] 0709 12:18:33.705179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.710075 (+  4896us) service_pool.cc:224] Handling call
0709 12:18:33.719015 (+  8940us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:33.719384 (+   369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:33.719415 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:33.719849 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 12:18:34.147222 (+427373us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:34.147263 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.147327 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:34.894343 (+747016us) raft_consensus.cc:1685] finished
0709 12:18:34.894366 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:34.894512 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1962,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"thread_start_us":427024,"threads_started":1,"wal-append.queue_time_us":591133}
I20260709 12:18:34.921526 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:34.922324 28822 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:34.923816 28792 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:34.911630 28818 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:34.924280 28704 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:34.905752 28795 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:34.908824 28734 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.925902 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:34.905072 28720 consensus_queue.cc:1048] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:18:34.927165 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.949680 24065 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 11: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:34.927856 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.928462 24035 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:34.950171 24068 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:34.944960 28765 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:34.951742 28765 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:34.951426 28584 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.952155 28765 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:34.952988 28555 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:34.929860 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.954541 24070 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:34.951447 24068 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:18:34.955763 28698 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:34.956104 28390 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:34.956614 28809 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:34.873863 28593 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:18:34.957175 28809 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.951149 24035 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:34.959254 28809 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.960898 28576 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.961083 28734 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.961552 28818 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.963687 28818 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:34.956626 28390 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:34.966924 28765 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:34.967378 28390 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.968868 28765 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.970544 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.939167 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:34.942658 24066 raft_consensus.cc:2393] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:18:34.942533 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 265464us
I20260709 12:18:34.973336 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:34.941524 24062 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 6.
I20260709 12:18:34.973778 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.973786 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:34.947854 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 51845.8us
I20260709 12:18:34.948788 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.975533 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:34.985693 23962 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:34.985170 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:34.942499 27904 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:34.909549 28833 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:18:34.988936 23887 leader_election.cc:400] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
I20260709 12:18:34.940198 28556 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:34.989657 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:34.990860 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.991731 23887 leader_election.cc:403] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:34.988303 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 68554.7us
I20260709 12:18:34.994242 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:34.997838 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:34.998435 24597 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:35.000869 24593 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:34.997004 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:35.003144 28802 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:35.003566 28802 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.003691 23887 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:35.003994 28802 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:35.002389 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:35.005239 28808 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:35.005740 28808 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:35.006590 28808 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.011353 24597 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:18:35.013963 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:35.017050 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.017426 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.017614 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.017627 24061 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:35.018961 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:35.020881 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:35.021646 24595 raft_consensus.cc:2410] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:18:35.022156 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:35.022778 24593 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:34.989025 28268 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:34.992520 28576 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:35.018061 24067 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
I20260709 12:18:35.028512 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:34.991770 28629 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:34.991609 28693 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:35.027680 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:35.030611 23987 raft_consensus.cc:2393] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 13: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:35.031591 23990 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:35.033087 24564 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:35.033725 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:35.034327 24593 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:35.035503 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:35.038369 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.038599 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.039418 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.037019 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:35.040792 23990 raft_consensus.cc:2393] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 15: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:35.009982 28792 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:35.036243 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:35.039067 24566 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:35.041718 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:35.043314 24600 raft_consensus.cc:2410] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:18:35.010469 28706 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11.
I20260709 12:18:35.043499 23996 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:34.991144 28337 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:18:34.993624 28329 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:18:35.024873 28818 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:35.028486 28268 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.059396 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:35.037513 28629 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:35.054381 28831 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:35.055456 28806 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:34.989243 28821 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:18:35.058499 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:35.058564 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:35.009188 28383 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:34.997032 28585 consensus_queue.cc:1059] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:18:35.048926 23962 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:35.028556 28576 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.074236 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:35.014138 28765 consensus_queue.cc:1059] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:18:35.066653 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:35.091993 23987 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:35.039345 28716 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.069504 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:35.049831 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:35.066337 28629 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.092598 23962 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:35.095069 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 45317.1us
I20260709 12:18:35.096665 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.072640 28806 raft_consensus.cc:697] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:35.052737 24035 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:35.089775 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:35.098054 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 45377.7us
I20260709 12:18:35.098444 23916 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:35.046241 28759 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:35.060331 28792 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:35.068238 28268 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.030441 28804 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.099822 24593 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:35.072654 28739 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:35.114092 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.108999 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.109429 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.109644 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.087343 28576 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:35.110105 24066 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:35.097208 23917 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:35.091018 28348 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.118696 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.097681 28612 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:35.123172 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.098563 28831 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:35.126470 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.132143 23960 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:35.071161 28818 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.125530 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.107576 28698 raft_consensus.cc:2764] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:18:35.106557 28716 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:35.113700 28585 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:35.136847 24065 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:35.165849 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.137413 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:35.093389 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:35.099982 23886 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:35.100800 28770 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:18:35.158684 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.173982 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.176676 23919 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 12: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:35.199761 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.200418 23913 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
I20260709 12:18:35.199970 23921 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:35.201253 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:35.201464 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 64434.2us
I20260709 12:18:35.202327 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.203619 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.204600 23919 raft_consensus.cc:2410] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 12 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:35.209985 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:35.210729 24065 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:35.150434 27904 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:35.214515 23912 raft_consensus.cc:1275] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:35.253455 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.343866 23917 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
I20260709 12:18:35.154202 28754 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:35.254267 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.345885 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.133764 28614 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:35.360639 28840 log.cc:927] Time spent T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 12:18:35.254884 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:35.361303 23916 raft_consensus.cc:2376] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12. Re-sending same reply.
I20260709 12:18:35.362468 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:35.150012 28612 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:35.363857 28612 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.258607 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:35.362392 28845 log.cc:927] Time spent T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:18:35.367154 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.275858 28792 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.368232 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.369253 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:35.254539 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 154618us
I20260709 12:18:35.370810 28844 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.371345 28844 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.371860 23886 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:35.165405 28585 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:35.162091 28716 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:35.269948 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 176615us
I20260709 12:18:35.380455 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:35.199290 28823 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.260888 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.279798 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:35.285737 28726 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:35.286175 28821 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:35.286729 28831 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:35.287030 28778 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:35.216348 28600 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:35.205291 28337 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:35.287799 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:35.059110 28795 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.199158 28764 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.207s
I20260709 12:18:35.257385 28793 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.256961 28420 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.360348 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.275113 28824 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:35.288632 28329 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:35.377231 24564 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:35.370157 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.432060 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.343636 28503 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:35.441854 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.373255 28754 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.451987 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.445969 28808 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:18:35.431185 28770 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:35.431468 28726 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.477483 23917 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:35.378302 28802 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:35.481477 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 193782us
I20260709 12:18:35.476635 28823 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:35.482484 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.483976 23921 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:35.427700 28716 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:35.488524 23912 raft_consensus.cc:2368] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12.
I20260709 12:18:35.446676 28600 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:35.455152 28383 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.492399 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.438405 28704 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:35.318851 28806 consensus_queue.cc:237] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.478770 28329 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.511636 23960 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:35.530057 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.512908 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.482270 28793 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.472875 28337 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.446481 28706 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 12:18:35.487931 28754 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:35.497776 28770 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:35.527005 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 155200us
I20260709 12:18:35.448665 28831 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.444753 28821 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.516136 28804 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.518028 28600 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:35.521253 23919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:18:35.602291 23919 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:35.602676 23919 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.488322 28503 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:35.568639 28839 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
I20260709 12:18:35.568830 23912 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:18:35.583252 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 50976.8us
I20260709 12:18:35.534502 24062 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 15: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
W20260709 12:18:35.585271 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.551496 23921 raft_consensus.cc:1275] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:35.503393 28726 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:35.567289 28818 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.533807 28329 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:35.596663 28770 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.482101 28824 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.537006 28844 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.572710 28798 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:35.547950 28825 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.618204 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.531957 28704 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.564190 28793 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.525004 28585 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.632088 24062 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
W20260709 12:18:35.621086 28657 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.017s	sys 0.001s
I20260709 12:18:35.599989 28614 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:18:35.620177 28804 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.658254 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:35.660756 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 283600us
I20260709 12:18:35.662488 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:35.663116 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 221857us
I20260709 12:18:35.666261 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:35.653398 28657 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.017s	sys 0.001s
I20260709 12:18:35.633602 28858 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.670321 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:35.657189 28844 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:35.674674 24564 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:35.677392 28861 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:35.678072 28861 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:35.678578 28853 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:18:35.678797 28861 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:35.679533 28861 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:35.679880 28861 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.680197 28861 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:35.682422 28842 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.682960 28842 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.683239 28503 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:35.684496 28857 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:18:35.688632 28861 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:35.689882 28629 consensus_meta.cc:287] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.574s	user 0.007s	sys 0.000s
W20260709 12:18:35.691349 28268 consensus_meta.cc:287] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.569s	user 0.013s	sys 0.002s
W20260709 12:18:35.693720 28856 log.cc:927] Time spent T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 12:18:35.694356 28854 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:35.694911 28854 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:35.695005 28802 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.695554 28704 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.652070 28798 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:35.683313 28849 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:18:35.672154 28585 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:35.672281 28556 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:35.691761 28268 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.662622 28804 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.698132 23919 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:35.727689 28583 consensus_meta.cc:287] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.784s	user 0.012s	sys 0.005s
I20260709 12:18:35.736594 23919 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.739109 24593 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:18:35.729851 28745 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.721365 28556 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:35.728120 28861 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.698724 28629 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.780014 28629 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.729956 28860 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:35.750947 28268 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.751855 28100 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:35.806778 28860 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.754702 28556 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:35.809024 28860 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.675680 28858 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.758430 28867 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.810537 28867 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.811163 28759 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.811357 28858 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:35.762436 28862 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:18:35.811694 28759 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.812574 28867 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.814291 28759 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.764576 28798 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.765386 28821 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.766248 28824 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.766858 28831 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.767772 28793 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.767813 28383 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:18:35.815686 23946 heartbeater.cc:646] Failed to heartbeat to 127.22.48.62:36189 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.48.62:36189 timed out after 15.000s (SENT)
I20260709 12:18:35.815843 28383 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:35.816272 28629 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.816679 28383 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.816890 28629 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.817842 28383 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:35.695837 28854 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.819386 28629 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:35.770087 28600 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.761760 28770 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:35.771631 28388 consensus_meta.cc:287] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.964s	user 0.010s	sys 0.000s
I20260709 12:18:35.736469 28764 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:18:35.738405 28693 consensus_queue.cc:1048] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:18:35.698963 28844 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.829435 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.830722 23918 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
W20260709 12:18:35.745082 28852 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 12:18:35.796636 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:35.797416 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:35.836715 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:35.786752 28745 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.799590 28716 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.800117 28804 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.801774 23989 raft_consensus.cc:1240] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 12:18:35.806348 28732 consensus_meta.cc:287] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.983s	user 0.012s	sys 0.002s
I20260709 12:18:35.807183 28100 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:35.742267 28337 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.808763 28754 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.735113 28583 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.760161 28727 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.762521 23915 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45120 (request call id 2866) took 1364 ms. Trace:
I20260709 12:18:35.867151 23915 rpcz_store.cc:276] 0709 12:18:34.398591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.435518 (+ 36927us) service_pool.cc:224] Handling call
0709 12:18:34.762019 (+326501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:34.762185 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:34.762210 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:34.762248 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:34.762293 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:34.762346 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:35.762361 (+1000015us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b540031fbd0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:35.762468 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750128896}
I20260709 12:18:35.908273 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:35.823975 23962 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:35.826634 23919 raft_consensus.cc:1240] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:35.820912 28576 consensus_meta.cc:287] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.693s	user 0.005s	sys 0.005s
I20260709 12:18:35.841717 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:35.938220 28576 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.940481 28576 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.941159 23916 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:35.944607 28716 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.946734 28844 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.949218 23916 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:35.950810 28100 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.952188 28100 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:35.954936 28818 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:35.955827 28754 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.955703 28818 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.960939 28686 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.856436 28732 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.962335 28770 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:35.963467 28732 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.857810 28726 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:35.965157 28583 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.965837 28726 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.966542 23917 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 16: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:35.967944 28842 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.969017 28600 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:35.836063 28388 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:35.972987 28388 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:35.973189 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:35.974359 24069 raft_consensus.cc:2368] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:35.974447 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.975533 24068 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:35.975744 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 2405) took 1057 ms. Trace:
I20260709 12:18:35.976291 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.976770 23913 raft_consensus.cc:2410] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:18:35.976941 24068 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:35.852258 28745 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:35.853794 28766 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:35.857508 23960 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:35.859226 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 184608us
I20260709 12:18:35.977880 28555 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.859681 24065 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:35.806134 28329 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:35.987499 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 163620us
I20260709 12:18:35.976203 24069 rpcz_store.cc:276] 0709 12:18:34.918016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.918250 (+   234us) service_pool.cc:224] Handling call
0709 12:18:35.975525 (+1057275us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540004c754. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:35.975677 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2375190400}
I20260709 12:18:35.845907 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:35.977787 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:35.989449 24068 raft_consensus.cc:3060] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:35.990125 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 132716us
I20260709 12:18:35.992051 23989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:35.994731 23989 raft_consensus.cc:606] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:35.995078 23989 raft_consensus.cc:614] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:35.996634 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:35.999433 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:36.000803 23887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.022s	sys 0.060s
W20260709 12:18:36.001214 23887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.022s	sys 0.060s
I20260709 12:18:36.002039 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.003005 24069 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:36.004437 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.011273 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:36.011340 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 207871us
I20260709 12:18:35.979033 28818 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:36.020320 24065 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:36.005833 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:36.024085 24062 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:36.027922 24599 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:18:36.031984 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.032804 24069 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:36.039506 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:35.997352 28612 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:36.002956 28793 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.050263 24591 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:36.050590 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:36.033957 28727 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:36.045092 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.051698 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:36.052250 23991 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:36.052480 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:36.045825 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.003118 28600 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:36.053431 28600 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:36.053853 28600 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.055518 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:36.056658 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:36.057237 23988 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:36.058013 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:35.996803 28766 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.058878 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:36.058792 28766 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.060847 28766 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:36.002528 28821 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.048146 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.061450 28821 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.062045 28824 consensus_queue.cc:1059] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:36.063264 28763 raft_consensus.cc:3055] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:36.063550 28821 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:36.063681 28763 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:36.048945 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.064586 28763 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.065796 28763 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.001587 28790 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.001356 28388 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:36.068454 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.064970 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.049085 23993 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:36.069339 24067 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:36.070469 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.070629 23960 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:36.071070 24597 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:36.075490 24068 raft_consensus.cc:2468] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:36.077960 24069 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
I20260709 12:18:36.069646 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.081736 24591 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:36.083194 23991 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:36.083899 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.025218 28686 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.085732 23988 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:36.087317 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:36.087919 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.088315 23962 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:36.089002 24597 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:36.091943 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.036306 28726 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:36.092538 24069 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:35.987043 28555 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.097298 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.104388 24034 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:35.996605 28831 consensus_queue.cc:1048] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:18:36.046372 28585 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:36.040347 28818 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.041224 28348 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.046545 28612 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.107064 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.121920 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.071805 28727 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:36.123433 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:36.109390 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.111613 24067 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 16.
I20260709 12:18:36.124222 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:36.124583 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.111797 24069 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:36.113983 24591 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:36.127043 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.127599 24597 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.127646 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.117182 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.068434 28716 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.118821 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.085516 28824 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.116545 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.136044 24068 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:36.067333 28790 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.190130 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.107959 28795 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.188098 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.189114 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.215175 24596 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:36.096951 28832 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:36.216383 24069 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:36.193101 28716 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.272921 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.218022 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.219662 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.220865 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.221843 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.134217 28612 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:36.188782 23996 raft_consensus.cc:1240] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:36.093075 28388 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.279502 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.188098 28870 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.230315 28329 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:36.230967 28872 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:18:36.246038 28853 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:18:36.251336 23914 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 769) took 1088 ms. Trace:
W20260709 12:18:36.253985 28843 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:18:36.105367 28704 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.099s
I20260709 12:18:36.083073 28793 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.255177 23992 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2678) took 1199 ms. Trace:
I20260709 12:18:36.302589 23992 rpcz_store.cc:276] 0709 12:18:35.055803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.057703 (+  1900us) service_pool.cc:224] Handling call
0709 12:18:35.058060 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:35.067414 (+  9354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.067460 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:35.088500 (+ 21040us) log.cc:844] Serialized 26 byte log entry
0709 12:18:35.374008 (+285508us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:35.374076 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:35.374164 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.252769 (+878605us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b54001b4a20. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0bc7dbe 00007f75c0bd2930 00007f75c0bd28d8 00007f75c0bd2858 00007f75c0bd2813 00007f75c0bd1a9c 00007f75c6abd2f6 00007f75c6ab7aa8 00007f75c0c0e7cb 00007f75c0c112c0
0709 12:18:36.254902 (+  2133us) raft_consensus.cc:1685] finished
0709 12:18:36.254921 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.255119 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10441,"raft.queue_time_us":7514,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":20998,"spinlock_wait_cycles":14693120,"thread_start_us":207419,"threads_started":1,"wal-append.queue_time_us":250912}
I20260709 12:18:36.304490 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.304625 24597 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:36.305570 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:36.257015 28600 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.307948 28600 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.257622 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:36.303329 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.308758 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:36.258608 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 1296) took 1107 ms. Trace:
I20260709 12:18:36.262629 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.262995 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.264358 23993 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:18:36.265726 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.266214 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.311823 24064 raft_consensus.cc:2368] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:36.269732 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.275689 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.312825 23915 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:36.282331 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.282423 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.313730 24069 raft_consensus.cc:2368] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:36.280269 23920 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:36.119580 28825 raft_consensus.cc:2804] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:36.310011 24593 rpcz_store.cc:276] 0709 12:18:35.151286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.151429 (+   143us) service_pool.cc:224] Handling call
0709 12:18:35.151743 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:35.739489 (+587746us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.258378 (+518889us) spinlock_profiling.cc:243] Waited 587 ms on lock 0x7b54006112d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:36.258553 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1350289792}
I20260709 12:18:36.286692 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.316402 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:36.317512 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:36.292348 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.318521 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:36.142524 28727 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.298557 24591 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.319716 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.319929 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.321497 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.322959 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:36.288033 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.133883 28770 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:36.299793 23914 rpcz_store.cc:276] 0709 12:18:35.162974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.163124 (+   150us) service_pool.cc:224] Handling call
0709 12:18:35.208581 (+ 45457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:35.596621 (+388040us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.596653 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:35.596697 (+    44us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:35.596728 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.251123 (+654395us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b5400224054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:36.251168 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.251280 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891921664}
I20260709 12:18:36.258204 28556 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.096556 28686 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.272645 28728 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:36.325790 23992 raft_consensus.cc:2368] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:36.193267 28824 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.329321 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.139760 28348 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.331138 24594 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.337206 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.348158 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.352056 23996 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:36.331647 28821 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:36.362540 28821 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.362941 28821 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.365198 28686 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:36.367794 28388 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:36.368954 28790 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.298868 28870 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.371018 28870 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:36.347285 28728 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.374253 24068 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:36.322772 28798 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:36.141845 28818 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.336800 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:36.332185 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:36.331278 28329 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:36.381850 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 137581us
I20260709 12:18:36.382993 23993 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:36.332507 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.344620 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:36.344646 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.384863 23912 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:18:36.337244 28383 consensus_meta.cc:287] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.001s
I20260709 12:18:36.376633 24591 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:36.377676 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.337599 24597 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:36.378979 23921 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.387492 23961 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:36.331147 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:36.327654 28825 raft_consensus.cc:697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:36.389199 23990 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:36.382977 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:36.390007 24067 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:36.390232 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.344007 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:36.338351 28860 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:36.373590 28793 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.394323 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.394964 24597 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:36.395794 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.391547 23989 raft_consensus.cc:2368] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:36.391247 24564 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:36.391741 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:18:36.392764 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 288459us
I20260709 12:18:36.397734 24070 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:36.397894 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 66803us
I20260709 12:18:36.399570 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.400588 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.401283 24592 raft_consensus.cc:2368] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12.
I20260709 12:18:36.401319 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:36.398175 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:36.402251 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:36.373615 28728 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:36.405385 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.404152 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.415303 24597 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:36.415771 24034 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.416847 24034 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.410583 24564 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:36.386087 28329 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:36.406534 23886 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:36.407435 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:36.423676 23887 leader_election.cc:400] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:36.424050 23887 leader_election.cc:403] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:18:36.394472 28802 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:36.427848 23887 leader_election.cc:400] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:36.428004 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.428323 23887 leader_election.cc:403] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:18:36.395244 28860 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.414207 23921 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
W20260709 12:18:36.432670 23961 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.439445 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.406260 28831 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:36.434267 23886 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:36.453967 23886 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:36.405871 28832 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:36.406472 28716 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:36.456357 24592 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:18:36.456452 24070 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 16.
I20260709 12:18:36.408828 28885 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:36.420192 28100 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:36.460631 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.405687 28686 consensus_queue.cc:1059] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:18:36.479377 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.479970 28726 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:36.480540 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.481086 24068 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:36.481166 28560 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:36.481896 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:36.483210 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.484228 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.484381 28603 consensus_queue.cc:1059] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:36.485913 23917 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:36.464468 28824 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.426963 28763 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:36.420079 28766 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:36.421335 28728 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:36.434067 28854 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:36.469028 23920 raft_consensus.cc:2410] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:18:36.459378 28832 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.465826 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.491441 24035 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.469442 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.442833 28790 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.449101 24597 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 16.
I20260709 12:18:36.471158 28817 raft_consensus.cc:3055] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:36.473047 23916 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2887) took 1208 ms. Trace:
I20260709 12:18:36.503342 23916 rpcz_store.cc:276] 0709 12:18:35.264243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.362182 (+ 97939us) service_pool.cc:224] Handling call
0709 12:18:36.472882 (+1110700us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b54002c4054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:36.472991 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329192704}
I20260709 12:18:36.465469 28337 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:36.475816 28348 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:36.434762 28802 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:36.477527 28329 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.478551 28629 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.478662 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.433974 28798 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.486140 23961 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:36.487407 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.484876 23988 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 12: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:36.445405 28860 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.451071 28585 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:36.490525 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.497989 28732 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:36.519181 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:36.487694 24594 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:36.507316 24035 leader_election.cc:400] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12.
I20260709 12:18:36.520183 24035 leader_election.cc:403] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:18:36.501972 28832 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.521075 23993 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:36.470323 28716 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.497359 28728 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:36.522912 23961 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:36.524127 23961 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:36.497622 28854 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.512753 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:36.556123 24068 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 12: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:36.514232 28855 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:36.508298 28766 consensus_queue.cc:1059] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:18:36.515965 23996 raft_consensus.cc:2393] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 12: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:36.452384 28831 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:36.488065 28763 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:36.512482 23989 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
I20260709 12:18:36.528946 28348 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12.
I20260709 12:18:36.478930 28825 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.530771 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.595817 23993 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
W20260709 12:18:36.533262 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.503141 28817 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:36.539343 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:36.508733 28802 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:36.518198 28732 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:36.511152 23805 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 10cd478aa7e9411bba254e94713f91de with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 71a48f59ff764d249519c6a53ec57f02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:36.442731 28871 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
W20260709 12:18:36.601975 23805 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 90887.2us
I20260709 12:18:36.512092 28337 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:36.517925 28585 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.500980 28790 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.530109 28728 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:36.511992 28885 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:18:36.529399 28833 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:36.505898 28388 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:36.560959 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 144159us
I20260709 12:18:36.608371 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:36.540162 28600 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:18:36.501365 28100 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:36.583236 28824 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:18:36.591619 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 164468us
I20260709 12:18:36.556959 28583 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:18:36.578676 28754 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:36.594170 23989 raft_consensus.cc:1240] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:36.577848 28329 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:36.603183 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 149285us
I20260709 12:18:36.565629 28854 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.557485 28855 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.632360 28855 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.577407 28870 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:36.634675 28870 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.636896 28870 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.582986 28831 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.591140 28763 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.603667 28585 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.654722 28870 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:36.655364 28870 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.657570 28870 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:36.616546 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:36.662770 28899 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.662235 28855 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.670053 28855 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:36.678786 28728 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.680460 28612 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.681159 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:36.639644 24034 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.643043 28337 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.616325 28817 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.703840 23917 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
W20260709 12:18:36.663074 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 46640.2us
I20260709 12:18:36.675513 24067 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.676105 28802 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.607174 28556 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.747977 28854 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.748791 28802 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:36.749747 28348 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:36.743654 28855 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.751878 24061 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:36.625159 23886 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:36.685228 28560 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:36.685568 23960 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:36.686254 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.686058 28100 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.764305 23912 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 13. Current term is 14. Ops: []
W20260709 12:18:36.765349 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 79849.4us
I20260709 12:18:36.703271 28770 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:36.693679 23961 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:36.771106 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 77541.3us
W20260709 12:18:36.699772 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 60225.8us
I20260709 12:18:36.666406 28754 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:36.627786 28884 log.cc:927] Time spent T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 12:18:36.626808 28891 log.cc:927] Time spent T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:18:36.782603 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60542 (request call id 853) took 1580 ms. Trace:
I20260709 12:18:36.625141 28818 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:36.744657 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 63567.6us
I20260709 12:18:36.750801 28855 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.786201 24036 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:36.770141 28599 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:36.681681 28728 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.754194 24067 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:36.789610 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 2427) took 1411 ms. Trace:
I20260709 12:18:36.789975 24067 rpcz_store.cc:276] 0709 12:18:35.378551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.675111 (+1296560us) service_pool.cc:224] Handling call
0709 12:18:36.675404 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.789340 (+113936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.789549 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:36.753505 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 128403us
I20260709 12:18:36.756032 24061 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:36.793653 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2408) took 1013 ms. Trace:
I20260709 12:18:36.757007 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:36.796398 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.797174 24597 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:36.758955 23915 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:18:36.799701 23915 pending_rounds.cc:85] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 12
I20260709 12:18:36.678141 28585 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.772079 24034 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:36.802829 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:36.750262 28348 raft_consensus.cc:697] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:36.750162 28854 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.775197 28813 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:36.775113 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:36.761772 28802 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:36.778136 28600 consensus_queue.cc:1059] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:36.626700 28629 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:36.783041 23987 rpcz_store.cc:276] 0709 12:18:35.202592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.202711 (+   119us) service_pool.cc:224] Handling call
0709 12:18:35.261478 (+ 58767us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:35.283997 (+ 22519us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:35.284049 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:35.287156 (+  3107us) log.cc:844] Serialized 52 byte log entry
0709 12:18:36.271884 (+984728us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b180038c4a0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:18:36.469965 (+198081us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:36.470004 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.470078 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:36.780635 (+310557us) raft_consensus.cc:1685] finished
0709 12:18:36.780660 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.782532 (+  1872us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22426,"raft.queue_time_us":22463,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":31043,"spinlock_wait_cycles":7459200,"thread_start_us":197897,"threads_started":1,"wal-append.queue_time_us":1274189}
I20260709 12:18:36.797087 23919 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:36.800064 23915 pending_rounds.cc:107] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:18:36.663638 28790 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.780773 28612 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.794095 24061 rpcz_store.cc:276] 0709 12:18:35.780296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.754703 (+974407us) service_pool.cc:224] Handling call
0709 12:18:36.755090 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.793308 (+ 38218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.793587 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:36.790789 28766 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:36.817234 24061 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:36.823124 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2410) took 1042 ms. Trace:
I20260709 12:18:36.810858 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.813632 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:36.771401 28727 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.813967 23915 raft_consensus.cc:2889] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:36.808171 28821 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.834560 24593 raft_consensus.cc:2368] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14.
I20260709 12:18:36.812419 28629 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:36.816051 28886 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:36.703126 28732 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.807020 24067 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 12:18:36.819263 28883 log.cc:927] Time spent T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:18:36.828234 28727 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.828699 23918 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.826710 24061 rpcz_store.cc:276] 0709 12:18:35.780823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.816526 (+1035703us) service_pool.cc:224] Handling call
0709 12:18:36.816883 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.817813 (+   930us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.823068 (+  5255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:36.809394 28770 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:36.837671 24034 leader_election.cc:400] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12.
I20260709 12:18:36.849695 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2409) took 1069 ms. Trace:
I20260709 12:18:36.866387 24067 rpcz_store.cc:276] 0709 12:18:35.780569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.806324 (+1025755us) service_pool.cc:224] Handling call
0709 12:18:36.806708 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.849348 (+ 42640us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.849626 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:36.851630 24597 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:36.820200 28813 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:36.894387 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2411) took 1113 ms. Trace:
I20260709 12:18:36.895072 24061 rpcz_store.cc:276] 0709 12:18:35.781063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.889991 (+1108928us) service_pool.cc:224] Handling call
0709 12:18:36.893705 (+  3714us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.893928 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.893981 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.894036 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:36.894086 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.894155 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.894314 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:36.897275 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2414) took 1115 ms. Trace:
I20260709 12:18:36.899397 24061 rpcz_store.cc:276] 0709 12:18:35.787648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.896361 (+1108713us) service_pool.cc:224] Handling call
0709 12:18:36.896682 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.896878 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.896914 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.896978 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:36.897022 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.897090 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.897213 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:36.898777 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2412) took 1117 ms. Trace:
I20260709 12:18:36.901575 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 957) took 1759 ms. Trace:
I20260709 12:18:36.825677 28802 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:36.902395 24067 rpcz_store.cc:276] 0709 12:18:35.781309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.897859 (+1116550us) service_pool.cc:224] Handling call
0709 12:18:36.898325 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.898496 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.898522 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.898560 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:36.898589 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.898638 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.898729 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:36.860441 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 80738.8us
I20260709 12:18:36.847415 28860 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.916532 28855 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.905208 28770 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:36.920195 28763 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.907444 28348 consensus_queue.cc:237] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:36.922377 28629 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.923709 28629 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:36.928387 28832 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:36.930266 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 236205us
I20260709 12:18:36.855023 28754 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.935319 28585 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:36.936353 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:36.940205 24070 raft_consensus.cc:2410] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:18:36.941879 23886 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:36.942209 28860 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:36.943053 28802 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:36.913306 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:36.949471 24061 raft_consensus.cc:1240] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:37.075632 24063 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 2423) took 1964 ms. Trace:
I20260709 12:18:36.950304 28766 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:37.043270 28585 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:37.076128 24063 rpcz_store.cc:276] 0709 12:18:35.111038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.591156 (+1480118us) service_pool.cc:224] Handling call
0709 12:18:36.591510 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.613038 (+ 21528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.613082 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.617573 (+  4491us) log.cc:844] Serialized 26 byte log entry
0709 12:18:36.782860 (+165287us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:37.075042 (+292182us) log.cc:844] Serialized 14 byte log entry
0709 12:18:37.075284 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.075377 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.075418 (+    41us) raft_consensus.cc:1685] finished
0709 12:18:37.075433 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.075577 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21101,"prepare.queue_time_us":153062,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":22132,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":12168,"thread_start_us":405055,"threads_started":2,"wal-append.queue_time_us":207831}
I20260709 12:18:37.093748 24063 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:37.110463 23996 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:37.116837 23918 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:37.122710 24063 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:37.075356 28763 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.076859 28686 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:37.077200 28832 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:37.150002 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:37.154440 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 241192us
W20260709 12:18:37.157033 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:37.141398 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 326922us
I20260709 12:18:37.159375 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:37.189288 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:37.204286 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.142218 28329 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.141388 28585 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:37.172731 28904 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:18:37.212765 28837 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:37.213049 28600 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:37.214164 28612 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:37.228243 28612 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.213191 28420 consensus_queue.cc:1059] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:18:37.137372 28813 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:37.200404 28831 consensus_meta.cc:287] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
I20260709 12:18:37.173084 28763 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:37.192540 28915 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:37.196987 28754 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:18:37.227555 28837 consensus_queue.cc:1243] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer a46beb8868d749fdbaa732dd1ef6b89b log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:37.238942 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:37.223196 28599 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:37.252789 24063 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:37.254877 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:37.255645 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:37.256191 24063 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:37.240852 28821 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:37.224599 28329 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.241474 28763 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.262217 24036 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:37.242971 28915 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:37.270797 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 411395us
I20260709 12:18:37.275903 24063 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:37.279238 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:37.243618 28831 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.282347 24034 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
W20260709 12:18:37.281519 28914 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:18:37.247684 28766 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.274084 28915 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:37.274561 28913 raft_consensus.cc:2764] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:18:37.278849 28612 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.279786 28917 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.271718 28763 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:37.295372 24600 raft_consensus.cc:1240] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 13. Current term is 14. Ops: []
W20260709 12:18:37.384464 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 675537us
I20260709 12:18:37.385386 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:37.387156 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37694 (request call id 1132) took 1279 ms. Trace:
I20260709 12:18:37.387633 24594 rpcz_store.cc:276] 0709 12:18:36.107569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.121683 (+ 14114us) service_pool.cc:224] Handling call
0709 12:18:37.386942 (+1265259us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b540064da54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:37.387083 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479760640}
I20260709 12:18:37.389133 24599 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:37.394657 28917 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.397431 28917 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.399487 28762 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:37.283000 28585 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.399923 28762 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:37.400300 28762 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:37.352620 28900 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.403650 28900 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.418985 23961 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:37.420311 28612 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:37.420817 28612 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:37.421664 28612 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.431680 28900 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.426252 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:37.433825 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 145406us
I20260709 12:18:37.435482 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.438512 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:37.354621 28906 log.cc:927] Time spent T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:18:37.355391 28916 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:37.363091 28911 log.cc:927] Time spent T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:18:37.364754 28329 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.366691 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:37.457731 24595 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:37.274848 28912 consensus_queue.cc:1059] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:18:37.289078 28908 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:37.351943 28599 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.465304 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:37.467878 28329 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:37.468320 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:37.372850 28831 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:37.469323 28897 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:37.442188 23990 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:37.470093 28912 raft_consensus.cc:3055] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:37.471254 28912 raft_consensus.cc:740] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:37.471635 24066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2400) took 2037 ms. Trace:
I20260709 12:18:37.472018 28912 consensus_queue.cc:260] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.472608 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:37.446026 24034 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:37.446874 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:37.473255 23993 raft_consensus.cc:2368] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:37.449684 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:37.473676 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:37.291127 28348 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:37.464345 28337 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:37.474974 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:37.464670 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:37.464490 28908 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.473004 28928 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:37.473204 28912 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:37.475773 28915 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.476886 23987 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:37.478543 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:37.479583 28908 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.472038 24066 rpcz_store.cc:276] 0709 12:18:35.434600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.700858 (+1266258us) service_pool.cc:224] Handling call
0709 12:18:36.701219 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.701574 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.701606 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.743554 (+ 41948us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.058093 (+314539us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:37.058151 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.058242 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.471437 (+413195us) raft_consensus.cc:1685] finished
0709 12:18:37.471458 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.471574 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":840,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":44318,"thread_start_us":310416,"threads_started":1,"wal-append.queue_time_us":458745}
I20260709 12:18:37.481024 28928 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:37.455116 28900 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:37.505477 28900 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:37.505923 28900 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:37.457885 28854 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:18:37.509356 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37704 (request call id 1304) took 1153 ms. Trace:
I20260709 12:18:37.509733 24599 rpcz_store.cc:276] 0709 12:18:36.355817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.403555 (+ 47738us) service_pool.cc:224] Handling call
0709 12:18:37.388944 (+985389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.389614 (+   670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.509135 (+119521us) spinlock_profiling.cc:243] Waited 968 ms on lock 0x7b540064da50. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c518ad 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:37.509296 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227230976}
I20260709 12:18:37.510618 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2419) took 1487 ms. Trace:
I20260709 12:18:37.510975 24067 rpcz_store.cc:276] 0709 12:18:36.022967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.909512 (+886545us) service_pool.cc:224] Handling call
0709 12:18:36.909902 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.910243 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.913806 (+  3563us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:37.057992 (+144186us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.281976 (+223984us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:37.282017 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.282081 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.510424 (+228343us) raft_consensus.cc:1685] finished
0709 12:18:37.510443 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.510564 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24708,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":172855,"threads_started":1,"wal-append.queue_time_us":426028}
I20260709 12:18:37.514940 23917 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2902) took 1460 ms. Trace:
I20260709 12:18:37.514995 24070 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:37.515390 23917 rpcz_store.cc:276] 0709 12:18:36.054884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.058636 (+  3752us) service_pool.cc:224] Handling call
0709 12:18:37.514797 (+1456161us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54001fde54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:37.514888 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":980666240}
I20260709 12:18:37.516364 28763 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.518501 24593 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37704 (request call id 1299) took 1191 ms. Trace:
I20260709 12:18:37.518247 28762 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.519028 28915 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:37.520622 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 309696us
I20260709 12:18:37.523417 24593 rpcz_store.cc:276] 0709 12:18:36.327125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.329034 (+  1909us) service_pool.cc:224] Handling call
0709 12:18:37.518316 (+1189282us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400556c54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:37.518443 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124693760}
I20260709 12:18:37.529222 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:18:37.544889 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 96456us
I20260709 12:18:37.546165 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:37.546435 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:37.547900 24035 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:37.548411 24599 raft_consensus.cc:2410] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:18:37.546855 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:37.549722 24035 leader_election.cc:400] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14.
I20260709 12:18:37.550130 24035 leader_election.cc:403] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:37.550463 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
W20260709 12:18:37.521147 28802 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.036s	sys 0.057s
I20260709 12:18:37.555848 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:37.561836 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:37.559525 28802 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.036s	sys 0.057s
I20260709 12:18:37.565166 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:37.567473 24066 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
W20260709 12:18:37.569626 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 350912us
I20260709 12:18:37.557137 28917 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:37.555994 28885 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:37.584434 28885 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.583386 28813 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:18:37.600296 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 119176us
I20260709 12:18:37.633649 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2901) took 1579 ms. Trace:
I20260709 12:18:37.634107 23918 rpcz_store.cc:276] 0709 12:18:36.054596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.057785 (+  3189us) service_pool.cc:224] Handling call
0709 12:18:37.610008 (+1552223us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54001fed54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:37.633591 (+ 23583us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1771020544}
I20260709 12:18:37.634970 24070 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:37.597718 28885 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:37.601326 28813 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.644861 28762 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:37.645488 24061 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2416) took 1652 ms. Trace:
I20260709 12:18:37.645944 28593 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.667527 24061 rpcz_store.cc:276] 0709 12:18:35.993374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.909206 (+915832us) service_pool.cc:224] Handling call
0709 12:18:36.909482 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.950059 (+ 40577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.645227 (+695168us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b5400265f54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:37.645414 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91166080}
I20260709 12:18:37.667783 28593 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.650498 23991 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:37.593997 28716 consensus_queue.cc:1059] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:18:37.650769 28555 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.652294 28908 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:37.656958 24598 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 1134) took 1514 ms. Trace:
W20260709 12:18:37.650513 24065 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57828 (request call id 2425) took 2523 ms (client timeout 2100 ms). Trace:
I20260709 12:18:37.659159 28763 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:37.661036 28917 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) with higher term. Message: Invalid argument: T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14.
I20260709 12:18:37.649788 28900 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.662942 24063 pending_rounds.cc:85] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 9
I20260709 12:18:37.678536 24063 pending_rounds.cc:107] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:18:37.678925 24063 raft_consensus.cc:2889] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:37.674401 24065 rpcz_store.cc:269] 0709 12:18:35.111527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.269237 (+157710us) service_pool.cc:224] Handling call
0709 12:18:37.608632 (+2339395us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b5400212fd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:37.634466 (+ 25834us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089526144}
I20260709 12:18:37.674232 24598 rpcz_store.cc:276] 0709 12:18:36.142344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.194446 (+ 52102us) service_pool.cc:224] Handling call
0709 12:18:36.226835 (+ 32389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:36.227228 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.227261 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:36.227873 (+   612us) log.cc:844] Serialized 52 byte log entry
0709 12:18:36.391269 (+163396us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:36.574259 (+182990us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.574648 (+   389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.574755 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.652408 (+1077653us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b18004375c0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb653f3 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:37.656631 (+  4223us) raft_consensus.cc:1685] finished
0709 12:18:37.656752 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.656897 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":218622,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":7409,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":11860,"spinlock_wait_cycles":6160640,"thread_start_us":328965,"threads_started":2,"wal-append.queue_time_us":365350}
W20260709 12:18:37.676306 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 104036us
I20260709 12:18:37.673723 28908 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.633293 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:37.682108 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 79128.7us
I20260709 12:18:37.682767 23962 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:37.682884 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.685549 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:37.686156 23988 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:37.686472 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.686185 23990 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:37.688180 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.689296 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:37.689421 28926 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:37.689788 28585 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:37.691885 24036 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.694839 24067 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:37.695173 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.696447 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:37.696523 28762 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:37.696527 23887 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.697467 28762 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:37.697556 28555 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:37.699076 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:37.699920 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.700927 23990 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:37.702668 23887 leader_election.cc:400] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:37.703210 23887 leader_election.cc:403] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:18:37.703002 28854 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:37.704339 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.706658 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:37.707633 28818 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:37.707918 28583 raft_consensus.cc:3055] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:37.708166 28818 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:37.708367 28583 raft_consensus.cc:740] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:37.708841 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:37.709152 28818 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.703150 28612 consensus_queue.cc:1059] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:18:37.711056 28910 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:37.711390 28910 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:36.902701 24068 rpcz_store.cc:276] 0709 12:18:35.142202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.593593 (+1451391us) service_pool.cc:224] Handling call
0709 12:18:36.593889 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.606625 (+ 12736us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:36.791907 (+185282us) log.cc:844] Serialized 14 byte log entry
0709 12:18:36.901153 (+109246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:36.901218 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:36.901279 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.901363 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:36.901508 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2543,"prepare.queue_time_us":295822,"thread_start_us":291175,"threads_started":2}
I20260709 12:18:37.712139 28910 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.713395 28910 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:37.684000 28802 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:37.716719 28908 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:37.703598 28555 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:18:37.718791 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:37.719631 28813 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:37.709296 28583 consensus_queue.cc:260] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.692260 28763 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:37.694761 28855 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:37.741982 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:37.744477 28900 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:37.738366 28585 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:37.746559 28585 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.748641 28585 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.749825 28583 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:37.700042 28593 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:37.754952 28763 raft_consensus.cc:697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:37.755854 28763 consensus_queue.cc:237] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.764701 24070 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:18:37.764618 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 62020.3us
I20260709 12:18:37.766746 23887 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.696409 28917 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:18:37.770006 28900 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.769549 23887 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.765403 28585 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:37.771859 28900 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.772549 28900 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:37.775650 23887 leader_election.cc:400] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16.
I20260709 12:18:37.778546 23887 leader_election.cc:400] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:37.778961 23887 leader_election.cc:403] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:37.784627 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:37.787284 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:37.790439 23990 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:37.784610 28802 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:18:37.791671 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:37.792383 23915 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:37.792855 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.793596 24070 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:18:37.783164 28900 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 9. Current term is 10.
I20260709 12:18:37.806169 23996 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2695) took 1315 ms. Trace:
I20260709 12:18:37.806569 23996 rpcz_store.cc:276] 0709 12:18:36.491237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.578007 (+ 86770us) service_pool.cc:224] Handling call
0709 12:18:36.578307 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.111032 (+532725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.805962 (+694930us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54002567d4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:37.806115 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223263488}
I20260709 12:18:37.809020 23917 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:37.814920 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:37.817513 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.820600 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:37.820770 28912 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:37.822028 28793 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:37.822741 28793 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:37.823401 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.824705 28793 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:37.824859 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:37.834064 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:37.835952 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:37.836280 23887 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:37.836936 24593 raft_consensus.cc:2393] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 9: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:37.840757 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.843478 24595 raft_consensus.cc:1240] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:37.843923 24592 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:37.845593 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.846442 28576 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:37.847100 28576 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:37.847661 28629 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.847867 28576 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.848436 28576 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:37.848232 28629 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.851096 28629 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.847098 24593 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:18:37.852205 28629 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.852664 28629 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.854745 28629 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:37.856324 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:37.859732 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.861163 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:37.862325 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:37.863194 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:37.863507 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.863947 23912 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:37.864586 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.864683 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.865618 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:37.865707 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.866596 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.867956 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.868351 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.869128 23920 raft_consensus.cc:1240] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:37.869458 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.869616 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.870867 24034 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.869130 23915 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:37.871840 28818 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.872018 24034 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.872637 28818 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:37.873327 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.843340 28762 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:18:37.874848 28922 log.cc:927] Time spent T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.516s	user 0.000s	sys 0.006s
I20260709 12:18:37.875787 28761 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:37.873416 28818 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:37.877647 24591 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:37.881249 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:37.881619 23961 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:37.880267 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.882656 23921 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56870 (request call id 785) took 1488 ms. Trace:
I20260709 12:18:37.884102 28556 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:37.884776 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:37.885032 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.886062 23917 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:37.886746 24598 raft_consensus.cc:1240] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:18:37.883069 23921 rpcz_store.cc:276] 0709 12:18:36.394897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.448139 (+ 53242us) service_pool.cc:224] Handling call
0709 12:18:36.448474 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:36.701987 (+253513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.702031 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:36.946048 (+244017us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b2c0001b8d8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55b372 00007f75c0c8da01 00007f75c0c5243a 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2
0709 12:18:36.963667 (+ 17619us) log.cc:844] Serialized 52 byte log entry
0709 12:18:37.239479 (+275812us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:37.239511 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.239578 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.874160 (+634582us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:37.882464 (+  8304us) raft_consensus.cc:1685] finished
0709 12:18:37.882485 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.882606 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16574,"raft.queue_time_us":33990,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"spinlock_wait_cycles":26707072,"thread_start_us":391496,"threads_started":2,"wal-append.queue_time_us":274219}
I20260709 12:18:37.882754 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:37.887844 23912 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:37.889659 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.827579 28900 consensus_queue.cc:1059] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:18:37.894898 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.898792 24591 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:37.901479 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:37.843169 28584 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:37.908819 24592 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:37.880959 28940 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.880636 28823 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:37.905398 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.896021 28855 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:37.931542 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:37.932171 24591 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:37.884783 28762 consensus_queue.cc:1059] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:18:37.899228 28329 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:37.897217 28917 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:37.934173 28916 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:37.937950 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:37.938958 24595 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:37.885329 27904 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.896091 28793 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.948464 24598 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12.
I20260709 12:18:37.884668 28556 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.955446 28556 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:37.891582 28833 consensus_queue.cc:1059] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:18:37.956584 28833 raft_consensus.cc:3055] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:37.956954 28833 raft_consensus.cc:740] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:37.910465 28783 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:37.959861 24564 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:37.938823 28818 consensus_queue.cc:1059] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:18:37.979197 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:37.980541 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:37.981573 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:37.982832 28556 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:37.983814 24598 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:37.984941 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:37.985673 24070 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:37.987072 24070 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:18:37.987414 24070 pending_rounds.cc:85] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 12
I20260709 12:18:37.987919 24070 pending_rounds.cc:107] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:18:37.988603 24070 raft_consensus.cc:2889] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:37.990882 24070 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:18:37.926873 28576 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:37.991948 28943 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:18:37.992749 28818 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:37.994632 24598 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:37.994436 28783 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.998430 24564 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:37.934252 28823 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:37.951650 28762 consensus_queue.cc:1243] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer ef0dd15ac654478b8371c22b8909240e log is divergent from this leader: its last log entry 11.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:37.926970 28584 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:37.952235 28926 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.957746 28833 consensus_queue.cc:260] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.019060 24070 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:38.015779 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:38.002524 28818 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:38.021294 28583 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:38.026685 28583 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:38.028666 28944 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:18:38.014959 28556 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:38.046159 23886 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.001348 28793 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.026144 28662 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:38.060015 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.060628 24070 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:38.059125 28662 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:38.065194 28662 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:38.023406 28926 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.055317 28802 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:38.074224 23960 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.057806 28556 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:38.075320 27904 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:38.097056 27904 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:38.075958 28791 raft_consensus.cc:3055] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:38.084596 28662 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:38.086486 28951 log.cc:927] Time spent T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
I20260709 12:18:38.087846 28783 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:38.090108 28555 raft_consensus.cc:3055] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:38.119199 28555 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
W20260709 12:18:38.095407 23992 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37418 (request call id 2374) took 1754 ms (client timeout 1709 ms). Trace:
W20260709 12:18:38.122589 23992 rpcz_store.cc:269] 0709 12:18:36.340597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.344357 (+  3760us) service_pool.cc:224] Handling call
0709 12:18:38.074152 (+1729795us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b5400099a54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:38.095322 (+ 21170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929952640}
I20260709 12:18:38.051080 28900 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:18:38.064143 28833 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:38.107391 24062 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57842 (request call id 2402) took 2672 ms (client timeout 3299 ms). Trace:
W20260709 12:18:38.129009 24062 rpcz_store.cc:269] 0709 12:18:35.435248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.657998 (+222750us) service_pool.cc:224] Handling call
0709 12:18:38.107137 (+2449139us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b540004bd54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:38.107315 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":836576128}
I20260709 12:18:38.125943 27904 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.111457 24063 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:18:38.115867 28920 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.758s	user 0.004s	sys 0.000s
I20260709 12:18:38.116956 28662 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:38.117362 28351 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.106705 28910 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:38.118803 28576 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:38.106877 28791 raft_consensus.cc:740] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:38.113904 28802 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:38.120036 28555 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.143678 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.147889 23920 raft_consensus.cc:1240] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:38.067852 28818 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.209756 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.210315 28818 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:38.209759 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:38.211401 24067 raft_consensus.cc:2376] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 12. Re-sending same reply.
I20260709 12:18:38.142067 28351 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.154259 28823 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:38.155983 28885 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.212206 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.213376 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.213681 28351 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:38.214027 24064 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:18:38.214155 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:38.214493 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.214913 24067 raft_consensus.cc:2393] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:38.215579 28585 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13.
I20260709 12:18:38.157390 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.217213 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.218218 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:38.218744 23920 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:38.218492 28556 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.221693 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.222913 28791 consensus_queue.cc:260] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.224119 28791 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:38.146237 28802 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.226820 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:38.227782 24066 raft_consensus.cc:2368] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 15. Current term is 16.
I20260709 12:18:38.228591 28583 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:38.229317 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.229861 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.230966 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:38.231491 23919 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:38.235386 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.236477 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.237499 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.238530 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.238626 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.242487 28854 raft_consensus.cc:3055] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:38.243024 28555 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:38.158114 28732 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:38.158679 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.244001 28584 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:38.244817 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 86205.2us
I20260709 12:18:38.161418 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.243034 28854 raft_consensus.cc:740] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:38.247115 23915 raft_consensus.cc:1240] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:38.247169 28854 consensus_queue.cc:260] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.248286 23915 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:38.248535 28854 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:38.249270 23915 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:38.249301 28739 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:38.156659 28817 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:38.162015 28919 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.874s	user 0.002s	sys 0.004s
W20260709 12:18:38.185537 28918 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.827s	user 0.000s	sys 0.004s
I20260709 12:18:38.253432 23912 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:38.141965 28910 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.165637 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:38.191409 23960 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:38.255661 28910 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:38.190289 28480 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:38.192788 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.197515 28929 consensus_queue.cc:1059] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:38.257957 28928 consensus_queue.cc:1059] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:38.200186 28900 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:38.258956 28928 raft_consensus.cc:3055] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:38.258795 28900 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.259342 28928 raft_consensus.cc:740] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:38.193657 28764 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:38.212219 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:38.204293 28926 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:38.269593 23915 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:38.266974 23912 raft_consensus.cc:1240] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:38.263197 24591 raft_consensus.cc:1240] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:18:38.288260 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 85541.3us
I20260709 12:18:38.265195 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.275031 24036 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.269472 23993 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:38.268103 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:38.293506 23918 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:38.293807 23915 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:38.263945 24600 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:38.266656 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:38.295114 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.295250 24596 raft_consensus.cc:1813] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Handling vote request from an unknown peer a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.264850 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.151959 24070 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:18:38.297777 24070 pending_rounds.cc:85] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 9
I20260709 12:18:38.298034 24070 pending_rounds.cc:107] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:18:38.298305 24070 raft_consensus.cc:2889] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:38.266788 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:38.274322 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.300076 24597 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:38.301134 24596 raft_consensus.cc:2393] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
W20260709 12:18:38.301589 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 249532us
I20260709 12:18:38.293962 24593 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:38.305538 24566 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.306241 23990 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:38.308338 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:38.309860 24593 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:38.310253 24593 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:38.313840 23919 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
I20260709 12:18:38.314498 23914 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:38.315501 23916 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:38.316545 23996 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:38.317392 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.318951 24063 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 15: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:38.319161 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:38.261453 28900 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:38.327721 24597 raft_consensus.cc:2468] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:38.329049 23920 raft_consensus.cc:2468] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:38.330163 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:38.333031 24061 raft_consensus.cc:2393] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:38.330205 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.311091 28662 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.297633 28886 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:38.335430 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:38.213752 28885 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:38.336951 23912 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:38.314339 24593 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.344060 24593 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:38.229893 28802 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:38.342768 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 151503us
I20260709 12:18:38.345738 24566 leader_election.cc:400] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 15. Current term is 16.
I20260709 12:18:38.346033 24566 leader_election.cc:403] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 12:18:38.358560 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.330926 28739 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:38.261966 28928 consensus_queue.cc:260] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.335507 28662 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.378844 28955 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.379379 28955 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.380515 28662 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:38.381098 28662 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 15. Current term is 16.
I20260709 12:18:38.381395 28955 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:38.344328 28831 consensus_queue.cc:1175] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" responder_term: 12 status { last_received { term: 12 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 12 index: 10 } }
I20260709 12:18:38.383342 28480 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:38.344476 28584 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
W20260709 12:18:38.386005 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 93288.1us
I20260709 12:18:38.389684 24062 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:18:38.391896 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:38.392860 28949 log.cc:927] Time spent T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.245s	user 0.000s	sys 0.000s
I20260709 12:18:38.392988 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.381983 28955 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:38.394886 23990 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:38.397047 24069 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:18:38.397431 24069 pending_rounds.cc:85] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 6
I20260709 12:18:38.397642 24069 pending_rounds.cc:107] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:18:38.397866 24069 raft_consensus.cc:2889] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:38.399228 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 53043.9us
I20260709 12:18:38.399683 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57828 (request call id 2430) took 2339 ms. Trace:
I20260709 12:18:38.400040 24069 rpcz_store.cc:276] 0709 12:18:36.060464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.927442 (+866978us) service_pool.cc:224] Handling call
0709 12:18:36.927761 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.398250 (+1470489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.399494 (+  1244us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000d1954. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:38.399631 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3378180352}
I20260709 12:18:38.400506 23960 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:38.384522 28929 raft_consensus.cc:3055] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:38.401799 28929 raft_consensus.cc:740] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:38.402655 28764 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:38.402558 28929 consensus_queue.cc:260] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.402269 23960 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.403746 28929 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:38.403898 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:38.405646 28813 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:38.305298 28908 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 12:18:38.342188 28599 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:18:38.405025 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.311470 28783 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.408638 28783 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.412604 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:38.412873 23960 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.428303 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:38.430339 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:38.434162 24591 raft_consensus.cc:1240] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 12:18:38.451735 24593 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:38.455662 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:38.339473 28860 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:38.450930 28795 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:38.463500 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.459511 28793 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:38.466538 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.471146 24597 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:38.472065 23961 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:38.306622 28855 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:18:38.488885 28599 consensus_queue.cc:1059] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:38.483191 28908 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:38.490025 28599 raft_consensus.cc:3055] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:18:38.493582 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 162401us
I20260709 12:18:38.500785 23988 raft_consensus.cc:2468] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:38.520431 28793 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.521196 28793 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.525185 28793 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:38.483969 28704 consensus_queue.cc:1175] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "71a48f59ff764d249519c6a53ec57f02" responder_term: 14 status { last_received { term: 14 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 14 index: 10 } }
W20260709 12:18:38.529933 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 52430.5us
I20260709 12:18:38.534447 28583 consensus_queue.cc:1059] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:38.536106 28583 consensus_queue.cc:1059] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:38.536311 28910 raft_consensus.cc:3055] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:38.536854 28910 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:38.540150 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 217680us
W20260709 12:18:38.544265 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 212663us
I20260709 12:18:38.491027 28599 raft_consensus.cc:740] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:38.547595 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.554337 23912 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:38.548226 23994 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:38.548938 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.549595 23920 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:18:38.556046 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 60994.1us
I20260709 12:18:38.551354 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:38.552814 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:38.557350 23916 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:38.550974 23960 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.528568 28739 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:18:38.537853 28910 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.529538 28900 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:18:38.539255 28795 consensus_queue.cc:1059] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:18:38.566833 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.571460 28817 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:38.571849 28817 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.572201 28817 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:38.575133 23990 raft_consensus.cc:1240] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:18:38.575762 24035 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.576901 28791 raft_consensus.cc:2804] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:38.577376 28791 raft_consensus.cc:697] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:38.560173 28940 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:18:38.578154 28791 consensus_queue.cc:237] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.564946 28599 consensus_queue.cc:260] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.567261 28913 consensus_queue.cc:1059] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:38.568063 28739 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:38.569720 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.592581 24066 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:38.570432 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.547817 28783 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:38.562353 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 221183us
I20260709 12:18:38.594653 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:38.599114 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 296880us
I20260709 12:18:38.600137 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.604116 24566 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.599776 23886 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:38.552884 28593 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:18:38.554498 28764 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:18:38.597304 28824 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:38.598556 28823 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:38.608049 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.588224 28704 consensus_queue.cc:1059] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
W20260709 12:18:38.633582 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.604698 28783 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:38.592335 28739 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:38.608952 28599 raft_consensus.cc:3060] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:38.632701 23885 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.588305 28686 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:18:38.660066 23921 raft_consensus.cc:1240] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:38.623366 28915 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:38.656926 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 382682us
I20260709 12:18:38.610085 28818 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.606467 28860 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:38.662700 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.612547 28865 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:38.655086 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 47277.9us
I20260709 12:18:38.655366 28762 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:38.611696 28556 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:38.665377 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.627101 28913 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.694945 23962 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:38.684219 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.658226 28831 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:38.620664 28936 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.611238 28910 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:38.627326 28824 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:38.656635 28813 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:18:38.688997 28762 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.664332 28823 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:38.701498 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:38.703696 28913 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.696996 28480 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:38.706120 28754 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:38.731810 28754 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:38.732489 28823 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.732753 28754 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.733856 28754 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:38.707810 28824 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:38.703429 28860 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:38.736655 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.688745 28865 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.746309 24566 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.747481 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.748514 24566 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:38.750456 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.716295 28795 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:38.717008 28762 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:38.686031 28915 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.690791 28818 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.703852 28833 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:18:38.705327 28583 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:18:38.705050 28936 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.728524 28603 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:18:38.749989 28783 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:38.755347 28556 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:38.773859 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.739923 28969 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:38.779053 28969 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:38.779501 28969 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:38.755978 28795 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:38.752357 28662 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:38.757731 28793 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:38.782707 28962 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:18:38.765530 28600 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:38.804847 28972 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:38.796495 28913 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:38.820266 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.821714 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.808552 28915 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:38.810065 28865 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:38.729270 28739 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.853477 28739 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:38.859346 28818 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:38.865513 28974 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:18:38.871820 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 208220us
I20260709 12:18:38.872845 23886 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.874975 28585 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:38.876466 28585 raft_consensus.cc:2764] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:18:38.876786 28802 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:38.878048 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 1138) took 1047 ms. Trace:
I20260709 12:18:38.798727 28795 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:38.878443 24599 rpcz_store.cc:276] 0709 12:18:37.830798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.833150 (+  2352us) service_pool.cc:224] Handling call
0709 12:18:37.838204 (+  5054us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:37.902219 (+ 64015us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:37.902270 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:37.902813 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:18:38.240233 (+337420us) spinlock_profiling.cc:243] Waited 2.46 ms on lock 0x7b180019b4c0. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:18:38.508889 (+268656us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:38.508927 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.508988 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.877749 (+368761us) raft_consensus.cc:1685] finished
0709 12:18:38.877771 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.877983 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62227,"raft.queue_time_us":62525,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":21336,"spinlock_wait_cycles":5664000,"thread_start_us":268481,"threads_started":1,"wal-append.queue_time_us":709775}
W20260709 12:18:38.880673 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 215343us
I20260709 12:18:38.882992 23887 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:38.875190 28940 raft_consensus.cc:3055] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:38.893607 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:38.894587 24591 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 15: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:38.886885 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.773795 28936 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:38.899462 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 151000us
I20260709 12:18:38.912247 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:38.913218 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.891716 28940 raft_consensus.cc:740] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:38.923960 28555 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:18:38.923795 28955 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:18:38.920890 28963 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:38.934553 28971 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:38.935177 28971 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:38.935765 28964 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:38.936060 28971 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:38.947223 24566 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.949776 28351 raft_consensus.cc:3055] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:38.950192 28351 raft_consensus.cc:740] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:38.950982 28351 consensus_queue.cc:260] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:38.924021 24564 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:38.953867 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.953670 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.955994 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:38.957211 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.957791 24064 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
W20260709 12:18:38.962759 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.966463 23987 raft_consensus.cc:2410] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:18:38.952054 28351 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:38.985525 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.986470 24068 raft_consensus.cc:2410] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:18:38.994527 24068 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:38.996037 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:38.996838 24064 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
I20260709 12:18:38.955153 28783 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:38.961046 28556 raft_consensus.cc:2804] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:38.982038 28798 raft_consensus.cc:2804] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:18:39.016568 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 252313us
W20260709 12:18:39.022403 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 123602us
I20260709 12:18:39.023351 23886 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:39.016144 28865 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.031172 24068 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:39.033785 24063 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:39.024184 28798 raft_consensus.cc:697] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:39.045081 28770 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:39.034610 28955 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:39.039259 28913 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.050757 28913 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.051404 23995 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 2392) took 1168 ms. Trace:
I20260709 12:18:39.051905 23995 rpcz_store.cc:276] 0709 12:18:37.883364 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.883604 (+   240us) service_pool.cc:224] Handling call
0709 12:18:37.885077 (+  1473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.025839 (+140762us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:18:38.450714 (+424875us) log.cc:844] Serialized 14 byte log entry
0709 12:18:38.764779 (+314065us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:38.764987 (+   208us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:38.765196 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.051100 (+285904us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400066dd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:39.051169 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.051342 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10519,"prepare.queue_time_us":58892,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":11410,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":3886,"spinlock_wait_cycles":323249920,"thread_start_us":702156,"threads_started":2,"wal-append.queue_time_us":459457}
I20260709 12:18:39.055657 28928 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:39.067664 28823 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:39.068502 28967 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:39.074478 24566 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:39.075724 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.075752 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:39.076509 24591 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:39.077409 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:39.078002 24593 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:39.079130 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:39.082444 24035 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:39.007501 28817 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.093264 24035 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.093659 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.103397 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.107118 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.111418 28824 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.115785 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.151820 24064 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:18:39.152108 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.020632 28940 consensus_queue.cc:260] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.098721 28821 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:39.101574 28686 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:39.098966 28983 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:39.108357 28831 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:39.108139 28957 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.043303 28865 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.062258 28795 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.101714 28860 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:18:39.076752 28969 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.100400 28762 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.190071 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:39.190371 24035 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.163043 28686 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.163196 28983 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.168407 28940 raft_consensus.cc:3060] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:39.230222 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:39.230882 23912 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:18:39.167088 28831 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:39.209297 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.168762 28770 consensus_queue.cc:1175] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0829ddf18f07439086398756b9c6d216" responder_term: 13 status { last_received { term: 12 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:39.198091 28994 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:39.224326 28762 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.225553 23914 raft_consensus.cc:1240] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:39.183081 28957 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.254930 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:39.255529 24064 raft_consensus.cc:3060] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:39.256672 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:39.226739 23913 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:18:39.258544 23913 pending_rounds.cc:85] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Aborting all ops after (but not including) 5
I20260709 12:18:39.258853 23913 pending_rounds.cc:107] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:18:39.259133 23913 raft_consensus.cc:2889] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.196099 28686 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:39.227387 28913 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:39.231724 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:39.266362 23921 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:18:39.266778 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:39.198200 28983 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:39.234844 23920 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:39.217725 24599 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:39.167972 28971 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:39.205155 28817 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.242300 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:39.245122 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:39.251180 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:39.251585 23995 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:18:39.285125 23995 pending_rounds.cc:85] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 9
I20260709 12:18:39.285454 23995 pending_rounds.cc:107] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:18:39.285729 23995 raft_consensus.cc:2889] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.217526 28969 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:39.204840 28824 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.199738 28865 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:39.243685 28831 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:39.201009 28795 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:39.241755 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.306568 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.286198 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.291342 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
W20260709 12:18:39.292574 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 62280.4us
I20260709 12:18:39.255152 28915 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:39.308795 28831 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.245889 28556 raft_consensus.cc:697] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:39.310678 28556 consensus_queue.cc:237] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.311455 28831 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:39.312325 28957 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:39.313776 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 70379.2us
I20260709 12:18:39.193689 28798 consensus_queue.cc:237] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.321967 23962 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:39.322748 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:39.323057 24595 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:39.326923 23995 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:39.328344 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 177696us
I20260709 12:18:39.283094 28913 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.337910 24064 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:39.319900 28704 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:39.339226 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:39.321115 28943 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:18:39.316730 28761 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:39.320751 28817 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:39.326340 28928 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:39.355659 28764 consensus_queue.cc:1059] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.009s
I20260709 12:18:39.364645 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:39.366783 28955 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:39.366801 24596 raft_consensus.cc:1275] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:39.356644 28824 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.370565 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:39.371578 28802 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.372426 28791 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:39.425776 23960 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:39.373196 28600 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:39.375706 23962 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:39.339594 28913 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:39.378979 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 49480.2us
W20260709 12:18:39.379948 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.401813 24035 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.330047 28593 consensus_queue.cc:1059] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:18:39.339877 28704 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.469570 24564 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:39.470471 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 44816.9us
I20260709 12:18:39.480073 23960 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:39.483089 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:39.490564 27904 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:39.357924 28761 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.496279 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.398423 28928 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.490084 28823 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:18:39.514772 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 139161us
I20260709 12:18:39.478143 28793 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:39.403674 28824 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.397269 28831 consensus_queue.cc:1059] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 12:18:39.395375 28817 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.431934 28802 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.547379 23912 raft_consensus.cc:2468] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:39.497579 23818 catalog_manager.cc:5697] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 8, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 8 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:39.498458 28600 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:39.498844 28955 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:39.563364 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 161613us
I20260709 12:18:39.515162 28885 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:39.515362 28991 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.575188 24592 raft_consensus.cc:1240] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:39.521677 28763 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.521693 28926 raft_consensus.cc:2804] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:39.481159 28996 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:18:39.514451 28823 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:18:39.570987 28988 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:18:39.571899 28854 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:39.589107 29006 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:18:39.596154 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 99952.4us
I20260709 12:18:39.641151 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.643150 23914 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:18:39.578497 28865 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:39.647505 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.649328 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.648519 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.592271 28793 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:39.641695 28995 log.cc:927] Time spent T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:18:39.591678 28823 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:39.595439 28924 raft_consensus.cc:3055] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:39.665346 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:39.641875 29008 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 12:18:39.673219 24598 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:39.683981 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:39.684847 23919 raft_consensus.cc:1240] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:39.580235 28955 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.689971 24034 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.701947 28704 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.582973 28991 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.704151 24564 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.642189 28770 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:39.685166 28793 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.710069 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.592792 28885 consensus_queue.cc:1048] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:18:39.586314 28763 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:39.737507 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 161635us
I20260709 12:18:39.665601 28926 raft_consensus.cc:697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:39.665813 28957 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:39.709723 29012 log.cc:927] Time spent T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:18:39.686041 28924 raft_consensus.cc:740] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:39.743090 23913 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:39.721166 28798 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:39.703390 29013 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:39.721385 29007 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.721375 28704 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.686113 28865 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.758961 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:39.759244 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:39.737198 28770 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.736146 29001 consensus_queue.cc:1059] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:18:39.721441 28996 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:18:39.753517 28957 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.753158 28420 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:18:39.782498 28926 consensus_queue.cc:237] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:39.764060 29005 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:18:39.809232 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.826522 28855 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:39.830847 28855 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.762403 29013 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.790830 29022 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:39.835202 29022 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.836920 29022 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:39.788831 28865 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.783198 28991 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:39.786175 28686 consensus_meta.cc:287] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.502s	user 0.005s	sys 0.005s
I20260709 12:18:39.788188 28817 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.838526 28686 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.786432 28854 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.840993 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.814680 28662 raft_consensus.cc:3055] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:39.783376 28761 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:39.800067 29009 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.226s	user 0.000s	sys 0.000s
I20260709 12:18:39.788466 28928 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:39.783515 29016 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 12:18:39.800488 29004 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
W20260709 12:18:39.803622 28997 log.cc:927] Time spent T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:18:39.818614 28824 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:39.780079 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 90193.4us
I20260709 12:18:39.825115 28913 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.763475 29020 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:39.825626 28924 consensus_queue.cc:260] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.841096 28854 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.841830 28662 raft_consensus.cc:740] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:39.859766 28854 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.860277 28662 consensus_queue.cc:260] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.787781 28955 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:39.861356 28662 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:39.841807 28686 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.866356 29001 raft_consensus.cc:3055] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:39.807632 28763 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:39.866849 29001 raft_consensus.cc:740] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:39.846477 23990 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37420 (request call id 2730) took 1260 ms. Trace:
I20260709 12:18:39.848788 29013 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:39.850291 24034 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:39.763592 29007 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.872630 29007 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.873366 23918 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 15: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:39.779892 28704 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.853792 23919 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:18:39.877557 28704 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:39.849534 24070 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:18:39.846057 24033 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.790222 28793 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:39.878811 28998 log.cc:927] Time spent T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.539s	user 0.000s	sys 0.005s
I20260709 12:18:39.880963 28802 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:39.882424 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:39.882740 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:39.883268 23993 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:39.888530 28965 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.889114 28965 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.889564 24599 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 1028) took 1003 ms. Trace:
I20260709 12:18:39.890038 24599 rpcz_store.cc:276] 0709 12:18:38.885749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.889458 (+  3709us) service_pool.cc:224] Handling call
0709 12:18:38.889762 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:39.275431 (+385669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.889304 (+613873us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400483d54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:39.889494 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":753746176}
I20260709 12:18:39.892639 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:39.894984 23919 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:39.896612 28762 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:39.897681 28762 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:39.868114 23990 rpcz_store.cc:276] 0709 12:18:38.586559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.587033 (+   474us) service_pool.cc:224] Handling call
0709 12:18:38.601909 (+ 14876us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:38.607662 (+  5753us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:38.944148 (+336486us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b1800351a00. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdadfc0a 00007f75c721f219 00007f75bdb67a40 00007f75bdb624e4 00007f75bdb62455 00007f75c464a3c7 00007f75c0c5c9a7 00007f75c0c6c0bf 00007f75c0c6c038
0709 12:18:38.944450 (+   302us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.313842 (+369392us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.314305 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:18:39.314432 (+   127us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:39.314463 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.314542 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.846111 (+531569us) raft_consensus.cc:1685] finished
0709 12:18:39.846228 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.846401 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99807,"prepare.queue_time_us":339468,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":68103,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":9193,"spinlock_wait_cycles":10267520,"thread_start_us":309468,"threads_started":1,"wal-append.queue_time_us":594373}
I20260709 12:18:39.898015 28762 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:39.898936 28762 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.857054 28924 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:39.900115 28762 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:39.906983 28855 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:39.844189 28957 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.798089 28593 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:39.909518 28593 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.912855 28770 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:39.914836 28593 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:39.752981 28754 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.164s
I20260709 12:18:39.916507 28965 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:39.907840 23920 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:39.908048 28967 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:39.919582 28967 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.922242 28967 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:39.919152 28983 consensus_meta.cc:287] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.001s
W20260709 12:18:39.849548 28940 consensus_meta.cc:287] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
W20260709 12:18:39.935611 28993 log.cc:927] Time spent T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.411s	user 0.003s	sys 0.000s
I20260709 12:18:39.935487 28823 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:39.947836 23887 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:39.950678 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.954353 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:39.954770 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 267957us
I20260709 12:18:39.926455 28983 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:39.955112 23917 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:39.957491 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:39.959558 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 109347us
I20260709 12:18:39.954470 24062 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2462) took 1245 ms. Trace:
I20260709 12:18:39.975760 24062 rpcz_store.cc:276] 0709 12:18:38.709419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.714068 (+  4649us) service_pool.cc:224] Handling call
0709 12:18:38.736574 (+ 22506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:38.737002 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:18:38.903657 (+166655us) log.cc:844] Serialized 14 byte log entry
0709 12:18:39.349685 (+446028us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.391551 (+ 41866us) log.cc:844] Serialized 26 byte log entry
0709 12:18:39.391722 (+   171us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:39.391770 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.391880 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:39.935021 (+543141us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:39.954173 (+ 19152us) raft_consensus.cc:1685] finished
0709 12:18:39.954256 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:39.954391 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26217,"prepare.queue_time_us":287282,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5552,"raft.queue_time_us":32683,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":35195,"spinlock_wait_cycles":26931072,"thread_start_us":555654,"threads_started":2,"wal-append.queue_time_us":570136}
I20260709 12:18:39.983348 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:39.990824 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:39.989508 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:39.986613 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:39.991941 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:39.992417 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:39.993036 24067 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:39.994642 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:39.995330 24067 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:39.996913 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:39.997852 24067 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:39.999256 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.001633 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.005385 24067 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:40.007226 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:40.008123 24067 raft_consensus.cc:2393] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 14: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:39.992268 23987 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:40.015080 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:40.015717 23916 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:40.020358 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:40.024353 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.025928 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:40.028908 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.031136 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.037056 24598 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:40.039005 24594 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:18:40.042169 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.043074 24596 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 15.
I20260709 12:18:39.868693 29001 consensus_queue.cc:260] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.050453 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.057521 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:40.022184 28763 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:40.060767 24566 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.023s
W20260709 12:18:40.061175 24566 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.003s	sys 0.023s
W20260709 12:18:40.059185 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 111465us
I20260709 12:18:40.053622 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.063302 23960 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:40.064639 24599 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:40.062170 29026 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:18:40.067348 28833 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:40.067772 28833 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.068154 28833 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.068434 28823 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.067796 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:40.070870 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 92123.6us
I20260709 12:18:39.972962 29027 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:18:40.071838 24034 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:40.075745 28915 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.076225 28915 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.078439 28833 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.080638 28833 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.081418 29001 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.082305 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:40.083359 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:40.083704 29032 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:40.084074 29010 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:40.084527 29032 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:40.084880 29032 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.085229 29032 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:40.087750 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:40.078239 28915 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:40.088496 28900 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:40.088857 28900 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.089198 28900 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:40.088867 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.093571 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:40.094192 24066 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
I20260709 12:18:40.096264 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.097054 23987 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:18:40.097669 27904 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:40.098066 27904 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.098413 27904 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.104478 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:40.110143 24064 raft_consensus.cc:3060] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:40.111931 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:40.112538 24066 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
W20260709 12:18:40.057933 28989 log.cc:927] Time spent T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:18:40.063879 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:40.123764 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.117707 23987 raft_consensus.cc:1240] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting Update request from peer 71a48f59ff764d249519c6a53ec57f02 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:40.124583 24600 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:40.144380 24596 raft_consensus.cc:1240] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:40.147150 24035 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:40.151656 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.153163 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.153954 24036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.000s	sys 0.014s
I20260709 12:18:40.159512 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:40.160859 24595 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.007s	sys 0.023s
W20260709 12:18:40.225675 24595 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.007s	sys 0.031s
I20260709 12:18:40.166261 24064 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:40.222496 23987 raft_consensus.cc:1275] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:40.165426 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:40.229398 28584 raft_consensus.cc:3055] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:40.178194 24066 raft_consensus.cc:1275] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:40.233992 28584 raft_consensus.cc:740] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:40.234863 28584 consensus_queue.cc:260] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.182066 27904 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.235883 28584 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:40.239053 27904 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.242445 28770 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.242667 28686 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.243024 28770 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.243171 28686 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.243187 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:40.244139 23913 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.245076 28770 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.252555 28908 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:40.127058 28964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.008s	sys 0.005s
W20260709 12:18:40.258246 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 92930.6us
I20260709 12:18:40.101553 28763 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:40.224431 24036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.000s	sys 0.014s
W20260709 12:18:40.177013 24069 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.005s	sys 0.009s
W20260709 12:18:40.277611 24069 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.007s	sys 0.010s
I20260709 12:18:40.150183 28854 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.284006 23995 raft_consensus.cc:1240] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:40.285992 24594 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 1036) took 1182 ms. Trace:
I20260709 12:18:40.287601 24594 rpcz_store.cc:276] 0709 12:18:39.103777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.103920 (+   143us) service_pool.cc:224] Handling call
0709 12:18:39.104285 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:40.039524 (+935239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.285749 (+246225us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b540057b054. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c52e01 00007f75c0c5183e 00007f75c5c16419 00007f75bf18dbd4 00007f75bf18db62 00007f75bf18da91 00007f75bf18da0c 00007f75bf18ccc2 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:40.285934 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2148871040}
I20260709 12:18:40.223829 29033 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.275781 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:40.224850 28802 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:18:40.274330 28964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.010s	sys 0.005s
I20260709 12:18:40.151767 28996 raft_consensus.cc:476] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 12:18:40.306628 28854 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.307715 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.184320 28967 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.156822 29025 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:40.312662 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.245112 28686 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.179085 29007 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:40.183265 28576 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.315845 29033 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.258226 29010 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.253495 28908 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.279212 28860 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:40.278656 28818 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.263080 28770 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.315559 28802 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.317353 28969 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.322801 28928 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:40.317106 28821 consensus_queue.cc:1048] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:18:40.317552 28783 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:18:40.496531 28854 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.369517 28770 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:40.207358 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 143520us
W20260709 12:18:40.433131 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 143011us
W20260709 12:18:40.502679 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.439812 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.504233 23990 raft_consensus.cc:2393] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:40.441188 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.506251 23989 raft_consensus.cc:2393] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 15: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:40.441373 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.508189 23991 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
W20260709 12:18:40.442556 23884 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.511796 28908 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.443708 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.446492 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.450114 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.451416 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.449586 23913 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
W20260709 12:18:40.469094 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 153298us
I20260709 12:18:40.318622 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:40.481864 24591 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37694 (request call id 1160) took 1305 ms. Trace:
I20260709 12:18:40.483076 24069 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 987) took 1087 ms. Trace:
I20260709 12:18:40.489989 28763 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.318018 28662 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:40.334633 28967 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.554811 28662 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:40.555509 28662 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.556995 28967 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:40.359987 28983 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.559952 23996 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:40.367674 29010 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.331168 29025 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.562572 23995 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:40.562755 29025 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:40.389272 29032 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.388533 29033 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.368391 28802 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:40.369974 28969 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.340911 28576 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.163825 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:40.514788 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:40.442484 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.569340 28739 consensus_queue.cc:1059] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:40.544050 28821 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:40.544946 23993 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:18:40.369009 28818 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:40.553831 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 235551us
I20260709 12:18:40.533847 24069 rpcz_store.cc:276] 0709 12:18:39.395550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.396097 (+   547us) service_pool.cc:224] Handling call
0709 12:18:39.432853 (+ 36756us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:39.433322 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.433366 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:39.465064 (+ 31698us) log.cc:844] Serialized 52 byte log entry
0709 12:18:40.281016 (+815952us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:18:40.308998 (+ 27982us) log.cc:844] Serialized 14 byte log entry
0709 12:18:40.318608 (+  9610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.318709 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.469918 (+151209us) raft_consensus.cc:1685] finished
0709 12:18:40.469962 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.482822 (+ 12860us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9308,"prepare.queue_time_us":28260,"prepare.run_wall_time_us":1689,"raft.queue_time_us":74758,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":27773,"spinlock_wait_cycles":5012864,"thread_start_us":783135,"threads_started":1,"wal-append.queue_time_us":832660}
I20260709 12:18:40.587572 28913 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.587939 28940 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.588555 28913 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.588835 28940 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:40.570112 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 55728.1us
I20260709 12:18:40.542518 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:40.568513 24036 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:40.614956 28739 raft_consensus.cc:3055] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:40.619757 28965 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:40.619846 28739 raft_consensus.cc:740] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:40.625743 29033 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.626514 29033 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.629673 29033 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:40.621778 28739 consensus_queue.cc:260] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.649735 28969 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:40.650723 24564 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.651122 28576 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.654903 29032 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.666743 29010 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.675661 28913 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.676334 28704 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.676980 28704 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.679194 28704 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.682365 28885 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:40.685060 29044 log.cc:927] Time spent T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.314s	user 0.004s	sys 0.001s
I20260709 12:18:40.687518 28739 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.694954 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:40.695678 23913 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:40.698091 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:40.698868 23921 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:40.532953 24591 rpcz_store.cc:276] 0709 12:18:39.175945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.177974 (+  2029us) service_pool.cc:224] Handling call
0709 12:18:39.178345 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:39.183841 (+  5496us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.183889 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:39.189440 (+  5551us) log.cc:844] Serialized 52 byte log entry
0709 12:18:39.741996 (+552556us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b1800477580. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:18:40.213707 (+471711us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:40.213766 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.213863 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.481070 (+267207us) raft_consensus.cc:1685] finished
0709 12:18:40.481115 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.481590 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5024,"raft.queue_time_us":5197,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":7067,"spinlock_wait_cycles":14507904,"thread_start_us":471478,"threads_started":1,"wal-append.queue_time_us":1090326}
I20260709 12:18:40.723764 28593 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:40.725170 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 191888us
I20260709 12:18:40.714480 28908 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.730374 28908 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.415937 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:40.734908 24563 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.736011 29054 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.224s	user 0.003s	sys 0.000s
I20260709 12:18:40.737944 28940 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.739790 28818 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:40.740260 29052 log.cc:927] Time spent T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:18:40.706233 28969 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.722190 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:40.743208 28967 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:40.754494 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44583us
I20260709 12:18:40.719841 28770 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.753599 23988 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37418 (request call id 2406) took 1087 ms. Trace:
I20260709 12:18:40.760751 28928 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.761555 28928 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.764047 28928 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:40.756762 28996 raft_consensus.cc:2764] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:18:40.753721 28821 consensus_queue.cc:1048] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260709 12:18:40.782598 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 214291us
I20260709 12:18:40.768407 28908 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:40.777129 29055 log.cc:927] Time spent T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.192s	user 0.000s	sys 0.002s
I20260709 12:18:40.756201 23988 rpcz_store.cc:276] 0709 12:18:39.662225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.662411 (+   186us) service_pool.cc:224] Handling call
0709 12:18:39.662759 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:39.703056 (+ 40297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.703087 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.709892 (+  6805us) log.cc:844] Serialized 26 byte log entry
0709 12:18:40.100293 (+390401us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x7b180002e660. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb47e07 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb64c02 00007f75c07ec20b 00007f75c07f1d23 00007f75c07f20d1 00007f75c0c0da0f
0709 12:18:40.439476 (+339183us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:18:40.440023 (+   547us) log.cc:844] Serialized 14 byte log entry
0709 12:18:40.440364 (+   341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.440511 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.739369 (+298858us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b4400022b4c. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bda8bc85 00007f75bda8c6a2 00007f75c07fe1db 00007f75c07f9aaf 00007f75c07ed86e 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221 00007f75c07f61d9 00007f75c07f6169
0709 12:18:40.744697 (+  5328us) raft_consensus.cc:1685] finished
0709 12:18:40.744726 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:40.749064 (+  4338us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82650,"prepare.queue_time_us":72597,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":109605,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":28357,"spinlock_wait_cycles":218082816,"thread_start_us":338738,"threads_started":1,"wal-append.queue_time_us":836758}
I20260709 12:18:40.758430 28576 consensus_queue.cc:1059] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 12:18:40.796591 23805 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 10cd478aa7e9411bba254e94713f91de with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 71a48f59ff764d249519c6a53ec57f02 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:40.801477 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.768332 28967 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.765817 28969 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.813365 28348 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.814146 28348 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.814917 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.816630 28348 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:40.817533 24036 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:40.821064 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:40.829533 24069 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:18:40.793712 29025 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.792570 28908 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.821982 23960 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:40.838587 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:40.839550 24065 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:40.842240 28823 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:40.842641 23960 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:40.842856 28823 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:40.842732 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:40.844250 28823 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.850855 28763 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:40.854430 28763 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.855019 28763 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:40.854476 23960 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:40.857071 28833 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:40.857463 28833 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.857862 28833 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:40.858732 29049 log.cc:927] Time spent T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.307s	user 0.001s	sys 0.002s
I20260709 12:18:40.862353 24036 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:40.866003 29048 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.322s	user 0.000s	sys 0.003s
I20260709 12:18:40.860823 28802 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.867581 29025 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:40.868119 29036 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:40.878293 29036 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.878811 29036 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:40.878787 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:40.879730 23919 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
W20260709 12:18:40.871057 28900 consensus_meta.cc:287] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 0.781s	user 0.004s	sys 0.015s
I20260709 12:18:40.914693 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.913069 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:40.925348 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.932798 23918 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 15: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:40.933642 28969 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.883494 28833 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:40.938122 28833 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.903720 28662 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.938764 28833 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:40.939112 24067 raft_consensus.cc:1240] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:18:40.939172 28833 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:40.939729 28833 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:40.940450 28662 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.940543 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:40.941330 24063 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:40.946372 28928 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:40.946959 28928 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:40.947495 28928 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:40.948583 28924 consensus_meta.cc:287] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 1.048s	user 0.010s	sys 0.010s
I20260709 12:18:40.960186 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:40.962810 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:40.963716 24061 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:40.876904 28908 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.968091 28908 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:40.983729 28802 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:40.909045 28900 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:40.990475 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.031100 28824 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:41.046403 24598 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:41.049960 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.022634 28662 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:41.063218 28967 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.063508 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.064126 24062 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
W20260709 12:18:41.065647 29056 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:18:41.060981 28802 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:41.068158 28763 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.068167 28802 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.070600 28802 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:41.071904 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 63290.1us
W20260709 12:18:41.075516 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 46859.5us
I20260709 12:18:41.079833 28886 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:18:41.080242 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 86212.1us
I20260709 12:18:41.081223 24066 raft_consensus.cc:2393] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:41.092378 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:41.092530 28886 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.093238 24597 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:41.094506 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.094820 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:41.094967 28886 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.095170 24064 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:41.096074 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.098073 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.099833 28900 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.107136 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.088274 28763 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.090783 28662 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.123981 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.124476 28662 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.110193 23961 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.156806 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.157505 23921 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
W20260709 12:18:41.167160 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 57042.9us
W20260709 12:18:41.169245 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.172905 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.173628 24065 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 16.
I20260709 12:18:41.173887 28926 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:41.174782 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.175331 24068 raft_consensus.cc:3060] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:41.178687 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.158201 28824 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.180908 29065 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:41.181411 29065 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.181797 29065 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:41.184319 28928 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.186168 28924 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.145794 29036 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:41.186517 28762 consensus_meta.cc:287] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: Time spent flushing consensus metadata: real 1.286s	user 0.013s	sys 0.008s
I20260709 12:18:41.186750 28924 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.188036 29036 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:41.188235 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.189126 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.189626 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.189998 23915 raft_consensus.cc:2410] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:18:41.190629 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.191004 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.192883 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.174523 28926 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.194830 24069 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
I20260709 12:18:41.193512 23921 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:41.155848 28802 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:41.207772 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.210983 23920 raft_consensus.cc:2368] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 15. Current term is 16.
I20260709 12:18:41.212747 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.221035 24591 raft_consensus.cc:1240] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:18:41.222568 23921 raft_consensus.cc:2393] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 15: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:41.208879 28762 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:41.209281 28928 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:41.205106 28854 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:41.207360 28802 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.237753 29072 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:41.239916 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.236063 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:41.241638 24593 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:41.234686 28739 consensus_meta.cc:287] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.005s
I20260709 12:18:41.246690 23920 raft_consensus.cc:2393] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:41.252375 24068 raft_consensus.cc:2468] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:41.254225 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.256064 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.238442 29072 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.258970 24062 raft_consensus.cc:2468] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:41.226845 28762 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.264370 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.242024 28854 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.268340 28854 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.268689 28833 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.270548 24064 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:41.262497 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.271229 24065 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:41.273439 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.273452 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.274423 24070 raft_consensus.cc:2393] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:41.276719 23920 raft_consensus.cc:2393] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 16: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:41.279392 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.280282 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.281138 24066 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:41.281657 28802 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.280260 28924 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.283361 24069 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:41.290197 23818 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:41.294947 24068 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:18:41.295972 24065 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:41.295277 24068 pending_rounds.cc:85] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting all ops after (but not including) 8
I20260709 12:18:41.296674 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.299269 23920 raft_consensus.cc:2393] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 13: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:41.298023 24068 pending_rounds.cc:107] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:18:41.303403 24068 raft_consensus.cc:2889] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:41.284488 29065 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.296149 28833 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.319267 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.317847 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.320636 23920 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:41.321453 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.322032 23919 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:41.321708 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.319891 23912 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:41.323705 28985 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:41.324275 28985 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.333863 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.334738 24066 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:41.335399 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.333839 23960 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.338518 28584 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:41.338923 28584 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.339548 28584 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.339824 29072 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.341461 28985 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.333443 28965 raft_consensus.cc:3055] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:41.344141 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.345106 28965 raft_consensus.cc:740] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:41.345336 24066 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:41.344211 24593 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 16.
I20260709 12:18:41.347920 23919 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:41.352559 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.353864 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.355511 28926 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.356244 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.357394 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.359777 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.360201 23887 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:41.360544 23913 raft_consensus.cc:2368] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:18:41.361187 28900 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:41.361433 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:41.361910 29074 log.cc:927] Time spent T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:18:41.350639 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:41.364459 24566 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:41.364732 28824 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.365826 28662 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:41.366516 28662 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.367061 28662 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:41.367815 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.368994 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.370430 28965 consensus_queue.cc:260] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.371351 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:41.371719 28965 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:41.372970 28576 consensus_queue.cc:1175] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" responder_term: 13 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 12. Current term is 13. Ops: [12.10-12.10]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:18:41.374092 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.358170 24066 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
I20260709 12:18:41.365876 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:41.384116 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.394138 23886 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:41.393885 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.366566 28860 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:41.404462 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:41.407253 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:41.405625 23918 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45120 (request call id 2992) took 1237 ms. Trace:
I20260709 12:18:41.410687 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.388537 28900 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:41.409168 23918 rpcz_store.cc:276] 0709 12:18:40.162916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.163629 (+   713us) service_pool.cc:224] Handling call
0709 12:18:41.383723 (+1220094us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540017af54. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c562fa 00007f75c5c17b17 00007f75bf1926d4 00007f75bf192662 00007f75bf192591 00007f75bf19250c 00007f75bf1917c2 00007f75bef8d48c 00007f75bef8c8c6 00007f75bef8c26f
0709 12:18:41.399822 (+ 16099us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":784137984}
I20260709 12:18:41.413203 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.413786 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:41.413959 23912 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.412549 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.417095 29065 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.422535 29007 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:41.423118 29007 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:41.424111 29007 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.413030 28900 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.438966 28348 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:41.439881 24595 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:41.440027 28348 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.441601 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:41.442067 24066 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:41.442766 28990 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:41.443517 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.444191 28990 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:41.444927 28584 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.439329 28900 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:41.405957 28762 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.455088 28584 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.457062 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.457671 24063 raft_consensus.cc:3060] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.458606 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.459236 24070 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:41.459693 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.460147 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.467573 24070 raft_consensus.cc:2393] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:41.480444 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.482121 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.483243 23996 raft_consensus.cc:2368] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14.
I20260709 12:18:41.484462 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:41.461926 23818 catalog_manager.cc:5697] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:41.489200 23920 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
I20260709 12:18:41.497081 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.497784 24065 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:41.499282 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.500510 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:41.502677 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 61199.4us
I20260709 12:18:41.502004 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.505885 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.511559 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.511811 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.512518 23921 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.513420 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.521112 28739 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.521857 28739 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.524252 23921 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:41.525839 28739 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.527326 24063 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:41.528916 23962 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:41.532611 28986 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:41.531023 24065 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
I20260709 12:18:41.533097 28986 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:41.534474 28986 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:41.534821 28969 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:41.535238 28969 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:41.535637 28969 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:41.538486 24064 raft_consensus.cc:1275] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:18:41.548864 28348 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.550486 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:41.551956 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:41.552479 28662 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.552855 28957 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:41.557471 28900 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.558086 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.559401 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:41.561712 23912 raft_consensus.cc:2468] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
W20260709 12:18:41.566771 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 200913us
I20260709 12:18:41.567456 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.568687 28662 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.573822 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.580294 24036 leader_election.cc:400] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14.
I20260709 12:18:41.509577 28824 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:41.576346 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:41.583073 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:41.578370 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:41.580981 24036 leader_election.cc:403] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:41.587453 28990 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:41.587909 28990 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:41.588304 28990 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:41.588536 28900 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.593099 23993 raft_consensus.cc:2393] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:41.601809 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.606803 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.607584 24063 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.617755 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.618520 24064 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 15: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:41.618942 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.579602 28996 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:41.624982 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:41.625829 23991 raft_consensus.cc:2368] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 16. Current term is 17.
I20260709 12:18:41.626853 23962 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.634773 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:41.636828 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.637636 24067 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.639875 23960 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.643404 24066 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:41.645210 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:41.646478 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:41.647223 23992 raft_consensus.cc:2368] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:18:41.648242 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:41.648806 24593 raft_consensus.cc:3060] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:41.616122 28348 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14.
I20260709 12:18:41.651336 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.623575 28996 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:41.645767 28662 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.641973 28739 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:41.645411 28821 raft_consensus.cc:2764] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
I20260709 12:18:41.664556 24064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.672283 23991 raft_consensus.cc:2393] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 15: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:41.672756 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.616685 28824 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:41.675992 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 97719.8us
I20260709 12:18:41.681450 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:41.682219 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:41.686614 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.687343 24065 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:41.687940 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:41.663841 28996 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:41.684733 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.690961 23994 raft_consensus.cc:2410] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:18:41.697007 23962 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.699800 24596 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:41.700354 24596 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.702857 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.705150 24063 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 16.
I20260709 12:18:41.678318 28926 consensus_queue.cc:1059] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:41.705641 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:41.708788 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.709678 23992 raft_consensus.cc:2393] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 14: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:41.716771 24065 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
W20260709 12:18:41.723346 29082 log.cc:927] Time spent T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:18:41.727945 28907 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:41.728526 28907 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:41.729368 28907 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.730036 23960 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.731853 28763 raft_consensus.cc:2804] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:41.732307 28763 raft_consensus.cc:697] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:41.733129 28763 consensus_queue.cc:237] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:41.693806 24034 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.48.1:35685 timed out after 1.510s (SENT) [suppressed 9 similar messages]
I20260709 12:18:41.736069 28420 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:41.684159 28739 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.736800 28420 raft_consensus.cc:697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:41.738350 28855 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:41.738624 28739 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.688997 28967 raft_consensus.cc:2804] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:41.746866 24036 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:41.751128 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 44027.8us
I20260709 12:18:41.752130 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.751973 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.758982 24596 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
W20260709 12:18:41.762122 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 52946.5us
I20260709 12:18:41.762424 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58aa4c7f8ec14db884253c7b025e4c26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.688373 28662 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.762820 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:41.765053 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 128971us
I20260709 12:18:41.769615 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:41.776484 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:41.776535 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.778505 23919 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:41.779544 23992 raft_consensus.cc:2393] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:41.780551 28576 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.780802 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:41.781644 28576 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:41.783799 23962 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:41.784994 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:41.785730 29065 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:41.786103 29065 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.786501 29065 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:41.786957 28823 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:41.787621 28823 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:41.787834 28662 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.789327 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.791410 24034 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:41.785743 29086 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:41.794802 29086 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.787649 28990 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.796885 29086 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.796821 29071 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:41.797595 29071 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:41.798048 29071 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:41.798496 23962 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:41.802054 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.802733 23994 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:18:41.793627 28986 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.802240 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:41.737962 28420 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.804235 23992 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:41.763665 28967 raft_consensus.cc:697] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:41.766409 28821 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:41.811822 24593 raft_consensus.cc:2468] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:18:41.817193 23919 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:41.797804 28969 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.823827 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.826261 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.827093 28662 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:41.828850 23995 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:41.821725 28926 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:41.778501 29026 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 12:18:41.830242 28662 raft_consensus.cc:493] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:41.848487 23962 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:41.837846 28584 consensus_queue.cc:1059] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:18:41.836418 28821 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:41.835985 28824 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:41.857316 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 177466us
I20260709 12:18:41.850723 28990 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.866407 28967 consensus_queue.cc:237] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.867563 28969 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:41.836182 28985 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:18:41.836114 28907 consensus_queue.cc:1048] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:18:41.857563 28662 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:41.858850 28821 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:41.878584 28821 raft_consensus.cc:3060] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:41.875054 28926 raft_consensus.cc:2804] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:41.885921 28926 raft_consensus.cc:697] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:41.885078 29071 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.887017 28926 consensus_queue.cc:237] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.888769 29071 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:41.898396 28969 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.899506 28986 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:41.901291 29094 log.cc:927] Time spent T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:18:41.904763 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.899164 28969 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.838991 28996 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:41.913359 24067 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:41.915351 29065 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:41.919950 29065 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:41.920035 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 223978us
I20260709 12:18:41.916074 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
W20260709 12:18:41.921145 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 174350us
I20260709 12:18:41.921838 24564 leader_election.cc:400] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 15. Current term is 16.
I20260709 12:18:41.922147 29036 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:41.922888 28739 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:41.921869 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 130542us
I20260709 12:18:41.928694 23919 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 16.
I20260709 12:18:41.931000 24034 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:41.931303 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.943617 23961 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:41.945281 28824 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:41.946043 24066 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:41.947484 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:41.949678 23960 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:41.953789 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.952863 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:41.954948 24036 leader_election.cc:400] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 16. Current term is 17.
I20260709 12:18:41.956717 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:41.959808 24597 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 15: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:41.960026 23919 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 15: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:41.960418 24036 leader_election.cc:403] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:18:41.963925 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:41.964763 24067 raft_consensus.cc:2393] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 15: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:41.971273 29036 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:41.966336 23961 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:41.972011 28833 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:41.980923 28907 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:42.002687 23961 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:42.005028 28584 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:42.006228 29101 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:42.007014 29101 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:41.997960 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:41.974184 28928 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 16. Current term is 17.
I20260709 12:18:42.008265 29101 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.010161 24036 leader_election.cc:400] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:18:42.010511 24036 leader_election.cc:403] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:18:42.011292 28928 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) with higher term. Message: Invalid argument: T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:18:42.008288 24067 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:18:42.012846 24036 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.014000 28928 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.016055 24036 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.016776 28928 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:42.018554 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:42.021245 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:42.028347 24066 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:42.029942 28969 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:42.024422 28907 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:42.031010 28907 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.031811 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:42.034368 29095 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:42.035249 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 196336us
W20260709 12:18:42.038483 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 107608us
I20260709 12:18:42.042309 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:42.043285 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 52159.2us
I20260709 12:18:42.044885 28969 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:42.050082 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:42.050892 24063 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:42.051553 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:42.051023 29095 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.075278 29095 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:42.076053 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:42.076412 24595 raft_consensus.cc:1240] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:42.076964 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:42.077663 24061 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:18:42.079885 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:42.080981 24066 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:42.085095 28821 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:42.094540 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 48629.5us
I20260709 12:18:42.095364 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:42.097576 28686 raft_consensus.cc:2764] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:18:42.097878 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.099993 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:42.101691 28348 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.103243 24061 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
I20260709 12:18:42.105985 29095 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:42.108412 28348 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.108398 23887 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.109125 28348 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:42.111110 28348 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:42.112278 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:42.112805 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:42.114832 24063 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
I20260709 12:18:42.096841 24566 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:42.104841 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.129662 23887 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.132349 23887 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.136960 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:42.141119 23887 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:42.149744 24069 raft_consensus.cc:2393] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 13: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:42.135953 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:42.125500 29095 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:18:42.154423 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 49698.9us
I20260709 12:18:42.132638 28802 raft_consensus.cc:3060] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.134853 28821 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:42.134449 28996 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:42.137099 28957 raft_consensus.cc:2749] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.153393 29095 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.170667 29095 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.174979 23987 raft_consensus.cc:2468] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 13.
I20260709 12:18:42.174540 23818 catalog_manager.cc:5697] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 7 to 9, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 9 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:42.176095 23818 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:42.182729 24566 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:42.134321 28686 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.186995 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.135000 29108 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.177532 23818 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 4 to 12, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 12 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.150022 29084 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:42.190088 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.201520 23920 raft_consensus.cc:1240] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:42.218024 23914 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:18:42.195129 28821 raft_consensus.cc:2804] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:42.223258 28957 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.223488 29084 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 15 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:42.188571 23991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:42.250545 23991 raft_consensus.cc:606] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:42.247646 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:42.192046 28854 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 12:18:42.230221 28662 raft_consensus.cc:515] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.256479 28662 leader_election.cc:290] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:42.229116 29007 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:18:42.257831 24034 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:42.259101 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.258864 29084 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.260289 24034 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.227104 29036 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:42.262874 28739 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.263298 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:42.263613 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:42.263780 28770 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.263634 28739 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:42.264906 24067 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:18:42.265457 24034 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:42.266932 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.267409 29095 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.267858 28686 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:42.263886 23987 raft_consensus.cc:3060] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:42.245463 28821 raft_consensus.cc:697] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:42.277817 24067 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:42.278257 28739 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:42.278493 28802 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.282037 29073 raft_consensus.cc:3055] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:42.268780 24034 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.290230 24566 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:42.295149 29073 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:42.295769 29036 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:42.296391 29097 raft_consensus.cc:2804] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:42.296267 24034 leader_election.cc:400] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Vote denied by peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685) with higher term. Message: Invalid argument: T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for earlier term 10. Current term is 11.
I20260709 12:18:42.300961 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:42.304533 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:42.309340 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 85350.1us
I20260709 12:18:42.296262 29073 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:42.310048 23962 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:42.314041 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.314908 23962 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:18:42.315732 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 84997.2us
I20260709 12:18:42.302126 29097 raft_consensus.cc:697] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:42.319141 23987 raft_consensus.cc:2468] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:42.306022 28686 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:42.325404 24064 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:42.313683 28928 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.321012 29071 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:42.392122 24598 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:42.392760 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:42.393342 24065 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.404155 24063 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:42.405575 29071 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:42.406929 29071 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:42.316922 29073 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:42.347529 29107 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.317942 28824 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:42.414839 28824 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:42.389801 29095 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:42.350071 29097 consensus_queue.cc:237] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.334095 28821 consensus_queue.cc:237] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.484696 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.487563 24065 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
I20260709 12:18:42.493140 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:42.496706 23987 raft_consensus.cc:606] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:42.497078 23987 raft_consensus.cc:614] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:42.502952 24070 raft_consensus.cc:1240] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:42.502928 28576 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:42.504768 24566 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:42.508919 24063 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:18:42.511206 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:42.511767 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:42.511288 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
W20260709 12:18:42.503499 29117 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.095s	user 0.004s	sys 0.009s
I20260709 12:18:42.511377 28965 consensus_queue.cc:1059] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:18:42.519289 23914 raft_consensus.cc:2393] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 16: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:42.522066 23917 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:42.524473 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:42.532584 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.507603 28969 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:42.543622 23915 raft_consensus.cc:1240] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:42.546756 29130 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:42.522370 29086 raft_consensus.cc:2804] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:42.533761 28348 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:42.562268 24065 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:18:42.563998 29108 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:42.552548 28969 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.580344 28969 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:42.583982 29026 raft_consensus.cc:3055] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:42.584424 29026 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:42.585373 29026 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:42.592427 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:42.593571 28824 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.559681 28957 consensus_queue.cc:1059] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:18:42.600415 23818 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.601902 28957 raft_consensus.cc:3055] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:42.602308 28957 raft_consensus.cc:740] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:42.602500 23818 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 11 to 13, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 13 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:42.603199 28957 consensus_queue.cc:260] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.604640 28957 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:42.604774 23818 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:42.606761 28662 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:42.607267 28662 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.609268 28662 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:42.558454 29086 raft_consensus.cc:697] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 15 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:42.609930 23818 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 11 to 14, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 14 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:42.610355 29086 consensus_queue.cc:237] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:42.615828 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 54905.4us
I20260709 12:18:42.616878 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:42.632105 24035 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.632514 24034 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:42.638583 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:42.644114 24063 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:18:42.655750 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55420.9us
I20260709 12:18:42.662086 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:42.709910 28964 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:42.710608 28964 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:42.711676 28964 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:42.713315 28964 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:42.673892 29127 raft_consensus.cc:2804] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:42.715550 29127 raft_consensus.cc:697] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:42.716455 29127 consensus_queue.cc:237] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.728927 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.742394 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:42.744046 24063 raft_consensus.cc:1240] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:42.746340 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:42.743126 23916 raft_consensus.cc:2468] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
W20260709 12:18:42.757256 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 95681.8us
I20260709 12:18:42.725984 29107 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.727272 29108 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.762472 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:42.763643 23920 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 16.
I20260709 12:18:42.767066 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:42.770047 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 153564us
I20260709 12:18:42.768587 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b3cbce810b542c7b032e8cbe30abbfd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:42.774163 24594 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 16: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:42.770780 24034 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.748803 29095 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:42.775828 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 48833.8us
I20260709 12:18:42.777344 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e7023603694b9d8a378858f72b4532" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:42.759052 29084 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:42.783579 24564 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:42.786917 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 77395.9us
I20260709 12:18:42.790068 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:42.771066 28855 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:42.781096 29136 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.122s	user 0.001s	sys 0.001s
I20260709 12:18:42.789300 29107 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:42.794359 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:42.794914 24597 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:42.798359 24595 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 16: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
W20260709 12:18:42.799053 29132 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 12:18:42.802996 24592 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:18:42.803140 23987 raft_consensus.cc:606] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:42.805730 24035 leader_election.cc:304] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.806787 29036 raft_consensus.cc:2749] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:42.802044 24597 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
W20260709 12:18:42.812534 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 54585.8us
I20260709 12:18:42.812960 24597 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:42.814078 29133 consensus_queue.cc:1059] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:42.815160 29133 raft_consensus.cc:3055] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:42.815553 29133 raft_consensus.cc:740] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:42.765398 28908 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:18:42.817945 28908 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:42.818758 28986 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:42.820506 28986 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:42.822042 28855 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.822177 28763 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:42.773854 29108 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.825407 28763 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:42.826469 29072 raft_consensus.cc:993] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
W20260709 12:18:42.827042 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 43604.2us
I20260709 12:18:42.827466 29108 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:42.829638 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:42.830233 24070 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:42.827142 29072 raft_consensus.cc:1081] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:42.832151 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:42.835294 24063 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:42.841146 24070 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:42.848047 23917 raft_consensus.cc:1275] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:42.848574 23913 raft_consensus.cc:1275] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:18:42.850226 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 79514.6us
I20260709 12:18:42.851428 24034 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:42.855929 29133 consensus_queue.cc:260] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:42.857523 29133 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.868501 28762 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:42.869154 28762 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.869547 23921 raft_consensus.cc:1275] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:18:42.869599 28762 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:42.787101 29084 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:42.872452 29084 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:42.843060 29095 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:42.877640 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:42.881569 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.819530 28908 consensus_queue.cc:1059] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
W20260709 12:18:42.900887 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 55400.8us
I20260709 12:18:42.906807 23921 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:18:42.911439 29135 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.116s	user 0.002s	sys 0.000s
I20260709 12:18:42.914629 29095 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.915149 29095 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:42.866372 29121 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:42.916956 29065 consensus_queue.cc:1048] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:42.930861 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:42.931311 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 79956.1us
I20260709 12:18:42.903581 29141 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:42.921792 24064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:18:42.940898 24064 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:42.941390 24064 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:42.898900 29072 consensus_queue.cc:1048] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:18:42.927532 28855 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:42.920581 29101 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:18:42.933598 28824 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:18:42.998929 28924 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:18:43.011893 23995 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:43.012043 28762 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:43.013867 29137 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:43.019260 24064 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:43.032793 24064 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:43.036413 29026 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.037468 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:43.038024 23912 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:43.045374 23818 catalog_manager.cc:5697] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 7 to 9, term changed from 8 to 11, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2), VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:43.046491 24070 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:18:43.047695 23818 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:43.048089 28969 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:43.048921 23818 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 10, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 10 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:43.057200 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:43.057996 23992 raft_consensus.cc:3055] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:43.058389 23992 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:43.063777 24064 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:18:43.067133 23818 catalog_manager.cc:5697] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 7 to 10, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 10 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:43.072669 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:43.073315 24062 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.078552 23992 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:43.079720 23992 raft_consensus.cc:3060] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:43.080224 24064 raft_consensus.cc:1275] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:43.081902 28969 consensus_queue.cc:1048] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:18:43.090308 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 306732us
I20260709 12:18:43.102525 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:43.105770 23912 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:43.100584 24062 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:43.108762 24034 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:43.090049 29125 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.527s	user 0.004s	sys 0.000s
I20260709 12:18:43.107951 23887 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:43.114138 23818 catalog_manager.cc:5697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:43.122144 23818 catalog_manager.cc:5697] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:43.129796 23887 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.145254 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 258253us
I20260709 12:18:43.104179 28762 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:43.114413 28662 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:43.120241 28928 raft_consensus.cc:2804] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:43.120729 28854 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:43.101629 29084 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:18:43.172698 23992 raft_consensus.cc:2468] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
W20260709 12:18:43.259485 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 86344.9us
I20260709 12:18:43.259598 28763 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:43.263494 23912 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:43.172365 28928 raft_consensus.cc:697] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:43.173236 29142 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:43.171442 28854 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:43.293721 23992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:43.291476 24598 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:18:43.294518 23992 raft_consensus.cc:606] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:43.273026 29125 log.cc:927] Time spent T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:18:43.291180 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 122979us
I20260709 12:18:43.308787 23921 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:43.313868 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:43.325845 24593 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 13.
I20260709 12:18:43.370519 29102 consensus_queue.cc:1048] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
W20260709 12:18:43.373693 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 61845us
I20260709 12:18:43.374557 23992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:43.375211 23992 raft_consensus.cc:606] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:43.375453 28926 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:43.377334 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:43.379274 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:43.380292 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:43.380966 24068 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2524) took 1332 ms. Trace:
I20260709 12:18:43.306125 28802 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:43.381800 28802 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:43.381320 24068 rpcz_store.cc:276] 0709 12:18:42.048787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.063639 (+ 14852us) service_pool.cc:224] Handling call
0709 12:18:42.069986 (+  6347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.122876 (+ 52890us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:18:42.283422 (+160546us) log.cc:844] Serialized 14 byte log entry
0709 12:18:42.530956 (+247534us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.531378 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.531546 (+   168us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:42.531821 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 12:18:42.531989 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.532060 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.947564 (+415504us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b1800382c60. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb65522 00007f75bdb677c1 00007f75bdb67779 00007f75bdb67709 00007f75bdb676d1 00007f75bdb669cd 0000000000388634 0000000000388479 00007f75bdb4883a
0709 12:18:43.081964 (+134400us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b24001ef6c8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bd9eb9c4 00007f75bd9e9acb 00007f75bdba4dc9 00007f75bdba4a55 00007f75bdba409d 00007f75c07d610e 00007f75c07ed88c 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221
0709 12:18:43.380778 (+298814us) raft_consensus.cc:1685] finished
0709 12:18:43.380807 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.380915 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3038,"prepare.queue_time_us":41377,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":93747,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":13893,"spinlock_wait_cycles":8651520,"thread_start_us":367742,"threads_started":3,"wal-append.queue_time_us":88706}
W20260709 12:18:43.383559 29143 log.cc:927] Time spent T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.215s	user 0.000s	sys 0.000s
I20260709 12:18:43.384706 29101 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:43.306972 29142 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:43.387960 29142 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:43.390970 29145 log.cc:927] Time spent T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:43.390615 29095 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:43.391875 24594 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:18:43.392875 29095 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:43.393895 28854 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:43.383152 28928 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:43.409590 24063 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:43.416402 24068 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:18:43.418783 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:43.434635 28584 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:43.373694 23813 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39296 (request call id 308) took 38195 ms (client timeout 15000 ms). Trace:
W20260709 12:18:43.436818 23813 rpcz_store.cc:269] 0709 12:18:05.178598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.178929 (+   331us) service_pool.cc:224] Handling call
0709 12:18:43.373381 (+38194452us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:31.867809 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:31.868482 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:31.868529 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:18:31.868558 (+    29us) tablet.cc:662] Decoding operations
0709 12:18:31.870832 (+  2274us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:31.870924 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:31.870954 (+    30us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:18:31.872139 (+  1185us) tablet.cc:701] Row locks acquired
0709 12:18:31.872185 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:18:31.872357 (+   172us) write_op.cc:270] Start()
0709 12:18:31.872499 (+   142us) write_op.cc:276] Timestamp: P: 1783599511872298 usec, L: 0
0709 12:18:31.872537 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 12:18:31.873225 (+   688us) log.cc:844] Serialized 5884 byte log entry
0709 12:18:32.531143 (+657918us) op_driver.cc:464] REPLICATION: finished
0709 12:18:32.844135 (+312992us) write_op.cc:301] APPLY: starting
0709 12:18:32.876750 (+ 32615us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:33.421469 (+544719us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:33.568189 (+146720us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:33.855576 (+287387us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:34.031383 (+175807us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:18:34.031466 (+    83us) write_op.cc:312] APPLY: finished
0709 12:18:34.067683 (+ 36217us) log.cc:844] Serialized 139 byte log entry
0709 12:18:34.502125 (+434442us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:34.528257 (+ 26132us) write_op.cc:454] Released schema lock
0709 12:18:34.549404 (+ 21147us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:34.643121 (+ 93717us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:34.643171 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":127853,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":196155,"apply.run_cpu_time_us":69768,"apply.run_wall_time_us":1864909,"cfile_cache_hit":58,"cfile_cache_hit_bytes":60697,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6220,"cfile_init":2,"lbm_read_time_us":96705,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":10,"num_ops":15,"prepare.queue_time_us":404211,"prepare.run_cpu_time_us":13448,"prepare.run_wall_time_us":247922,"raft.queue_time_us":207224,"raft.run_cpu_time_us":11067,"raft.run_wall_time_us":102453,"replication_time_us":658335,"thread_start_us":1068272,"threads_started":5,"wal-append.queue_time_us":868204,"wal-append.run_cpu_time_us":10801,"wal-append.run_wall_time_us":2429497}]]}
I20260709 12:18:43.449328 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:43.455725 29102 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.016s
W20260709 12:18:43.494171 29148 log.cc:927] Time spent T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.368s	user 0.003s	sys 0.000s
W20260709 12:18:43.495529 29149 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.371s	user 0.001s	sys 0.000s
I20260709 12:18:43.517103 24597 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:18:43.537071 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:43.542500 24598 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:43.543124 23886 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:43.548524 23886 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:43.550400 28855 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:43.556483 28855 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:43.563426 28855 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:18:43.574558 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 86352.3us
I20260709 12:18:43.604936 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:43.606527 24066 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:43.616984 24597 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:43.635160 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:43.635492 23921 raft_consensus.cc:3060] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:43.582780 28907 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:43.658064 29175 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:18:43.660351 29114 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.626197 29036 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:18:43.693508 23921 raft_consensus.cc:1275] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:18:43.658595 29073 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:18:43.654564 29147 consensus_queue.cc:1059] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:18:43.658468 29097 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:18:43.661846 28907 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:43.725438 29152 log.cc:927] Time spent T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:18:43.742667 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 66742us
I20260709 12:18:43.677497 29114 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:43.798496 28576 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:43.841584 29135 log.cc:927] Time spent T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:18:43.933552 29110 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:43.934023 28907 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:43.934172 29110 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:43.934911 28802 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:43.936329 29110 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:43.929461 28576 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:43.938977 28576 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:43.929752 29181 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
W20260709 12:18:43.975734 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 221134us
I20260709 12:18:43.976617 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:43.978428 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 111797us
I20260709 12:18:43.977969 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:43.980751 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:43.979810 29109 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:43.982954 24066 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 12: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:43.993279 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:43.993099 29109 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:43.993883 23919 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 11.
W20260709 12:18:43.994171 29138 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:18:44.028718 24598 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:43.991835 29142 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.983295 29141 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:43.982868 29113 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:43.940950 29181 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:44.072083 29163 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:18:44.044165 29142 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:44.073819 29186 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260709 12:18:44.084024 29142 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:44.091187 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.115049 28965 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:44.213011 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55244.9us
W20260709 12:18:44.217223 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 67570.7us
W20260709 12:18:44.220639 24564 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.001s
W20260709 12:18:44.221107 24564 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.007s	sys 0.002s
W20260709 12:18:44.221504 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 552562us
I20260709 12:18:44.223747 29142 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:44.212522 29163 log.cc:927] Time spent T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:18:44.078377 29141 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:44.231328 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 204663us
I20260709 12:18:44.169449 29109 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:44.105640 29113 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.241453 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:44.213143 29190 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:44.224776 29187 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.295837 28763 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:44.296429 28763 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.296854 29193 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.297092 29114 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:44.297426 29193 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.299070 29141 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.224474 29142 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.300107 29193 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.300782 29185 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.301052 29142 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:44.301430 29185 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.294468 29190 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.304188 29185 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.304453 29190 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:44.309715 29182 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.435s	user 0.001s	sys 0.000s
I20260709 12:18:44.310685 29187 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.312227 29181 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.312783 29187 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.318521 29187 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.319006 29187 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.321316 29187 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.296099 29161 consensus_queue.cc:1048] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:18:44.218402 28965 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.296876 28763 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:44.362421 24064 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.000s	sys 0.019s
I20260709 12:18:44.350994 29187 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:44.354394 29181 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.390306 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da0449b96d0e4a57b82ad92e05c4cea7" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:44.383790 24064 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.000s	sys 0.020s
I20260709 12:18:44.355522 28900 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.341634 29185 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:18:44.386210 23914 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.009s	sys 0.009s
I20260709 12:18:44.351372 29141 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:18:44.390986 24062 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.000s	sys 0.011s
I20260709 12:18:44.391181 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:44.393036 23914 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.010s	sys 0.009s
I20260709 12:18:44.394411 23995 raft_consensus.cc:1275] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:18:44.365267 29026 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.006s	sys 0.006s
W20260709 12:18:44.396032 24062 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.000s	sys 0.012s
W20260709 12:18:44.390709 28985 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.007s	sys 0.011s
I20260709 12:18:44.400116 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:18:44.400091 29026 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.006s	sys 0.006s
I20260709 12:18:44.392457 29187 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:44.403287 28985 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.007s	sys 0.011s
I20260709 12:18:44.410422 29187 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.420652 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.421113 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.421286 23994 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:44.421542 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.392691 29190 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.424507 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.422293 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.396771 28900 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.435212 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.435812 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.434722 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.437516 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.444298 23988 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:44.423210 29109 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.453035 29113 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:44.458711 29121 raft_consensus.cc:3055] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:44.459153 29121 raft_consensus.cc:740] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:44.460047 29121 consensus_queue.cc:260] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.461179 29121 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:18:44.464843 29183 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.481s	user 0.003s	sys 0.000s
I20260709 12:18:44.432710 28576 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.467303 28576 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.430568 29190 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.397822 29181 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.470885 23992 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:44.424546 29187 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.399899 29185 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.399988 29141 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.444342 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:44.482199 24062 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.498237 24062 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 16.
I20260709 12:18:44.502760 29205 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:44.503204 29205 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.503821 29205 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:44.503084 29107 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.504091 29141 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.504488 29107 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.505689 28576 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.506577 28965 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:44.507483 28900 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.508002 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.508960 29107 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.510248 29213 raft_consensus.cc:493] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:44.511839 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.510922 29213 raft_consensus.cc:515] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.473965 29109 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.545665 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.481281 29187 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.540850 29206 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.525686 29072 raft_consensus.cc:493] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:44.523970 29193 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:18:44.547703 29107 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.555661 29130 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:44.552438 29141 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.558153 29130 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.558256 29141 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.558990 29109 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:44.562052 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 115354us
I20260709 12:18:44.564752 29199 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.565341 29199 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.567078 29130 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.567466 29199 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.556597 29206 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.572057 29206 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.559765 29107 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.575426 29107 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.587391 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.588297 23919 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 9.
I20260709 12:18:44.593333 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:44.594163 24593 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 17.
I20260709 12:18:44.562991 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:44.554888 29167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.012s	sys 0.009s
I20260709 12:18:44.596252 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:44.598719 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:44.599323 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:44.601646 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:44.561579 29190 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:44.609513 29222 consensus_queue.cc:1048] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:18:44.606087 29086 raft_consensus.cc:2749] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:44.612023 29185 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.615113 24035 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:44.616262 29185 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:44.617242 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:18:44.596626 29167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.012s	sys 0.010s
I20260709 12:18:44.619149 24035 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:44.620038 29185 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:44.620992 24591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:44.621760 24591 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 17: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:44.618115 29205 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.606968 29181 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.557526 29072 raft_consensus.cc:515] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.622876 24600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:44.623234 29141 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.625259 24597 raft_consensus.cc:1240] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:18:44.608884 23886 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:44.605665 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:44.635480 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:44.636919 24593 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:44.644228 28763 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.647312 23987 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 13: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
W20260709 12:18:44.650497 23806 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 97276.7us
I20260709 12:18:44.650700 29220 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:44.651774 29219 log.cc:927] Time spent T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
W20260709 12:18:44.653566 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 47945us
I20260709 12:18:44.653910 28969 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:44.654721 23960 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:44.657501 29065 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:44.657944 29065 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.658347 29065 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:44.659977 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 112800us
I20260709 12:18:44.631595 29168 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.664012 29168 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.668018 29129 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:44.668594 29129 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.672344 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.672765 23991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.673101 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.674376 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.686652 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.696416 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.697108 24065 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 8.
I20260709 12:18:44.638878 28576 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:44.705017 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.713649 24063 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:44.747282 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:44.748242 23921 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:44.695809 29187 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:44.809028 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.820716 24596 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:44.823307 24066 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 12.
I20260709 12:18:44.713398 28576 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.843648 24068 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:44.841812 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.842542 23921 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:44.810544 29194 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:44.845917 29209 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.404s	user 0.006s	sys 0.010s
I20260709 12:18:44.847059 28576 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:44.843202 28964 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.865031 29109 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.883469 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.880627 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.885504 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.870457 29129 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.899711 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.900588 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.854173 29194 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.901351 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.907145 24061 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 16.
I20260709 12:18:44.908113 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:44.908519 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.910394 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.911973 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.908955 24595 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:44.916002 24064 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57842 (request call id 2574) took 1332 ms. Trace:
I20260709 12:18:44.916380 24064 rpcz_store.cc:276] 0709 12:18:43.583206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.583690 (+   484us) service_pool.cc:224] Handling call
0709 12:18:43.584128 (+   438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:43.584610 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:43.584650 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:43.624560 (+ 39910us) log.cc:844] Serialized 52 byte log entry
0709 12:18:44.391493 (+766933us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:44.391533 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.393484 (+  1951us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:44.808787 (+415303us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b24001ef6c8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bd9eb9c4 00007f75bd9e9acb 00007f75bdba4dc9 00007f75bdba4a55 00007f75bdba409d 00007f75c07d610e 00007f75c07ed88c 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221
0709 12:18:44.915673 (+106886us) raft_consensus.cc:1685] finished
0709 12:18:44.915703 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:44.915948 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":37441,"spinlock_wait_cycles":4368256,"thread_start_us":728462,"threads_started":1,"wal-append.queue_time_us":788709}
W20260709 12:18:44.918056 29225 log.cc:927] Time spent T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:18:44.919800 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:44.920593 23960 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:44.931617 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:44.935739 23921 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:44.932250 24066 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 8.
I20260709 12:18:44.937482 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.940606 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.941123 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.941776 23920 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 9: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:44.941442 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6850e6a4a82a49d689423ed8fb40c891" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.943610 23987 raft_consensus.cc:1275] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:44.946496 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.946957 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.947220 23920 raft_consensus.cc:2393] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 13: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:44.948632 29007 raft_consensus.cc:493] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:44.948698 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f76f3699ab4bae8da2e38abd9f9348" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.950832 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.952565 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.953543 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.953640 23920 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.954748 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.955772 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.956148 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.956909 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:44.958148 23887 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:44.958436 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.959270 23887 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:44.960253 29113 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:44.961006 29113 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:44.961472 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.961726 29113 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:44.962581 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a27cf3ad031452fa9b230da94f82f48" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:44.951915 29007 raft_consensus.cc:515] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:44.965592 29007 leader_election.cc:290] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.966629 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:44.963307 29168 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.004462 28821 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:18:45.012104 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 176651us
I20260709 12:18:44.957998 29072 leader_election.cc:290] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:44.966535 29007 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:44.887492 29109 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:44.905309 28964 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.019176 28821 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.022411 29191 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:45.022010 29194 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.043608 23919 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:45.025934 28576 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:45.006501 29197 log.cc:927] Time spent T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:18:45.028537 29205 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:45.030473 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:45.013960 29108 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:45.054355 23987 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.014703 28823 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:45.049041 28770 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:45.076404 23918 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 18: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:45.048959 29220 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:45.046607 29113 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:18:45.075101 29227 log.cc:927] Time spent T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:18:45.087162 29195 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:45.075040 29191 raft_consensus.cc:697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
W20260709 12:18:45.109907 29229 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:18:45.056741 29007 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.086562 29239 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:45.114835 28964 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.059617 29108 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.087024 29224 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:45.112756 28821 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.101467 29220 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.084797 28823 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.194546 28823 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.119206 29195 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:45.196058 29195 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:45.197139 24034 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.199038 29107 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:45.199072 29224 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.199497 29187 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:45.199687 29107 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.200868 29187 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:45.200964 23920 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:18:45.201268 29224 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.185938 29222 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:45.202243 29222 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.202901 28907 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:45.204306 29222 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.204409 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:45.108392 29235 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 12:18:45.205731 29107 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:45.148375 24067 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42676 (request call id 1026) took 1157 ms. Trace:
W20260709 12:18:45.149600 29189 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 1.169s	user 0.003s	sys 0.011s
I20260709 12:18:45.149152 29191 consensus_queue.cc:237] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.207865 24592 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37708 (request call id 1101) took 1633 ms. Trace:
I20260709 12:18:45.206801 24067 rpcz_store.cc:276] 0709 12:18:43.990887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.990997 (+   110us) service_pool.cc:224] Handling call
0709 12:18:43.991316 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:44.632677 (+641361us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b18003d3420. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75c07fa4bc 00007f75bdb4848b 00007f75c69a29a9 00007f75bdb6469b 00007f75bdb6293f 00007f75bdb62455 00007f75c0c4a060 00007f75c0c4abfb 00007f75c0c5564b
0709 12:18:44.636557 (+  3880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:44.636584 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:44.652466 (+ 15882us) log.cc:844] Serialized 26 byte log entry
0709 12:18:44.707207 (+ 54741us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:44.707245 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:44.707392 (+   147us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.148089 (+440697us) raft_consensus.cc:1685] finished
0709 12:18:45.148109 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.148318 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50048,"raft.queue_time_us":162916,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":55658,"spinlock_wait_cycles":4971776,"thread_start_us":248707,"threads_started":2,"wal-append.queue_time_us":228417}
I20260709 12:18:45.208216 24592 rpcz_store.cc:276] 0709 12:18:43.574351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:43.574468 (+   117us) service_pool.cc:224] Handling call
0709 12:18:43.574806 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:43.583229 (+  8423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:43.583261 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:43.629220 (+ 45959us) log.cc:844] Serialized 26 byte log entry
0709 12:18:43.801696 (+172476us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:43.801751 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.801839 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:45.149185 (+1347346us) spinlock_profiling.cc:243] Waited 8.26 ms on lock 0x7b2400318ea8. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bd9eddb1 00007f75bd9eb9c4 00007f75bd9e9acb 00007f75bdba4dc9 00007f75bdba4a55 00007f75bdba409d 00007f75c07d610e 00007f75c07ed88c 00007f75c07ecbb6 00007f75c07ec7d8 00007f75c07f6221
0709 12:18:45.207627 (+ 58442us) raft_consensus.cc:1685] finished
0709 12:18:45.207645 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:45.207812 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":119,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":9860,"spinlock_wait_cycles":18999552,"thread_start_us":135762,"threads_started":1,"wal-append.queue_time_us":316113}
I20260709 12:18:45.150803 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:45.087849 28576 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.168886 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:45.166813 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 77984.9us
I20260709 12:18:45.104099 29109 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.219697 29107 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:45.223574 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.224469 29203 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:45.223671 29107 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.226959 28763 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.227038 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:45.228102 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.100876 28770 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.229301 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:45.229964 28770 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:45.232091 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:45.192495 29220 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:45.232686 24061 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:45.228291 29107 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.233381 28348 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:45.235006 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:45.235569 24065 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:18:45.238627 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:45.247177 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:45.250108 29213 leader_election.cc:290] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.250773 24065 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 18.
W20260709 12:18:45.251013 29065 consensus_meta.cc:287] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e: Time spent flushing consensus metadata: real 0.592s	user 0.009s	sys 0.001s
I20260709 12:18:45.251402 29065 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.251968 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:45.252597 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:45.253320 29065 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.253539 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:45.251996 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:45.315654 23915 raft_consensus.cc:2393] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 14: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:45.261533 28833 raft_consensus.cc:993] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:45.262434 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:45.263172 28348 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:18:45.316694 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 61453.7us
I20260709 12:18:45.317862 29113 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:45.318293 29113 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.318655 29113 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.325280 23887 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:45.326874 29236 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:45.327374 29236 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:45.328200 29236 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.184664 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:45.332764 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 148170us
I20260709 12:18:45.333789 29208 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:18:45.334203 29208 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.334586 29208 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:45.337380 28926 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:45.339037 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.267764 29108 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.273236 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:45.340436 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:18:45.340706 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 81904.9us
I20260709 12:18:45.273546 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:45.277225 24035 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:18:45.342713 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 65578us
I20260709 12:18:45.337913 28926 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.278568 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:45.279579 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:45.345713 28926 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.286899 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b36a4b120beb473694980945af8d8909" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:45.349040 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:45.288136 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:45.289953 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:45.293162 23961 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
W20260709 12:18:45.355290 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 62215.6us
I20260709 12:18:45.356792 29102 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:45.357170 29102 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting leader election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:45.357543 29102 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:45.241287 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:45.342793 28348 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:45.358538 28348 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:18:45.358891 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 117718us
I20260709 12:18:45.358979 28348 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:45.359963 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.360718 29205 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:45.361299 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.361756 29205 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:45.362452 28686 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:45.362672 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:45.285917 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9661e61546884b0aa0c1e828cd13e76e" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:45.364467 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db304f4ee46489296e4f0f6b21cac26" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.364863 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.366406 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.358006 29007 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.368979 23992 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:45.369891 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.371188 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:45.372007 24034 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:45.373051 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.374846 24066 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 13.
I20260709 12:18:45.379475 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:45.380153 24066 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:45.382334 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.383215 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0caf361b460241abb91679f8f8b6e7e4" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:45.384282 24564 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:45.387746 24034 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.389393 24034 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:45.390479 29107 raft_consensus.cc:2749] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:45.430738 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.432457 23887 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:45.433236 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 61653.2us
I20260709 12:18:45.367352 28833 raft_consensus.cc:1081] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:45.145495 29239 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.440703 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.441628 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.442260 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.441324 23993 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 17.
I20260709 12:18:45.444424 23961 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:45.445124 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.447451 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.382328 29206 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:18:45.427351 29245 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:18:45.469765 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:45.374604 28990 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.017s	sys 0.066s
I20260709 12:18:45.453662 23887 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.462234 24066 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:45.387300 28969 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:45.479979 23887 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:45.496632 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 52326.1us
I20260709 12:18:45.493108 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:45.439096 29205 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:18:45.439245 29203 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:45.439132 28686 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.493268 28854 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:45.491813 28990 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.018s	sys 0.067s
I20260709 12:18:45.504701 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.464542 28965 raft_consensus.cc:2749] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:45.445662 29239 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:45.406152 29195 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.495010 29107 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:45.516682 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:45.491657 28762 raft_consensus.cc:2749] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:45.523106 24067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:18:45.523875 24067 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:45.524325 24067 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:45.527202 24597 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:18:45.525156 24036 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.532464 24566 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.536824 23915 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:45.546747 28348 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.549561 28348 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.555682 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:45.555966 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:45.558705 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 473275us
I20260709 12:18:45.523149 29198 raft_consensus.cc:2749] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:45.565266 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:45.533595 29205 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:45.538458 29224 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:45.561772 29142 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:45.599232 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:45.599062 24067 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.613847 24592 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 17: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:45.611577 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.621140 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:45.627642 29195 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.628149 29102 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.631649 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.633181 29236 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:45.633565 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:45.633963 29236 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:45.634881 28854 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:45.635257 28854 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:45.635622 28854 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:45.557559 28926 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:18:45.644686 24067 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.554947 28348 consensus_queue.cc:1048] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:18:45.609810 28967 consensus_queue.cc:1059] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:18:45.647164 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:45.657470 24592 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:45.615715 29084 raft_consensus.cc:2749] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:45.668190 29101 raft_consensus.cc:3055] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:45.668601 29101 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:45.669384 29101 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.671893 29113 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.673529 29239 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:45.687258 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:45.693516 23916 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:45.694808 24068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:45.699455 23913 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:45.683588 29102 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.705734 29191 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:45.713745 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:45.666079 29208 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.716584 29208 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.719710 24597 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 18: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:45.709250 23886 leader_election.cc:304] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.711799 24592 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:45.709874 28854 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:45.734193 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:45.734774 23990 raft_consensus.cc:606] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:45.735109 28854 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 17 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:45.702756 29101 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:45.740151 23886 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.741708 24592 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:18:45.747274 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:45.753691 24598 raft_consensus.cc:2393] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 17: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:18:45.755164 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:45.755909 24067 raft_consensus.cc:2393] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 18: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:45.731096 29007 raft_consensus.cc:2749] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:45.760838 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:45.761427 23914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:45.762037 23912 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:45.765223 23912 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:45.763471 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 232408us
I20260709 12:18:45.766747 24036 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:45.768291 29107 raft_consensus.cc:2764] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:18:45.760839 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "49b6c160a80f417b89957aa0a1f5dd34" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:45.764546 28969 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:45.746477 29108 raft_consensus.cc:2749] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:45.763036 28833 consensus_queue.cc:1059] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:18:45.799263 28833 raft_consensus.cc:3055] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:45.799638 28833 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:45.800053 23919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:45.800472 28833 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:45.814965 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 43838.9us
I20260709 12:18:45.815857 29239 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.817948 29113 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:45.821695 23912 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:45.821796 24034 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:45.821792 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:45.826239 23990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:45.827009 23990 raft_consensus.cc:606] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:45.827428 23990 raft_consensus.cc:614] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:45.834120 24034 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:45.843412 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:45.844285 23987 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.852684 23990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:45.861629 23990 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:45.871187 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:45.874369 23987 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:45.892042 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:45.892860 24066 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.894702 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:45.895608 24067 raft_consensus.cc:2393] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate ef0dd15ac654478b8371c22b8909240e in this term.
I20260709 12:18:45.856244 29203 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.943368 24598 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:18:45.946906 29084 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:45.948359 28833 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:45.948514 24066 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 15.
I20260709 12:18:45.937816 23993 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
W20260709 12:18:45.901379 23959 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.926090 29204 raft_consensus.cc:993] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:45.931124 23994 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 17.
I20260709 12:18:45.939705 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:45.962949 23987 raft_consensus.cc:606] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:45.963423 23987 raft_consensus.cc:614] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:45.898339 23887 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:18:45.966378 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 68163.6us
I20260709 12:18:45.967458 24564 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:45.958359 24063 raft_consensus.cc:1240] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:45.971755 24065 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:18:45.980031 23887 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:45.985761 23887 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:45.989590 23887 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:45.974383 29247 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:45.977603 29190 raft_consensus.cc:1081] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:45.989060 29084 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:45.992681 29108 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:45.995167 29246 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:46.025669 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8132db9882c041d1845d0a8815c39788"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:46.026544 23987 raft_consensus.cc:606] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:46.006799 29247 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 15 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:46.034533 23913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:18:46.035076 23913 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:46.035400 23913 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:46.022783 29108 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:46.058112 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:46.077165 23987 raft_consensus.cc:606] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:46.077560 23987 raft_consensus.cc:614] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:46.026188 29246 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 17 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:46.015538 29248 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:18:46.075294 23913 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:46.100670 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:46.102983 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:46.117657 24034 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:46.120362 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:46.129948 28928 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:46.116356 29206 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:46.142323 28928 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:46.130944 29236 consensus_queue.cc:1059] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
W20260709 12:18:46.163735 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 148019us
W20260709 12:18:46.166597 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 397740us
I20260709 12:18:46.173933 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:46.175837 24036 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:46.184731 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:46.193521 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:46.194324 23987 raft_consensus.cc:3055] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:46.194693 23987 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:46.202416 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:46.204958 23989 raft_consensus.cc:1240] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Rejecting Update request from peer a46beb8868d749fdbaa732dd1ef6b89b for earlier term 13. Current term is 14. Ops: []
I20260709 12:18:46.176568 29187 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:46.186496 28686 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:46.225162 23987 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:46.181663 29220 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:18:46.232318 23962 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:46.237125 23987 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:46.155962 29108 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:46.260373 23962 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:46.146129 29247 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:46.264928 29264 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:46.266211 29206 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:46.266796 29206 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:46.269104 29206 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:46.271984 28907 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:18:46.275379 28985 raft_consensus.cc:993] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:46.275888 28985 raft_consensus.cc:1081] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:46.277990 23962 leader_election.cc:304] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:46.282589 23962 leader_election.cc:304] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:46.237058 29261 raft_consensus.cc:2764] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:18:46.162894 29246 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:46.298623 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 130477us
I20260709 12:18:46.301448 23987 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:46.303529 23887 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:46.295614 29172 raft_consensus.cc:2749] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:46.306759 23962 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:18:46.294567 29191 raft_consensus.cc:2749] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:18:46.306903 29265 log.cc:927] Time spent T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.161s	user 0.000s	sys 0.003s
I20260709 12:18:46.309084 28990 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:46.313643 28584 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:46.262486 28928 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:46.350404 29276 log.cc:927] Time spent T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 12:18:46.336726 28990 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:46.360766 28990 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:46.365796 23913 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:18:46.370124 23962 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:46.391309 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 192365us
I20260709 12:18:46.399044 24069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8132db9882c041d1845d0a8815c39788"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:18:46.399534 24068 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:18:46.400522 24069 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:46.400874 24069 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:46.401264 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:46.407092 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:46.407390 23994 raft_consensus.cc:2410] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 12:18:46.417505 29267 log.cc:927] Time spent T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:18:46.418437 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:46.393362 28584 raft_consensus.cc:697] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:46.428861 24069 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:46.429500 24065 raft_consensus.cc:1240] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 12. Current term is 13. Ops: []
I20260709 12:18:46.423695 29205 consensus_queue.cc:1059] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:18:46.433990 23962 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:46.435914 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:46.424225 29210 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:18:46.453271 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:46.454068 24593 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:46.456425 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:46.457177 23913 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:46.447889 29065 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:18:46.446700 29261 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:46.471294 24069 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:46.471513 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:46.472136 23987 raft_consensus.cc:3055] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:46.472431 23987 raft_consensus.cc:740] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:46.473130 23987 consensus_queue.cc:260] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:46.475625 23913 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 18.
I20260709 12:18:46.477020 29248 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:18:46.478929 29248 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:46.483968 23916 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 17. Current term is 18. Ops: []
W20260709 12:18:46.495523 29270 log.cc:927] Time spent T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
W20260709 12:18:46.508508 23960 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.555868 24593 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:18:46.564008 29213 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:46.489104 28584 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:46.580009 28985 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:46.580608 28985 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:46.582962 28985 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:46.584362 24070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:18:46.587215 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 118132us
I20260709 12:18:46.592712 28985 consensus_queue.cc:1059] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:46.606765 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:46.629506 23960 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:46.633942 29191 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:18:46.646463 29269 log.cc:927] Time spent T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.489s	user 0.003s	sys 0.000s
W20260709 12:18:46.641754 29294 log.cc:927] Time spent T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:18:46.657130 29208 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.657717 29208 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:46.659735 29208 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:46.664167 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:46.665354 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:46.666121 23994 raft_consensus.cc:2410] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:18:46.681664 28770 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:46.682124 28770 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:46.685519 28770 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:46.686908 28770 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:46.714949 24070 raft_consensus.cc:1240] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Rejecting Update request from peer ef0dd15ac654478b8371c22b8909240e for earlier term 17. Current term is 18. Ops: []
I20260709 12:18:46.732235 24034 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:46.733275 24065 raft_consensus.cc:1240] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:46.733142 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:46.739528 24564 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:46.757606 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:46.751335 29287 raft_consensus.cc:2804] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:46.749320 28969 raft_consensus.cc:2749] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:18:46.753996 29248 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:46.793977 29282 consensus_queue.cc:1059] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:46.796988 23887 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:46.798053 28854 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:46.812995 23987 raft_consensus.cc:3060] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:46.821066 29287 raft_consensus.cc:697] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:46.831934 23987 raft_consensus.cc:2468] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 18.
I20260709 12:18:46.847040 29084 raft_consensus.cc:3055] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:46.847468 29084 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:46.863440 23987 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:18:46.864400 23987 pending_rounds.cc:85] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Aborting all ops after (but not including) 10
I20260709 12:18:46.863869 29210 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:46.864763 23987 pending_rounds.cc:107] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 12.11
I20260709 12:18:46.872588 23987 raft_consensus.cc:2917] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Aborting config change with OpId 12.11: Aborted: Op aborted by new leader
I20260709 12:18:46.873018 23987 raft_consensus.cc:2889] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:46.880048 29084 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:46.881533 29084 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:46.866374 29210 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:46.884106 24066 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:46.885366 29210 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:46.885584 29286 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:46.887832 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:46.889578 29287 consensus_queue.cc:237] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:46.891767 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:46.903018 23987 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:58656 (request call id 1) took 2068 ms. Trace:
I20260709 12:18:46.908233 23987 rpcz_store.cc:276] 0709 12:18:44.805392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:45.012149 (+206757us) service_pool.cc:224] Handling call
0709 12:18:45.078718 (+ 66569us) log.cc:844] Serialized 487 byte log entry
0709 12:18:45.391465 (+312747us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b2c00000e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55aa0a 00007f75bf55a693 00007f75bf55a631 00007f75c0c8eb52 00007f75c0c8ecf5 00007f75c0bcb691 00007f75c0babeaa 00007f75c0bb2d53 00007f75c0bb2cd9 00007f75c0bb2c69
0709 12:18:45.545012 (+153547us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b2c00000e98. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75bf54ba11 00007f75bf55aa0a 00007f75bf55a693 00007f75bf55a631 00007f75c0c8eb52 00007f75c0c8ecf5 00007f75c0bcb691 00007f75c0babeaa 00007f75c0bb2d53 00007f75c0bb2cd9 00007f75c0bb2c69
0709 12:18:45.738192 (+193180us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b180006a420. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c6a2dab1 00007f75c6a3a281 00007f75bdb332a6 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c8ed01 00007f75c0bcb691 00007f75c0babeaa
0709 12:18:45.929491 (+191299us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b180017a000. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c8ed01 00007f75c0bcb691 00007f75c0babeaa 00007f75c0bb2d53 00007f75c0bb2cd9 00007f75c0bb2c69 00007f75c0bb2c31 00007f75c0bb1dfd 0000000000388634 0000000000388479
0709 12:18:46.873381 (+943890us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5793,"raft.queue_time_us":22038,"raft.run_cpu_time_us":7156,"raft.run_wall_time_us":701326,"spinlock_wait_cycles":160189824,"thread_start_us":288213,"threads_started":1,"wal-append.queue_time_us":286818,"wal-append.run_cpu_time_us":2541,"wal-append.run_wall_time_us":1203945}
W20260709 12:18:46.911036 23806 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet def9be339f8f4adc820a6a1320fec425 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:18:46.913064 23962 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:46.924299 29273 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:46.930751 24592 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:46.933126 28907 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:46.940871 23819 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:46.942518 23819 catalog_manager.cc:5697] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 9 to 11, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:46.950187 23990 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:18:46.955991 29113 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:18:46.939772 29273 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:18:46.992583 23993 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:46.996999 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 10cd478aa7e9411bba254e94713f91de with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:59384
I20260709 12:18:46.998488 23819 catalog_manager.cc:5697] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 13, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:47.008168 23993 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:18:47.006469 23819 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.011363 29298 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:18:47.018184 23819 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 7, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 7 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:47.011236 29187 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:18:47.019728 23819 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 11, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.020596 29187 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:47.021253 23819 catalog_manager.cc:5697] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 6 to 12, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 12 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.022749 29187 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:47.023435 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:47.025729 24594 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:18:47.025475 23819 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 11 to 13, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:47.026501 29108 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:18:47.027119 23819 catalog_manager.cc:5697] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 11, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:47.028453 23819 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 9 to 11, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:47.030551 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:47.031270 23989 raft_consensus.cc:2393] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 11: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:47.032627 28965 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:47.034965 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:18:47.040395 23818 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43626 (request call id 198) took 15671 ms (client timeout 15000 ms). Trace:
I20260709 12:18:47.042145 23819 catalog_manager.cc:5697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.049351 23994 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:18:47.037943 29187 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:47.040983 23818 rpcz_store.cc:269] 0709 12:18:31.343027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.346506 (+  3479us) service_pool.cc:224] Handling call
0709 12:18:47.014379 (+15667873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:43.501888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:43.552652 (+ 50764us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:43.552708 (+    56us) write_op.cc:435] Acquired schema lock
0709 12:18:43.552730 (+    22us) tablet.cc:662] Decoding operations
0709 12:18:43.556896 (+  4166us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:43.557095 (+   199us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:43.557128 (+    33us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:18:43.688429 (+131301us) tablet.cc:701] Row locks acquired
0709 12:18:43.688483 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:18:43.688676 (+   193us) write_op.cc:270] Start()
0709 12:18:43.688850 (+   174us) write_op.cc:276] Timestamp: P: 1783599523688613 usec, L: 0
0709 12:18:43.688890 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:18:43.689649 (+   759us) log.cc:844] Serialized 6247 byte log entry
0709 12:18:44.620044 (+930395us) op_driver.cc:464] REPLICATION: finished
0709 12:18:44.912108 (+292064us) write_op.cc:301] APPLY: starting
0709 12:18:44.932744 (+ 20636us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:45.218342 (+285598us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b54002e4354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c4f32a 00007f75c0bd4f14 00007f75c0bd4ec3 00007f75c0bd4e38 00007f75c0bd4df3 00007f75c0bd40dc 00007f75c0bfde16 00007f75c0be5cbb 00007f75c0bd039d 00007f75c0bd3d75
0709 12:18:45.310220 (+ 91878us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:45.367954 (+ 57734us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:46.361552 (+993598us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:46.361896 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:18:46.361963 (+    67us) write_op.cc:312] APPLY: finished
0709 12:18:46.362571 (+   608us) log.cc:844] Serialized 148 byte log entry
0709 12:18:46.434695 (+ 72124us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:46.464141 (+ 29446us) write_op.cc:454] Released schema lock
0709 12:18:46.474259 (+ 10118us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:46.570594 (+ 96335us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:46.573510 (+  2916us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4446775,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":252258,"apply.run_cpu_time_us":42171,"apply.run_wall_time_us":1667200,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71103,"num_ops":16,"prepare.queue_time_us":104849,"prepare.run_cpu_time_us":28193,"prepare.run_wall_time_us":1136001,"raft.queue_time_us":147414,"raft.run_cpu_time_us":125038,"raft.run_wall_time_us":603791,"replication_time_us":930975,"spinlock_wait_cycles":11678976,"thread_start_us":1354759,"threads_started":5,"wal-append.queue_time_us":874843,"wal-append.run_cpu_time_us":34510,"wal-append.run_wall_time_us":1091678}]]}
I20260709 12:18:47.054823 23819 catalog_manager.cc:5697] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 10 to 13, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.059988 23819 catalog_manager.cc:5697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 10 to 13, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.087579 23918 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:18:47.092481 23917 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:47.101536 23819 catalog_manager.cc:5697] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 9, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 9 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.057279 29113 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:18:47.108206 28420 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:18:47.136204 23819 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 10 to 13, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 13 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:47.111680 29290 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:18:47.142175 23819 catalog_manager.cc:5697] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 10, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 10 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.174144 24593 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:18:47.204090 29312 tablet_replica.cc:333] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:18:47.196043 29194 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:18:47.214219 23819 catalog_manager.cc:5697] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 9, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 9 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.219662 23819 catalog_manager.cc:5697] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:47.221109 23819 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 12 to 14, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 14 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:47.227144 23819 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 9, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 9 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.245414 29187 raft_consensus.cc:2749] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.258220 24066 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:47.262135 23819 catalog_manager.cc:5697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:47.269325 29309 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.191s	user 0.004s	sys 0.000s
I20260709 12:18:47.276469 23819 catalog_manager.cc:5697] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 6 to 8, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 8 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
W20260709 12:18:47.284081 29313 log.cc:927] Time spent T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:18:47.302788 29311 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:18:47.305333 23819 catalog_manager.cc:5697] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 7 to 17, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 17 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.307998 23819 catalog_manager.cc:5697] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 3 to 8, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 8 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.320806 23819 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 9 to 11, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:47.326907 23819 catalog_manager.cc:5697] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.329576 23819 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 11 to 14, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 14 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.334579 23819 catalog_manager.cc:5697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 12 to 14, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 14 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:47.349550 24070 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:47.366536 29312 raft_consensus.cc:2243] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:47.367691 29312 raft_consensus.cc:2272] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:47.372332 29134 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:47.376595 29312 ts_tablet_manager.cc:1916] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:47.400195 23916 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:47.406046 29113 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:18:47.408886 28770 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 12:18:47.539494 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 107376us
W20260709 12:18:47.540503 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 114231us
W20260709 12:18:47.541910 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 115877us
I20260709 12:18:47.544165 23993 raft_consensus.cc:1275] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:47.571175 29107 consensus_queue.cc:1048] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:18:47.701239 29312 ts_tablet_manager.cc:1929] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 12:18:47.701978 29312 log.cc:1199] T 10cd478aa7e9411bba254e94713f91de P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/10cd478aa7e9411bba254e94713f91de
I20260709 12:18:47.705987 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 10cd478aa7e9411bba254e94713f91de (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:47.896531 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:48.005098 29324 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.005743 29324 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.008615 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:48.009184 24063 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:48.010321 23962 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:48.011220 29172 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:48.011665 29172 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.012014 29172 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:48.017940 29324 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:48.018409 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:48.022372 29172 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.028678 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:48.028932 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:48.029282 24063 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:48.036602 24063 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:18:48.037107 29172 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:48.037827 23962 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:48.038795 29172 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:48.049104 29172 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:48.050000 29172 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.115026 29336 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:18:48.115697 29336 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.117915 29336 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:48.135339 23813 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 13 to 15, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 15 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.144459 23813 catalog_manager.cc:5697] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.155435 23989 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:48.156062 23989 raft_consensus.cc:606] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:48.156400 23989 raft_consensus.cc:614] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:48.181840 23813 catalog_manager.cc:5697] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 7 to 10, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 10 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.182641 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:18:48.184188 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:48.184952 24065 raft_consensus.cc:2368] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 14. Current term is 15.
I20260709 12:18:48.184497 23813 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 12 to 14, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 14 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.185866 23813 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 10 to 14, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 14 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:48.193562 23806 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet def9be339f8f4adc820a6a1320fec425 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ef0dd15ac654478b8371c22b8909240e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.200205 23813 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.201660 23813 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 15, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 15 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.200908 24566 leader_election.cc:400] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 14. Current term is 15.
I20260709 12:18:48.203122 24566 leader_election.cc:403] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:48.207183 23813 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 13 to 17, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 17 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.208724 23813 catalog_manager.cc:5697] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 12, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 12 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.219290 23813 catalog_manager.cc:5697] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 5 to 15, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 15 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.224515 23813 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 10 to 18, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 18 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.229166 23813 catalog_manager.cc:5697] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 12, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 12 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.233804 23813 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 12 to 16, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 16 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.238107 23813 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 14 to 16, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 16 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.242461 23813 catalog_manager.cc:5697] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 12, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 12 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.233281 29336 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:18:48.249676 23813 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 10 to 11, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 11 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.253082 23813 catalog_manager.cc:5697] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 11 to 14, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 14 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.254473 23813 catalog_manager.cc:5697] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 6 to 8, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 8 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.256968 23813 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 10 to 13, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.259661 23813 catalog_manager.cc:5697] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.262856 23813 catalog_manager.cc:5697] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 14, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 14 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.268293 23813 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 8 to 11, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 11 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.271766 23813 catalog_manager.cc:5697] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 10 to 11, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 11 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.279052 23813 catalog_manager.cc:5697] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 8 to 13, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 13 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:48.280038 23819 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39296 (request call id 309) took 17736 ms (client timeout 15000 ms). Trace:
I20260709 12:18:48.280718 23813 catalog_manager.cc:5697] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 10, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 10 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:48.284116 23813 catalog_manager.cc:5697] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 11, leader changed from 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:48.286172 23813 catalog_manager.cc:5697] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:48.280463 23819 rpcz_store.cc:269] 0709 12:18:30.535359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.535617 (+   258us) service_pool.cc:224] Handling call
0709 12:18:48.271775 (+17736158us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:47.710601 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:47.742584 (+ 31983us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:47.742619 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:18:47.742636 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:47.745518 (+  2882us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:47.745597 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:47.745626 (+    29us) tablet.cc:685] Acquiring locks for 28 operations
0709 12:18:47.748006 (+  2380us) tablet.cc:701] Row locks acquired
0709 12:18:47.748028 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:18:47.748341 (+   313us) write_op.cc:270] Start()
0709 12:18:47.748455 (+   114us) write_op.cc:276] Timestamp: P: 1783599527748292 usec, L: 0
0709 12:18:47.748477 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:47.760092 (+ 11615us) log.cc:844] Serialized 10812 byte log entry
0709 12:18:47.871480 (+111388us) op_driver.cc:464] REPLICATION: finished
0709 12:18:47.889538 (+ 18058us) write_op.cc:301] APPLY: starting
0709 12:18:47.889627 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:47.935785 (+ 46158us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:47.935872 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:48.055967 (+120095us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:48.056302 (+   335us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0709 12:18:48.056343 (+    41us) write_op.cc:312] APPLY: finished
0709 12:18:48.056771 (+   428us) log.cc:844] Serialized 244 byte log entry
0709 12:18:48.071238 (+ 14467us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:48.072063 (+   825us) write_op.cc:454] Released schema lock
0709 12:18:48.072127 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:48.072501 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:48.072528 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":856976,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":17802,"apply.run_cpu_time_us":33058,"apply.run_wall_time_us":182942,"cfile_cache_hit":114,"cfile_cache_hit_bytes":121335,"num_ops":28,"prepare.queue_time_us":133652,"prepare.run_cpu_time_us":8409,"prepare.run_wall_time_us":56404,"raft.queue_time_us":79814,"raft.run_cpu_time_us":879,"raft.run_wall_time_us":18526,"replication_time_us":122839,"thread_start_us":133146,"threads_started":4,"wal-append.queue_time_us":10130}]]}
W20260709 12:18:48.295614 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 56163.9us
I20260709 12:18:48.288300 29344 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.337900 29281 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:48.338120 29342 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.369009 29342 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.329550 29344 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:48.378778 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 54803.3us
I20260709 12:18:48.360069 29281 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.429410 29344 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:48.435140 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:48.435811 24594 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 8.
I20260709 12:18:48.436846 29281 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:48.441046 24035 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:48.442366 29349 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:48.442759 29349 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.443071 29349 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:48.448932 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:48.450136 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:48.451643 23917 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:18:48.452347 24594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a33810a45fd4e70b0d4411b8c0afdd6"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:40170
W20260709 12:18:48.455268 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 141140us
I20260709 12:18:48.458798 24564 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:48.453058 24594 raft_consensus.cc:606] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:48.460282 24594 raft_consensus.cc:614] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:48.462957 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216" is_pre_election: true
I20260709 12:18:48.463549 23916 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:18:48.479127 29281 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:48.479535 29281 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:18:48.479882 29281 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:48.481107 29342 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:48.486239 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:18:48.488472 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:18:48.493338 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:48.494017 23987 raft_consensus.cc:606] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:48.494448 23987 raft_consensus.cc:614] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:48.485093 29336 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 14. Current term is 15.
I20260709 12:18:48.532886 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:48.534014 23987 raft_consensus.cc:606] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:48.549470 24592 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 12:18:48.551514 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 161165us
I20260709 12:18:48.553316 29330 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:48.555013 29349 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.556162 24065 raft_consensus.cc:2368] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10.
I20260709 12:18:48.558851 24566 leader_election.cc:400] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10.
I20260709 12:18:48.558956 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:48.560997 29281 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.562024 24597 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:48.564096 23886 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:48.565155 29342 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:48.565578 29342 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:48.565970 29342 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:48.567948 29324 raft_consensus.cc:993] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:48.568465 29324 raft_consensus.cc:1081] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:48.559019 29349 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:48.575594 23913 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:18:48.576191 23913 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:48.576615 23913 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:48.584507 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:48.588541 29281 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:48.589490 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:48.589640 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:48.590171 24065 raft_consensus.cc:2368] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10.
I20260709 12:18:48.589311 23987 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:48.591073 23987 raft_consensus.cc:606] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:48.591130 24566 leader_election.cc:400] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10.
I20260709 12:18:48.591574 24566 leader_election.cc:403] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:48.601420 29281 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:48.611963 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:48.613384 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:48.614187 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:48.586146 29342 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.619771 23916 raft_consensus.cc:2393] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 0829ddf18f07439086398756b9c6d216 in this term.
I20260709 12:18:48.621387 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:48.621685 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:48.622009 24065 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:48.622903 24034 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:48.622113 24061 raft_consensus.cc:2393] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0829ddf18f07439086398756b9c6d216 in current term 10: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:18:48.629483 29172 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:48.630445 29349 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:48.621865 23913 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:48.645054 29281 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409) with higher term. Message: Invalid argument: T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 for earlier term 9. Current term is 10.
I20260709 12:18:48.649423 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:48.650403 23987 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:48.650774 23987 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:48.651015 23913 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:48.651921 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:48.652539 24065 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:48.654245 23987 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:48.655933 23987 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:48.656719 24597 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 10.
I20260709 12:18:48.658993 23886 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:48.650751 29342 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 10 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:48.662086 29239 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:48.662361 24065 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 18.
I20260709 12:18:48.662734 29239 raft_consensus.cc:697] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:48.663563 23887 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:48.663570 29239 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:48.666517 29348 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:48.667012 29348 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:48.667835 29348 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:48.777927 28907 raft_consensus.cc:993] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:48.779116 28824 raft_consensus.cc:1081] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:48.781633 24066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:18:48.782289 24066 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:48.782626 24066 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:48.790934 23987 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 18.
I20260709 12:18:48.800884 24066 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:48.849169 24066 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:48.850147 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:48.850760 23916 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:48.856223 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:48.856830 23987 raft_consensus.cc:3055] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:48.857125 23987 raft_consensus.cc:740] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:48.857832 23987 consensus_queue.cc:260] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:48.858983 23987 raft_consensus.cc:3060] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:48.882294 23916 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:48.883441 24034 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:48.885174 29345 raft_consensus.cc:2804] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:48.886240 29345 raft_consensus.cc:697] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:48.887410 29345 consensus_queue.cc:237] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:48.893235 23987 raft_consensus.cc:2468] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:18:48.993698 23805 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet 10cd478aa7e9411bba254e94713f91de with cas_config_opid_index 7: aborting the task: latest config opid_index 9; task opid_index 7
I20260709 12:18:49.043888 23813 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43626 (request call id 199) took 2113 ms. Trace:
I20260709 12:18:49.044284 23813 rpcz_store.cc:276] 0709 12:18:46.929024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.929205 (+   181us) service_pool.cc:224] Handling call
0709 12:18:49.042820 (+2113615us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:48.427699 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:48.546735 (+119036us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:48.546769 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:18:48.546789 (+    20us) tablet.cc:662] Decoding operations
0709 12:18:48.550579 (+  3790us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:48.550656 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:48.550685 (+    29us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:18:48.591742 (+ 41057us) tablet.cc:701] Row locks acquired
0709 12:18:48.591763 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:48.591914 (+   151us) write_op.cc:270] Start()
0709 12:18:48.592027 (+   113us) write_op.cc:276] Timestamp: P: 1783599528591863 usec, L: 0
0709 12:18:48.592049 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:18:48.606587 (+ 14538us) log.cc:844] Serialized 10394 byte log entry
0709 12:18:48.663935 (+ 57348us) op_driver.cc:464] REPLICATION: finished
0709 12:18:48.841627 (+177692us) write_op.cc:301] APPLY: starting
0709 12:18:48.841711 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:48.932269 (+ 90558us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:48.932386 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:48.995667 (+ 63281us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:48.996027 (+   360us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 12:18:48.996077 (+    50us) write_op.cc:312] APPLY: finished
0709 12:18:48.996583 (+   506us) log.cc:844] Serialized 236 byte log entry
0709 12:18:48.996757 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:48.996989 (+   232us) write_op.cc:454] Released schema lock
0709 12:18:48.997059 (+    70us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:49.004749 (+  7690us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:49.004786 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49736,"reported_tablets":33,"spinlock_wait_cycles":9600,"child_traces":[["op",{"apply.queue_time_us":177318,"apply.run_cpu_time_us":31550,"apply.run_wall_time_us":158663,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117149,"num_ops":27,"prepare.queue_time_us":64576,"prepare.run_cpu_time_us":6746,"prepare.run_wall_time_us":185460,"replication_time_us":71692,"thread_start_us":203317,"threads_started":2}]]}
I20260709 12:18:49.064138 24592 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:49.065785 29239 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:49.073907 23987 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:49.076556 29341 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:49.138366 24066 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:49.152016 24066 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:49.152652 29239 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:49.162416 29341 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:18:49.257367 23806 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet def9be339f8f4adc820a6a1320fec425 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica ef0dd15ac654478b8371c22b8909240e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:49.260035 23816 catalog_manager.cc:5697] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 5 to 7, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 7 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:49.312621 23916 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:49.315407 29349 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:49.378409 23987 raft_consensus.cc:1275] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:18:49.380815 29345 consensus_queue.cc:1048] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:49.752382 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 68973.7us
W20260709 12:18:49.759322 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 81386.7us
I20260709 12:18:49.759589 23813 catalog_manager.cc:5697] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 7 to 13, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:49.766805 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 79652.1us
I20260709 12:18:49.771775 23813 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 10 to 11, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 11 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:49.773113 23813 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 13 to 15, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 15 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:49.774116 23813 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:49.879899 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:49.880972 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 184259us
W20260709 12:18:49.940104 23816 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39282 (request call id 310) took 50560 ms (client timeout 15000 ms). Trace:
W20260709 12:18:49.948220 23816 rpcz_store.cc:269] 0709 12:17:59.380064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.385749 (+  5685us) service_pool.cc:224] Handling call
0709 12:18:00.091183 (+705434us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54002e4354. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbc090 00007f75c0c5af3a 00007f75c6a10e9c 00007f75c6b0f04e 00007f75c4fd02a4 00007f75c4fd0232 00007f75c4fd0161 00007f75c4fd00dc 00007f75c4fcf392 00007f75bef8d48c 00007f75bef8c8c6
0709 12:18:49.940007 (+49848824us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:49.318121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:49.318743 (+   622us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:49.318802 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:18:49.318820 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:49.319180 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:49.319271 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:49.319301 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:49.319491 (+   190us) tablet.cc:701] Row locks acquired
0709 12:18:49.319511 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:18:49.319657 (+   146us) write_op.cc:270] Start()
0709 12:18:49.319771 (+   114us) write_op.cc:276] Timestamp: P: 1783599529319606 usec, L: 0
0709 12:18:49.319794 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:18:49.320567 (+   773us) log.cc:844] Serialized 535 byte log entry
0709 12:18:49.562783 (+242216us) op_driver.cc:464] REPLICATION: finished
0709 12:18:49.688127 (+125344us) write_op.cc:301] APPLY: starting
0709 12:18:49.688210 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:49.689243 (+  1033us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:49.689347 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:49.690019 (+   672us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:49.690190 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:18:49.690238 (+    48us) write_op.cc:312] APPLY: finished
0709 12:18:49.701587 (+ 11349us) log.cc:844] Serialized 25 byte log entry
0709 12:18:49.701778 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:49.701869 (+    91us) write_op.cc:454] Released schema lock
0709 12:18:49.701908 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:49.763476 (+ 61568us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:49.764484 (+  1008us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49177,"reported_tablets":49,"spinlock_wait_cycles":358203136,"child_traces":[["op",{"apply.queue_time_us":125059,"apply.run_cpu_time_us":3145,"apply.run_wall_time_us":61053,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8313,"num_ops":1,"prepare.queue_time_us":21922,"prepare.run_cpu_time_us":2784,"prepare.run_wall_time_us":33837,"replication_time_us":242831,"spinlock_wait_cycles":1792,"thread_start_us":109044,"threads_started":2}]]}
I20260709 12:18:50.037335 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:50.037976 23993 raft_consensus.cc:606] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:50.040732 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:50.041289 23993 raft_consensus.cc:606] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:50.041612 23993 raft_consensus.cc:614] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:50.048209 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:50.048882 23993 raft_consensus.cc:606] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:50.055096 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:50.055639 23993 raft_consensus.cc:606] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:50.047362 23817 catalog_manager.cc:5697] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:50.066435 23993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:50.067181 23993 raft_consensus.cc:606] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:50.068682 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:50.073222 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:50.075346 29382 raft_consensus.cc:993] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:50.077955 29382 raft_consensus.cc:1081] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:50.080308 24597 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37694
I20260709 12:18:50.080873 24597 raft_consensus.cc:493] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:50.081225 24597 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.083143 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:50.088387 23813 catalog_manager.cc:5697] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:50.094552 24597 raft_consensus.cc:515] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:50.116173 29391 raft_consensus.cc:993] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:50.117606 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:50.118247 23916 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.117605 29323 raft_consensus.cc:1081] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:50.123127 24599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37694
I20260709 12:18:50.123871 24599 raft_consensus.cc:493] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:50.124276 24599 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:50.126777 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db9cea3b8f64883a51327db383cd13e" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:50.127372 23993 raft_consensus.cc:3055] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:50.127652 23993 raft_consensus.cc:740] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:50.130214 23916 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 16.
I20260709 12:18:50.122849 24597 leader_election.cc:290] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:50.128612 23993 consensus_queue.cc:260] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:50.131623 24564 leader_election.cc:304] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:50.136430 23993 raft_consensus.cc:3060] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.141664 23993 raft_consensus.cc:2468] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 16.
I20260709 12:18:50.143540 29380 raft_consensus.cc:2804] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:50.144150 29380 raft_consensus.cc:697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 16 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:50.145177 29380 consensus_queue.cc:237] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:50.142630 24599 raft_consensus.cc:515] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:50.185928 23817 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39282 (request call id 311) took 29819 ms (client timeout 15000 ms). Trace:
I20260709 12:18:50.191267 29382 raft_consensus.cc:993] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:50.191776 29382 raft_consensus.cc:1081] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:50.193533 24599 leader_election.cc:290] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:50.193984 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:50.194579 23913 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:50.198549 24065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:18:50.199121 24065 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:50.199648 24065 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.202920 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:50.203491 23993 raft_consensus.cc:3055] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:50.203771 23993 raft_consensus.cc:740] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:50.204128 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe5bb4f2e9f04fbb9241a5e24d5ae777" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:50.204957 24066 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:50.206108 23913 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 17.
I20260709 12:18:50.204528 23993 consensus_queue.cc:260] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:50.209470 23993 raft_consensus.cc:3060] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:50.210067 24065 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:50.186810 23817 rpcz_store.cc:269] 0709 12:18:20.366935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.368360 (+  1425us) service_pool.cc:224] Handling call
0709 12:18:50.086382 (+29718022us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.086420 (+    38us) write_op.cc:454] Released schema lock
0709 12:18:50.185853 (+ 99433us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:50.066799 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:50.067378 (+   579us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:50.067414 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:18:50.067433 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:50.067797 (+   364us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:50.067851 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:50.067878 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:50.068074 (+   196us) tablet.cc:701] Row locks acquired
0709 12:18:50.068093 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:18:50.068262 (+   169us) write_op.cc:270] Start()
0709 12:18:50.068378 (+   116us) write_op.cc:276] Timestamp: P: 1783599530068203 usec, L: 0
0709 12:18:50.068411 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:18:50.069017 (+   606us) log.cc:844] Serialized 535 byte log entry
0709 12:18:50.070946 (+  1929us) op_driver.cc:464] REPLICATION: finished
0709 12:18:50.071284 (+   338us) write_op.cc:301] APPLY: starting
0709 12:18:50.071367 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:50.072135 (+   768us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:50.072222 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:50.072887 (+   665us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:50.073045 (+   158us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:18:50.073089 (+    44us) write_op.cc:312] APPLY: finished
0709 12:18:50.073269 (+   180us) log.cc:844] Serialized 25 byte log entry
0709 12:18:50.073408 (+   139us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.073491 (+    83us) write_op.cc:454] Released schema lock
0709 12:18:50.073527 (+    36us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":114,"apply.run_cpu_time_us":2506,"apply.run_wall_time_us":2506,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4186,"num_ops":1,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":2489,"prepare.run_wall_time_us":2489,"replication_time_us":2392}]]}
I20260709 12:18:50.219924 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:50.220543 23913 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.222350 23993 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 17.
I20260709 12:18:50.223510 24566 leader_election.cc:304] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:50.224973 24065 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:50.225819 23812 catalog_manager.cc:5697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 8 to 10, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 10 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.229300 23913 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:50.230090 29281 raft_consensus.cc:2804] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:50.227808 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccf053e06f514bffaa9c442a8ea2c144" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:50.230584 24034 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:50.230690 29281 raft_consensus.cc:697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 17 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:50.235690 24066 raft_consensus.cc:2468] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 17.
I20260709 12:18:50.236492 29389 raft_consensus.cc:2804] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:50.236629 29281 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:50.239094 29389 raft_consensus.cc:697] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:50.240075 29389 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:50.236943 23993 raft_consensus.cc:3055] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:50.269958 23993 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:50.264869 23817 catalog_manager.cc:5697] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 15 to 16, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 16 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.270731 23993 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:50.275949 23993 raft_consensus.cc:3060] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:50.280190 23812 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 13 to 14, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 14 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.285255 23812 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 11 to 13, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 13 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.301070 23993 raft_consensus.cc:2468] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:50.302093 23812 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 11 to 12, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 12 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.305022 23812 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 14 to 16, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 16 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.307449 23812 catalog_manager.cc:5697] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.333395 23812 catalog_manager.cc:5697] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 7 to 16, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 16 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.351608 23812 catalog_manager.cc:5697] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 11 to 13, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.354142 23812 catalog_manager.cc:5697] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 9 to 11, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.369182 29391 raft_consensus.cc:993] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:50.374210 29391 raft_consensus.cc:1081] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:50.382527 24066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:18:50.383030 24066 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:50.383363 24066 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:50.399502 24066 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:50.402464 23913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:50.402938 23913 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:50.405335 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:50.405982 23993 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:18:50.406297 23993 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:50.407029 23993 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:50.408118 23993 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:50.408967 23913 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 18.
I20260709 12:18:50.372854 23812 catalog_manager.cc:5697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.410574 24066 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:50.410333 24034 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:50.411597 29388 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:18:50.412869 29388 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:50.413688 29388 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:50.415449 23993 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 18.
I20260709 12:18:50.495805 23817 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 16 to 17, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 17 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:50.521917 23811 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.532920 23811 catalog_manager.cc:5697] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.564286 23811 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 11 to 12, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 12 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:50.572167 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 10cd478aa7e9411bba254e94713f91de with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:59384
I20260709 12:18:50.573273 23812 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39310 (request call id 315) took 9196 ms. Trace:
I20260709 12:18:50.582828 23913 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:18:50.584446 29338 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:50.639153 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 10cd478aa7e9411bba254e94713f91de (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:50.573817 23812 rpcz_store.cc:276] 0709 12:18:41.376534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.376832 (+   298us) service_pool.cc:224] Handling call
0709 12:18:50.573183 (+9196351us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:50.430133 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:50.430915 (+   782us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:50.430974 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:18:50.431004 (+    30us) tablet.cc:662] Decoding operations
0709 12:18:50.432407 (+  1403us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:50.432488 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:50.432539 (+    51us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:18:50.433482 (+   943us) tablet.cc:701] Row locks acquired
0709 12:18:50.434811 (+  1329us) write_op.cc:260] PREPARE: finished
0709 12:18:50.434973 (+   162us) write_op.cc:270] Start()
0709 12:18:50.435099 (+   126us) write_op.cc:276] Timestamp: P: 1783599530434923 usec, L: 0
0709 12:18:50.435117 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:18:50.436273 (+  1156us) log.cc:844] Serialized 3974 byte log entry
0709 12:18:50.439968 (+  3695us) op_driver.cc:464] REPLICATION: finished
0709 12:18:50.440573 (+   605us) write_op.cc:301] APPLY: starting
0709 12:18:50.440675 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:50.445876 (+  5201us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:50.445966 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:50.461209 (+ 15243us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:50.461428 (+   219us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:18:50.461476 (+    48us) write_op.cc:312] APPLY: finished
0709 12:18:50.461798 (+   322us) log.cc:844] Serialized 97 byte log entry
0709 12:18:50.461981 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.462129 (+   148us) write_op.cc:454] Released schema lock
0709 12:18:50.462178 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:50.466556 (+  4378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.466587 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":682834,"reported_tablets":50,"spinlock_wait_cycles":1654016,"child_traces":[["op",{"apply.queue_time_us":165,"apply.run_cpu_time_us":12413,"apply.run_wall_time_us":25944,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41860,"num_ops":10,"prepare.queue_time_us":5083,"prepare.run_cpu_time_us":4809,"prepare.run_wall_time_us":6495,"replication_time_us":4702}]]}
I20260709 12:18:50.698467 23989 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:50.703675 29370 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:50.731602 23989 raft_consensus.cc:1275] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:18:50.750788 29368 consensus_queue.cc:1048] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:50.753968 24066 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:50.768400 29380 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:50.775014 23991 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:18:50.786178 29380 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:50.853394 23916 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:18:50.980073 23913 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:18:50.981892 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 59891.6us
I20260709 12:18:50.984190 23918 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:51.017359 23811 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39282 (request call id 312) took 8269 ms. Trace:
I20260709 12:18:51.023196 29368 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 12:18:51.031567 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 164817us
I20260709 12:18:51.069204 29416 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:51.073179 29418 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:51.139348 23989 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:18:51.147580 29345 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:51.017935 23811 rpcz_store.cc:276] 0709 12:18:42.756573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.781703 (+ 25130us) service_pool.cc:224] Handling call
0709 12:18:50.638222 (+7856519us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.638344 (+   122us) write_op.cc:454] Released schema lock
0709 12:18:51.017141 (+378797us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:50.578421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:50.578964 (+   543us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:50.579002 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:18:50.579019 (+    17us) tablet.cc:662] Decoding operations
0709 12:18:50.579513 (+   494us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:50.579570 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:50.579596 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:18:50.579918 (+   322us) tablet.cc:701] Row locks acquired
0709 12:18:50.579938 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:18:50.580080 (+   142us) write_op.cc:270] Start()
0709 12:18:50.580187 (+   107us) write_op.cc:276] Timestamp: P: 1783599530580039 usec, L: 0
0709 12:18:50.580207 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:18:50.580811 (+   604us) log.cc:844] Serialized 1299 byte log entry
0709 12:18:50.582706 (+  1895us) op_driver.cc:464] REPLICATION: finished
0709 12:18:50.583253 (+   547us) write_op.cc:301] APPLY: starting
0709 12:18:50.583347 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:50.585039 (+  1692us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:50.585121 (+    82us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:50.586949 (+  1828us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:50.587177 (+   228us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:18:50.587244 (+    67us) write_op.cc:312] APPLY: finished
0709 12:18:50.587479 (+   235us) log.cc:844] Serialized 41 byte log entry
0709 12:18:50.588525 (+  1046us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:50.588614 (+    89us) write_op.cc:454] Released schema lock
0709 12:18:50.588652 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":88923,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":309,"apply.run_cpu_time_us":4821,"apply.run_wall_time_us":5714,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12558,"num_ops":3,"prepare.queue_time_us":9530,"prepare.run_cpu_time_us":2643,"prepare.run_wall_time_us":2648,"replication_time_us":2403,"spinlock_wait_cycles":2304}]]}
I20260709 12:18:51.206302 23810 catalog_manager.cc:5697] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 13 to 14, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 14 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.223577 23810 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.225720 23810 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.279271 23810 catalog_manager.cc:5697] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.282169 23810 catalog_manager.cc:5697] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.287487 23810 catalog_manager.cc:5697] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:51.297254 23810 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 16 to 17, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 17 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.301582 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 10cd478aa7e9411bba254e94713f91de with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:59384
W20260709 12:18:51.323148 23814 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39310 (request call id 313) took 47898 ms (client timeout 15000 ms). Trace:
W20260709 12:18:51.323753 23814 rpcz_store.cc:269] 0709 12:18:03.425017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.425311 (+   294us) service_pool.cc:224] Handling call
0709 12:18:51.322918 (+47897607us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266614,"reported_tablets":50}
I20260709 12:18:51.324714 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 10cd478aa7e9411bba254e94713f91de (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:51.347412 23810 catalog_manager.cc:5697] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.350137 23810 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 12 to 13, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:51.354750 24065 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:51.389194 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:51.399842 23994 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:51.405310 24599 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:18:51.407401 23810 catalog_manager.cc:5697] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 14 to 16, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 16 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.409677 29345 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:51.422223 29416 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:51.544343 29416 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 4 to 12, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:51.547709 24599 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 4 to 12, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:51.602532 23994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0740227aa014467da8e8269927b1cfda"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:51.603345 23994 raft_consensus.cc:606] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:51.604019 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet def9be339f8f4adc820a6a1320fec425 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 12:18:51.612460 23994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:51.613411 23994 raft_consensus.cc:606] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:51.613782 23994 raft_consensus.cc:614] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:51.661551 23994 raft_consensus.cc:2955] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 4 to 12, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:51.721083 23916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:34020
I20260709 12:18:51.722105 23916 raft_consensus.cc:606] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:51.733834 23994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:51.734493 23994 raft_consensus.cc:606] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:51.737527 23917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:34020
I20260709 12:18:51.738108 23917 raft_consensus.cc:606] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:51.739631 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:51.741078 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:51.742549 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:51.818451 29411 raft_consensus.cc:993] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:51.818965 29411 raft_consensus.cc:1081] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:51.821421 24066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0740227aa014467da8e8269927b1cfda"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:18:51.822001 24066 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.822347 24066 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:51.882392 24066 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:51.895972 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:51.896641 23916 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:51.901080 29323 raft_consensus.cc:993] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:51.901577 29323 raft_consensus.cc:1081] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:51.908900 24065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:18:51.909488 24065 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:51.909847 24065 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:51.924386 23916 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:51.925535 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:51.926146 23994 raft_consensus.cc:3055] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:51.926465 23994 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:51.926401 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:51.927423 29418 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:51.927382 23994 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:51.928036 29418 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:51.928555 23994 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:51.928987 29418 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:51.921856 24066 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:51.940699 24599 consensus_queue.cc:237] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:51.948951 23994 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:18:51.988896 24065 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:51.991351 23817 catalog_manager.cc:5697] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 4 to 12, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:51.994994 24065 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:52.002362 23810 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39296 (request call id 310) took 5033 ms. Trace:
I20260709 12:18:52.005082 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:52.006356 23989 raft_consensus.cc:3055] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:52.006657 23989 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:52.013700 23989 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:52.015204 23989 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:52.040628 23994 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:18:52.046367 29338 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:52.064256 23811 catalog_manager.cc:5697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 10 to 11, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 11 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:52.089560 23989 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
W20260709 12:18:52.097018 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 59542.9us
I20260709 12:18:52.108605 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 10cd478aa7e9411bba254e94713f91de with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 9)) from {username='slave'} at 127.0.0.1:59384
I20260709 12:18:52.003182 23810 rpcz_store.cc:276] 0709 12:18:46.980945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.981273 (+   328us) service_pool.cc:224] Handling call
0709 12:18:52.002238 (+5020965us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:51.559073 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:51.559757 (+   684us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:51.559802 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:18:51.559820 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:51.560850 (+  1030us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:51.560953 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:51.560982 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:18:51.561855 (+   873us) tablet.cc:701] Row locks acquired
0709 12:18:51.561905 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:18:51.562063 (+   158us) write_op.cc:270] Start()
0709 12:18:51.562201 (+   138us) write_op.cc:276] Timestamp: P: 1783599531562003 usec, L: 0
0709 12:18:51.562240 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:18:51.562912 (+   672us) log.cc:844] Serialized 3970 byte log entry
0709 12:18:51.721379 (+158467us) op_driver.cc:464] REPLICATION: finished
0709 12:18:51.754516 (+ 33137us) write_op.cc:301] APPLY: starting
0709 12:18:51.754612 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:51.776345 (+ 21733us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:51.776459 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:51.801308 (+ 24849us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:51.801654 (+   346us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:18:51.801712 (+    58us) write_op.cc:312] APPLY: finished
0709 12:18:51.802061 (+   349us) log.cc:844] Serialized 97 byte log entry
0709 12:18:51.807537 (+  5476us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.807668 (+   131us) write_op.cc:454] Released schema lock
0709 12:18:51.807735 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:51.831595 (+ 23860us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:51.831627 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":83398,"reported_tablets":48,"spinlock_wait_cycles":25472,"child_traces":[["op",{"apply.queue_time_us":32875,"apply.run_cpu_time_us":13878,"apply.run_wall_time_us":76978,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45987,"num_ops":10,"prepare.queue_time_us":12740,"prepare.run_cpu_time_us":4220,"prepare.run_wall_time_us":5178,"replication_time_us":158948,"thread_start_us":32363,"threads_started":2}]]}
I20260709 12:18:52.089593 23811 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 15 to 16, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 16 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.146543 24036 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:52.147997 29414 raft_consensus.cc:2804] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:52.148521 29414 raft_consensus.cc:697] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:52.148092 29434 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 8 to 14, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:52.149399 29414 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:18:52.155149 23815 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39310 (request call id 314) took 30654 ms (client timeout 15000 ms). Trace:
W20260709 12:18:52.155683 23815 rpcz_store.cc:269] 0709 12:18:21.500308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.500503 (+   195us) service_pool.cc:224] Handling call
0709 12:18:52.154888 (+30654385us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52533,"reported_tablets":50}
I20260709 12:18:52.148836 23811 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 17 to 18, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 18 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.170696 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 10cd478aa7e9411bba254e94713f91de (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:52.171132 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "432ae242d4354d208df9f37d432ef3f7" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:52.171720 23916 raft_consensus.cc:3060] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:52.183149 23811 catalog_manager.cc:5697] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 13 to 14, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 14 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.186429 23917 raft_consensus.cc:1275] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:18:52.190338 23916 raft_consensus.cc:2468] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:18:52.190148 23989 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 8 to 14, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:52.206146 29338 consensus_queue.cc:1048] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260709 12:18:52.187354 23811 catalog_manager.cc:5697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 13 to 15, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 15 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:52.246330 23805 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:52.250814 29239 raft_consensus.cc:993] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:52.255625 29239 raft_consensus.cc:1081] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:52.265084 24063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57828
I20260709 12:18:52.265666 24063 raft_consensus.cc:493] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:52.266012 24063 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:52.270968 23811 catalog_manager.cc:5697] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 15 to 18, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 18 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.279021 23811 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 17 to 18, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 18 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:52.301540 29443 raft_consensus.cc:993] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:52.302099 29443 raft_consensus.cc:1081] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:52.303814 24594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37708
I20260709 12:18:52.304351 24594 raft_consensus.cc:493] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:52.304699 24594 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:52.309453 24063 raft_consensus.cc:515] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:52.311358 24594 raft_consensus.cc:515] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:52.316615 24063 leader_election.cc:290] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:52.310422 23916 raft_consensus.cc:2955] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 8 to 14, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:52.317579 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:52.318444 23989 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:52.322646 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet def9be339f8f4adc820a6a1320fec425 with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:34022
I20260709 12:18:52.353029 29448 tablet_replica.cc:333] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:18:52.354331 29448 raft_consensus.cc:2243] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.394088 24594 leader_election.cc:290] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:52.396240 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:52.396898 23918 raft_consensus.cc:3055] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:52.397186 23918 raft_consensus.cc:740] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:52.397992 23918 consensus_queue.cc:260] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:52.399678 23918 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:52.402248 29448 raft_consensus.cc:2272] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.406885 23815 catalog_manager.cc:5697] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 8 to 14, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 17 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.414790 29448 ts_tablet_manager.cc:1916] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:52.417011 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a0df8b4c2674e279e8740ab00a67267" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:52.337903 23921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2e07822f804c3c9a8ff2c0177d5d72" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:52.451297 23994 raft_consensus.cc:3060] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:52.451388 23921 raft_consensus.cc:3055] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:18:52.451866 23921 raft_consensus.cc:740] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:52.452642 23921 consensus_queue.cc:260] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:52.453954 23921 raft_consensus.cc:3060] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:18:52.428510 23918 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:52.455291 24564 leader_election.cc:304] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:18:52.458020 29434 raft_consensus.cc:2804] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:52.458526 29434 raft_consensus.cc:697] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:52.459296 29434 consensus_queue.cc:237] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:52.444196 23811 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet def9be339f8f4adc820a6a1320fec425 with cas_config_opid_index 4: aborting the task: latest config opid_index 12; task opid_index 4
I20260709 12:18:52.465055 23811 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39310 (request call id 316) took 1169 ms. Trace:
I20260709 12:18:52.465809 23811 rpcz_store.cc:276] 0709 12:18:51.296046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.296198 (+   152us) service_pool.cc:224] Handling call
0709 12:18:52.464962 (+1168764us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:52.331666 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:52.332247 (+   581us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:52.332278 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:18:52.332297 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:52.333267 (+   970us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:52.333329 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:52.333363 (+    34us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:18:52.334001 (+   638us) tablet.cc:701] Row locks acquired
0709 12:18:52.334022 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:52.334169 (+   147us) write_op.cc:270] Start()
0709 12:18:52.334298 (+   129us) write_op.cc:276] Timestamp: P: 1783599532334129 usec, L: 0
0709 12:18:52.334325 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:18:52.337708 (+  3383us) log.cc:844] Serialized 2828 byte log entry
0709 12:18:52.354844 (+ 17136us) op_driver.cc:464] REPLICATION: finished
0709 12:18:52.355292 (+   448us) write_op.cc:301] APPLY: starting
0709 12:18:52.355386 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:52.362977 (+  7591us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:52.363119 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:52.380962 (+ 17843us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:52.381204 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 12:18:52.381264 (+    60us) write_op.cc:312] APPLY: finished
0709 12:18:52.381557 (+   293us) log.cc:844] Serialized 73 byte log entry
0709 12:18:52.381722 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:52.381845 (+   123us) write_op.cc:454] Released schema lock
0709 12:18:52.381900 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:52.427969 (+ 46069us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:52.428003 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17463,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":250,"apply.run_cpu_time_us":10580,"apply.run_wall_time_us":26975,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29302,"num_ops":7,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":3876,"prepare.run_wall_time_us":6349,"replication_time_us":17263}]]}
I20260709 12:18:52.478845 23921 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 19.
I20260709 12:18:52.488737 24034 leader_election.cc:304] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:52.490330 29445 raft_consensus.cc:2804] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:18:52.490803 29445 raft_consensus.cc:697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:52.491669 29445 consensus_queue.cc:237] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:52.510299 23921 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:52.514442 29414 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:52.472426 23994 raft_consensus.cc:2468] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:52.543757 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:59384
I20260709 12:18:52.544863 29441 tablet_replica.cc:333] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:18:52.546072 29441 raft_consensus.cc:2243] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:52.546793 29441 raft_consensus.cc:2272] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:52.550781 29441 ts_tablet_manager.cc:1916] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:52.562971 23989 raft_consensus.cc:2468] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 19.
I20260709 12:18:52.568177 23815 catalog_manager.cc:5697] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 11 to 12, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 12 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.594475 23993 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:18:52.595906 23918 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:52.596560 29414 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:52.601804 29345 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:52.679744 23990 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:52.685999 29414 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:52.684551 23811 catalog_manager.cc:5697] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 10 to 11, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.694839 23811 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 12 to 13, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.715487 23812 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39282 (request call id 313) took 1408 ms. Trace:
I20260709 12:18:52.715950 23812 rpcz_store.cc:276] 0709 12:18:51.307419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.307620 (+   201us) service_pool.cc:224] Handling call
0709 12:18:52.715340 (+1407720us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":34}
I20260709 12:18:52.813087 29441 ts_tablet_manager.cc:1929] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 12:18:52.813723 29441 log.cc:1199] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/fe5bb4f2e9f04fbb9241a5e24d5ae777
I20260709 12:18:52.815642 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:52.849984 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 8 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:59384
I20260709 12:18:52.859170 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet fe5bb4f2e9f04fbb9241a5e24d5ae777 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:52.884325 23810 catalog_manager.cc:5697] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 18 to 19, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 19 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:52.890187 23990 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:52.892653 29435 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:52.909986 23918 raft_consensus.cc:1275] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:52.911861 29435 consensus_queue.cc:1048] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:52.933722 23994 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:18:52.935550 29457 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:52.954571 29448 ts_tablet_manager.cc:1929] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 12:18:52.970662 29448 log.cc:1199] T def9be339f8f4adc820a6a1320fec425 P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/def9be339f8f4adc820a6a1320fec425
I20260709 12:18:52.976579 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet def9be339f8f4adc820a6a1320fec425 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:52.991166 23918 raft_consensus.cc:1275] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 19 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:18:52.992954 29457 consensus_queue.cc:1048] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:53.007226 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:53.330535 24067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0740227aa014467da8e8269927b1cfda"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:53.331185 24067 raft_consensus.cc:606] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:53.337711 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:34020
I20260709 12:18:53.344551 23921 raft_consensus.cc:606] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:53.366606 23921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:34020
I20260709 12:18:53.367292 23921 raft_consensus.cc:606] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:53.369045 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:53.370877 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:53.371608 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:53.498239 23989 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:18:53.550168 23918 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:18:53.551971 23961 consensus_peers.cc:597] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea2fd010d40d4400b7b9f1b9cca54a0c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:53.553151 24067 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:53.553320 29411 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:53.558133 29323 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:53.569631 29418 raft_consensus.cc:993] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:53.570175 29418 raft_consensus.cc:1081] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:53.575850 23918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0740227aa014467da8e8269927b1cfda"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:18:53.576500 23918 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.576861 23918 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:53.591679 23918 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:53.602563 23989 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:53.607841 29410 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:53.612527 23917 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:53.655099 23989 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:53.671563 24066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:53.672323 24066 raft_consensus.cc:3055] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:53.672618 24066 raft_consensus.cc:740] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:53.673475 24066 consensus_queue.cc:260] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:53.676905 23918 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:53.679522 24066 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:53.713332 24066 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:53.720134 23812 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:53.741102 29442 raft_consensus.cc:993] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:53.801337 29442 raft_consensus.cc:1081] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:53.803401 24063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57828
I20260709 12:18:53.804021 24063 raft_consensus.cc:493] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.804375 24063 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:53.812053 24063 raft_consensus.cc:515] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:53.814832 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:53.815433 23918 raft_consensus.cc:3055] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:53.815739 23918 raft_consensus.cc:740] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:53.818570 23989 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 14.
I20260709 12:18:53.814896 23887 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:53.822080 24063 leader_election.cc:290] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:53.822983 23918 consensus_queue.cc:260] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:53.824334 23918 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:53.824597 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c59becc061884c78add6c7ec0be6583c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:53.825192 23994 raft_consensus.cc:3060] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:53.823598 29403 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:53.827853 24063 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:53.858680 23918 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:53.869562 23994 raft_consensus.cc:2468] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:53.873178 24036 leader_election.cc:304] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:53.878880 29418 raft_consensus.cc:2804] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:53.895094 29403 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:53.894414 29418 raft_consensus.cc:697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:53.920790 29418 consensus_queue.cc:237] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:53.928915 23990 raft_consensus.cc:1240] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Rejecting Update request from peer 0829ddf18f07439086398756b9c6d216 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:53.974643 29403 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:53.999626 29484 raft_consensus.cc:993] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:18:54.000757 29484 raft_consensus.cc:1081] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
W20260709 12:18:54.002254 23867 auto_rebalancer.cc:629] Failed to schedule move for tablet c59becc061884c78add6c7ec0be6583c: Illegal state: Replica 0829ddf18f07439086398756b9c6d216 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } }
I20260709 12:18:54.000420 23810 catalog_manager.cc:5697] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 11 to 12, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 12 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.007546 23918 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:18:54.010540 23994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:18:54.011361 23994 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:54.011880 23994 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:54.041661 23994 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:54.044209 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:54.044749 23915 raft_consensus.cc:3055] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:54.045008 23915 raft_consensus.cc:740] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:54.045682 23915 consensus_queue.cc:260] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:54.046782 23915 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:54.053929 23915 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
I20260709 12:18:54.055169 23960 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:54.056036 29479 raft_consensus.cc:2804] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:54.056540 29479 raft_consensus.cc:697] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:54.057400 29479 consensus_queue.cc:237] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:54.057914 23812 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 13 to 14, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 14 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:54.078217 23886 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 371c317c26eb44cd875c5925f4b31bd6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:54.088069 23994 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 17 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:54.097564 24066 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:54.098839 23994 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:54.098716 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:54.099432 24599 raft_consensus.cc:3060] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:54.104507 29403 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:54.162911 24599 raft_consensus.cc:2468] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
I20260709 12:18:54.170904 29494 ts_tablet_manager.cc:933] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:18:54.177804 29494 tablet_copy_client.cc:323] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.2:43801
I20260709 12:18:54.177202 23812 catalog_manager.cc:5697] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 16 to 17, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 17 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.180080 24006 tablet_copy_service.cc:140] P ef0dd15ac654478b8371c22b8909240e: Received BeginTabletCopySession request for tablet ea2fd010d40d4400b7b9f1b9cca54a0c from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:60542)
I20260709 12:18:54.180611 24006 tablet_copy_service.cc:161] P ef0dd15ac654478b8371c22b8909240e: Beginning new tablet copy session on tablet ea2fd010d40d4400b7b9f1b9cca54a0c from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:60542: session id = 71a48f59ff764d249519c6a53ec57f02-ea2fd010d40d4400b7b9f1b9cca54a0c
W20260709 12:18:54.187497 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 73216.6us
I20260709 12:18:54.191422 29482 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:54.192144 24006 tablet_copy_source_session.cc:215] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:54.217176 29494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea2fd010d40d4400b7b9f1b9cca54a0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:54.258466 29494 tablet_copy_client.cc:806] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:54.262440 29494 tablet_copy_client.cc:670] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:54.268532 29494 tablet_copy_client.cc:538] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:54.273825 29482 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:54.289956 23989 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:54.303476 24066 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:54.312714 24063 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:18:54.315816 23812 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 10, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 14 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:54.321009 29494 tablet_bootstrap.cc:492] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:18:54.360958 23917 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:54.361352 23994 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:18:54.362375 29487 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:18:54.363400 24035 consensus_peers.cc:597] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04e684c6cc9c44a496daa6c45678df59. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:54.366475 29487 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:54.429579 29489 raft_consensus.cc:2955] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:54.431550 23917 raft_consensus.cc:2955] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:54.442930 23989 raft_consensus.cc:2955] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Committing config change with OpId 18.11: config changed from index -1 to 11, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:54.457485 24067 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:54.460266 29482 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:54.467962 23811 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 11, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 18 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:18:54.484246 23918 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:18:54.486960 29479 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:18:54.495326 24599 raft_consensus.cc:1275] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:18:54.496596 29323 consensus_queue.cc:1048] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:18:54.501096 23915 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:18:54.504479 29487 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:54.514235 23989 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:18:54.517510 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:54.558532 29494 tablet_bootstrap.cc:492] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:54.559638 29494 tablet_bootstrap.cc:492] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:18:54.560819 29494 ts_tablet_manager.cc:1403] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.240s	user 0.038s	sys 0.002s
I20260709 12:18:54.564035 29494 raft_consensus.cc:359] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:18:54.564909 29494 raft_consensus.cc:740] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:18:54.608155 29505 ts_tablet_manager.cc:933] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:18:54.550390 29403 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:18:54.565730 29494 consensus_queue.cc:260] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:18:54.710808 23989 raft_consensus.cc:1275] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:18:54.719795 29504 log.cc:927] Time spent T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:54.716506 29505 tablet_copy_client.cc:323] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:18:54.738772 29521 consensus_queue.cc:1048] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:18:54.788074 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 66649.6us
I20260709 12:18:54.821586 29494 ts_tablet_manager.cc:1434] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.260s	user 0.009s	sys 0.000s
W20260709 12:18:54.879324 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 57446.9us
W20260709 12:18:54.876127 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 132687us
W20260709 12:18:54.997344 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 52896.8us
I20260709 12:18:55.005652 23931 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 371c317c26eb44cd875c5925f4b31bd6 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:18:55.006289 23931 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 371c317c26eb44cd875c5925f4b31bd6 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-371c317c26eb44cd875c5925f4b31bd6
I20260709 12:18:55.007920 24066 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:55.008574 24066 raft_consensus.cc:606] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:55.020093 29506 raft_consensus.cc:993] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:18:55.020601 29506 raft_consensus.cc:1081] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:18:55.023985 23994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37420
I20260709 12:18:55.024583 23994 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.025008 23994 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:55.026937 23931 tablet_copy_source_session.cc:215] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:55.038169 23994 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:55.040180 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 301868us
I20260709 12:18:55.058816 23994 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:55.063123 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:55.063831 24067 raft_consensus.cc:3055] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:55.064091 24067 raft_consensus.cc:740] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:55.065120 24067 consensus_queue.cc:260] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:55.066867 24067 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:55.061057 24599 raft_consensus.cc:1217] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
I20260709 12:18:55.084719 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:55.085320 24599 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:55.116010 24599 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:55.124642 23961 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:55.140407 23988 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "368f96220d5b4469885774acf06e4475"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:55.141049 23988 raft_consensus.cc:606] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
W20260709 12:18:55.155340 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 258616us
W20260709 12:18:55.199278 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 47231.8us
I20260709 12:18:55.201555 29505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 371c317c26eb44cd875c5925f4b31bd6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:18:55.226692 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 130314us
I20260709 12:18:55.232992 24067 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:18:55.237751 23918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:34020
I20260709 12:18:55.238631 23918 raft_consensus.cc:606] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:55.241307 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:18:55.243017 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:55.243770 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:55.247855 29545 ts_tablet_manager.cc:933] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:18:55.299327 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 173177us
W20260709 12:18:55.358517 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 58473.2us
I20260709 12:18:55.314574 29522 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:55.371554 29522 raft_consensus.cc:697] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:55.372426 29522 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:55.375422 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 250772us
I20260709 12:18:55.383553 24006 tablet_copy_service.cc:342] P ef0dd15ac654478b8371c22b8909240e: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-ea2fd010d40d4400b7b9f1b9cca54a0c received from {username='slave'} at 127.0.0.1:60542
I20260709 12:18:55.392709 24006 tablet_copy_service.cc:434] P ef0dd15ac654478b8371c22b8909240e: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-ea2fd010d40d4400b7b9f1b9cca54a0c on tablet ea2fd010d40d4400b7b9f1b9cca54a0c with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:55.381111 29545 tablet_copy_client.cc:323] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:18:55.435382 29546 raft_consensus.cc:1064] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
W20260709 12:18:55.461544 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 52728.1us
I20260709 12:18:55.438025 29546 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:55.521659 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 47743us
I20260709 12:18:55.525432 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 04e684c6cc9c44a496daa6c45678df59 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:18:55.526083 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 04e684c6cc9c44a496daa6c45678df59 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-04e684c6cc9c44a496daa6c45678df59
I20260709 12:18:55.548133 29505 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:37708 (request call id 1361) took 1048 ms. Trace:
I20260709 12:18:55.548620 29505 rpcz_store.cc:276] 0709 12:18:54.499346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.499491 (+   145us) service_pool.cc:224] Handling call
0709 12:18:54.608632 (+109141us) ts_tablet_manager.cc:934] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
0709 12:18:55.200369 (+591737us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:18:55.260141 (+ 59772us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:55.260264 (+   123us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:18:55.507022 (+246758us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:18:55.519590 (+ 12568us) tablet_replica.cc:206] Creating consensus instance
0709 12:18:55.547995 (+ 28405us) ts_tablet_manager.cc:989] Replica registered.
0709 12:18:55.548056 (+    61us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":43036,"tablet-copy.queue_time_us":108042,"thread_start_us":148454,"threads_started":2}
I20260709 12:18:55.550242 29505 tablet_copy_client.cc:806] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:55.570541 29505 tablet_copy_client.cc:670] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:55.613021 24079 tablet_copy_source_session.cc:215] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:55.619812 29545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04e684c6cc9c44a496daa6c45678df59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:55.626654 29550 raft_consensus.cc:993] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:55.628569 29484 raft_consensus.cc:993] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:55.629076 29484 raft_consensus.cc:1081] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:18:55.643729 29551 raft_consensus.cc:1081] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:55.647969 24593 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37708
I20260709 12:18:55.648541 24593 raft_consensus.cc:493] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.648854 24593 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:55.651470 29505 tablet_copy_client.cc:538] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:55.663017 23915 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "368f96220d5b4469885774acf06e4475"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:18:55.663895 23915 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.670815 23915 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.684432 23815 catalog_manager.cc:5697] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 9 to 10, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 10 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:55.688027 23915 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:55.693449 23915 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:55.702759 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:55.703430 24063 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.720618 24593 raft_consensus.cc:515] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:55.723532 23993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:55.738703 23993 raft_consensus.cc:3055] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:55.739045 23993 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:55.739856 23993 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:55.741308 23993 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.744837 23915 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:55.749497 24063 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:55.756850 23915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:55.757433 23915 raft_consensus.cc:3055] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:55.757714 23915 raft_consensus.cc:740] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:55.758703 24593 leader_election.cc:290] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:18:55.762497 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 45541.8us
I20260709 12:18:55.762259 23915 consensus_queue.cc:260] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:55.763230 23887 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:55.764295 23915 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:55.765247 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "392f06df3ae54cb5a9746fdbb980ad3d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:55.765806 23992 raft_consensus.cc:3060] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:55.766475 24597 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:55.784813 23992 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:55.786013 24566 leader_election.cc:304] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:55.749249 29550 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:18:55.796900 23993 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 9.
I20260709 12:18:55.794797 29515 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:55.802093 29515 raft_consensus.cc:697] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:55.803098 29515 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:55.809048 29536 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:55.798447 29541 raft_consensus.cc:2804] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:55.814211 23915 raft_consensus.cc:2468] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:18:55.829164 29541 raft_consensus.cc:697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:18:55.836030 29541 consensus_queue.cc:237] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:55.840023 24597 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:55.861083 29535 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:55.843883 29545 tablet_copy_client.cc:806] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:55.839968 29505 tablet_bootstrap.cc:492] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:18:55.866923 29545 tablet_copy_client.cc:670] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:55.870337 24067 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:55.887029 29545 tablet_copy_client.cc:538] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:55.887684 24063 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:55.904377 29522 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:18:55.908425 29535 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:55.922644 29522 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:55.940158 23918 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:55.947238 24593 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:56.018776 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 47707.8us
I20260709 12:18:56.025100 23817 catalog_manager.cc:5697] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 11 to 12, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 12 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.072995 24070 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:56.083802 29545 tablet_bootstrap.cc:492] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:18:56.264421 23993 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:56.270117 29557 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:56.300733 29505 tablet_bootstrap.cc:492] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:56.301862 29505 tablet_bootstrap.cc:492] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:18:56.302668 29505 ts_tablet_manager.cc:1403] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.463s	user 0.042s	sys 0.012s
I20260709 12:18:56.281466 23810 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:56.305971 29505 raft_consensus.cc:359] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:18:56.306938 29505 raft_consensus.cc:740] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:18:56.307650 29505 consensus_queue.cc:260] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:18:56.309572 29505 ts_tablet_manager.cc:1434] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:18:56.311412 23931 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-371c317c26eb44cd875c5925f4b31bd6 received from {username='slave'} at 127.0.0.1:56870
I20260709 12:18:56.311821 23931 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-371c317c26eb44cd875c5925f4b31bd6 on tablet 371c317c26eb44cd875c5925f4b31bd6 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:56.330433 23992 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:18:56.332077 29538 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:56.366662 23996 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:56.338718 23815 catalog_manager.cc:5697] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 8 to 9, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 9 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.374538 24063 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:56.374538 24597 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:56.376233 29522 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:56.383039 29522 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:56.385768 29571 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:56.387836 24061 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:56.395846 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea2fd010d40d4400b7b9f1b9cca54a0c with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:56.395417 24597 raft_consensus.cc:2955] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:56.405385 24063 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:56.407111 29519 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:56.423470 23921 raft_consensus.cc:1275] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:18:56.426436 29538 consensus_queue.cc:1048] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:56.436627 23812 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 9 to 10, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 11 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:56.483310 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:56.487248 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet ea2fd010d40d4400b7b9f1b9cca54a0c with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:34022
I20260709 12:18:56.615064 23918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:34020
I20260709 12:18:56.615661 23918 raft_consensus.cc:606] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:56.617964 29519 raft_consensus.cc:993] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:56.618449 29519 raft_consensus.cc:1081] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:56.621572 29545 tablet_bootstrap.cc:492] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=2 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:56.624328 24061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57828
I20260709 12:18:56.624764 23991 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eac75053172041f285deb68d4418ed57"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:56.624890 24061 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.625340 23991 raft_consensus.cc:606] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:56.625324 24061 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:56.628791 29545 tablet_bootstrap.cc:492] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:18:56.629626 29545 ts_tablet_manager.cc:1403] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.579s	user 0.043s	sys 0.010s
I20260709 12:18:56.631094 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:56.631354 24597 raft_consensus.cc:1217] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 12:18:56.633208 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:56.633968 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:56.642005 29585 tablet_replica.cc:333] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:18:56.643513 29585 raft_consensus.cc:2243] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:56.645572 29585 raft_consensus.cc:2272] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:56.657117 29585 ts_tablet_manager.cc:1916] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:56.665510 24061 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:56.668191 23918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:18:56.668835 23918 raft_consensus.cc:3055] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:56.669158 23918 raft_consensus.cc:740] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:56.669945 23918 consensus_queue.cc:260] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:56.671161 23918 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:56.675750 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:56.676527 24597 raft_consensus.cc:3060] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:56.677831 23918 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:56.682368 24061 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:56.696173 29585 ts_tablet_manager.cc:1929] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:18:56.699281 29585 log.cc:1199] T ea2fd010d40d4400b7b9f1b9cca54a0c P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/ea2fd010d40d4400b7b9f1b9cca54a0c
I20260709 12:18:56.692454 29545 raft_consensus.cc:359] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:18:56.699224 24034 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:18:56.699833 29545 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:18:56.700539 29516 raft_consensus.cc:2804] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:56.701089 29516 raft_consensus.cc:697] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:56.702085 29516 consensus_queue.cc:237] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:56.704012 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet ea2fd010d40d4400b7b9f1b9cca54a0c (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:56.706560 24597 raft_consensus.cc:2468] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:18:56.714324 29545 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:18:56.719632 29545 ts_tablet_manager.cc:1434] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
I20260709 12:18:56.722250 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-04e684c6cc9c44a496daa6c45678df59 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:18:56.722702 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-04e684c6cc9c44a496daa6c45678df59 on tablet 04e684c6cc9c44a496daa6c45678df59 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:18:56.770635 23817 catalog_manager.cc:5697] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 11 to 12, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 12 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:56.928140 29571 raft_consensus.cc:993] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:56.928781 29571 raft_consensus.cc:1081] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:18:56.934012 24061 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eac75053172041f285deb68d4418ed57"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57842
I20260709 12:18:56.934577 24061 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:56.934947 24061 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:56.984256 24061 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:57.006331 24061 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:57.008941 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:57.014088 24597 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:57.017123 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eac75053172041f285deb68d4418ed57" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:57.017760 23992 raft_consensus.cc:3055] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:57.018066 23992 raft_consensus.cc:740] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:57.018795 23992 consensus_queue.cc:260] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:57.020080 23992 raft_consensus.cc:3060] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:57.027083 23992 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:57.035089 24036 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:57.038894 29528 raft_consensus.cc:2804] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:57.039662 29528 raft_consensus.cc:697] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:57.040606 29528 consensus_queue.cc:237] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:57.048249 24597 raft_consensus.cc:2468] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:18:57.100530 24597 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:57.102712 29528 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:57.103165 23817 catalog_manager.cc:5697] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 15 to 16, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 16 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.140909 23921 raft_consensus.cc:1275] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:57.143165 29514 consensus_queue.cc:1048] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:57.152086 24592 raft_consensus.cc:1217] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.10->[18.11-18.11]   Dedup: 18.11->[]
I20260709 12:18:57.164433 29557 raft_consensus.cc:1064] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:18:57.189697 29557 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:18:57.300029 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 44544us
I20260709 12:18:57.419792 24599 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:57.435743 29598 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:57.455570 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 45900.6us
I20260709 12:18:57.456851 23991 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:18:57.458726 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 47976.3us
I20260709 12:18:57.462062 24061 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:57.469831 24593 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:57.475459 29595 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:57.480268 29602 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:57.486305 29602 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:57.549327 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 83448.1us
W20260709 12:18:57.588675 29607 log.cc:927] Time spent T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:18:57.610544 23996 raft_consensus.cc:1275] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:18:57.631799 29596 consensus_queue.cc:1048] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:18:57.648367 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 73834.4us
I20260709 12:18:57.661973 29600 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:57.669555 24599 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:57.678081 29516 raft_consensus.cc:1064] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:18:57.681981 29516 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 9, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:57.716147 24063 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:57.745975 23817 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:57.754812 23996 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:57.784554 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 209354us
I20260709 12:18:57.925738 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:57.929629 24599 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 18 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:57.931741 23991 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:57.933842 29619 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:18:57.936120 29603 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:57.986079 29603 raft_consensus.cc:2955] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:57.993068 24599 raft_consensus.cc:2955] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:58.024695 23918 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:18:58.034919 23812 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 11 to 12, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:58.045038 23918 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:58.061870 23991 raft_consensus.cc:2955] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 11 to 12, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:58.106505 24599 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:58.107883 23996 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:18:58.108377 29593 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:58.110459 29593 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:18:58.114042 24067 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:58.129999 29594 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:58.132036 24598 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:58.143927 24597 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:18:58.149768 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 371c317c26eb44cd875c5925f4b31bd6 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:58.161854 23992 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:18:58.165036 23810 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 11 to 12, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 14 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:58.160064 29516 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
W20260709 12:18:58.228345 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 49343.3us
W20260709 12:18:58.271126 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 60306.5us
I20260709 12:18:58.230489 29613 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:18:58.290153 24067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:58.291020 24067 raft_consensus.cc:606] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
W20260709 12:18:58.292910 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 74194.2us
W20260709 12:18:58.316809 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 56051.2us
I20260709 12:18:58.337332 24067 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:18:58.337994 24067 raft_consensus.cc:606] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:18:58.406189 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:58.408318 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:58.409147 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:58.418546 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet 371c317c26eb44cd875c5925f4b31bd6 with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:59384
I20260709 12:18:58.417410 29514 raft_consensus.cc:2955] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:58.436887 24598 raft_consensus.cc:2955] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:18:58.466432 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 137701us
W20260709 12:18:58.491911 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 157078us
W20260709 12:18:58.496490 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 164288us
I20260709 12:18:58.498427 23991 raft_consensus.cc:2955] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:58.503372 23812 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 12 to 13, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 18 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:58.492779 29647 tablet_replica.cc:333] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:18:58.538008 23992 raft_consensus.cc:2955] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:18:58.540030 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04e684c6cc9c44a496daa6c45678df59 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:18:58.546265 29647 raft_consensus.cc:2243] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:58.547240 29647 raft_consensus.cc:2272] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:58.568410 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet 04e684c6cc9c44a496daa6c45678df59 with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:34022
I20260709 12:18:58.566030 29647 ts_tablet_manager.cc:1916] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:58.595247 29648 tablet_replica.cc:333] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:18:58.596364 29648 raft_consensus.cc:2243] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:58.597080 29648 raft_consensus.cc:2272] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:58.608314 29648 ts_tablet_manager.cc:1916] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:58.638854 29648 ts_tablet_manager.cc:1929] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.11
I20260709 12:18:58.639288 29648 log.cc:1199] T 04e684c6cc9c44a496daa6c45678df59 P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/04e684c6cc9c44a496daa6c45678df59
I20260709 12:18:58.643482 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet 04e684c6cc9c44a496daa6c45678df59 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:58.643669 29647 ts_tablet_manager.cc:1929] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:18:58.644106 29647 log.cc:1199] T 371c317c26eb44cd875c5925f4b31bd6 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/371c317c26eb44cd875c5925f4b31bd6
I20260709 12:18:58.645761 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet 371c317c26eb44cd875c5925f4b31bd6 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:18:58.741618 29561 raft_consensus.cc:993] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:58.742199 29561 raft_consensus.cc:1081] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:58.744992 23917 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45136
I20260709 12:18:58.745503 23917 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.745834 23917 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:58.761248 23917 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:58.775960 23917 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 17 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:18:58.777530 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:18:58.778182 23992 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:58.784087 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:58.784685 24067 raft_consensus.cc:3055] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:18:58.784955 24067 raft_consensus.cc:740] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:58.785665 24067 consensus_queue.cc:260] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:58.786691 24067 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:58.789038 29516 raft_consensus.cc:993] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:18:58.789553 29516 raft_consensus.cc:1081] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:18:58.790144 23992 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 17.
I20260709 12:18:58.794694 23887 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:58.795787 29642 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:18:58.796538 29642 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 17 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:18:58.797369 29642 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:18:58.808487 23991 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37420
I20260709 12:18:58.809190 23991 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:58.809607 23991 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:58.814755 24067 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 17.
I20260709 12:18:58.827291 23812 catalog_manager.cc:5697] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 16 to 17, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 17 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:58.861677 23991 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:58.870769 23991 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Requested vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:18:58.872443 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:18:58.873036 24599 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:58.874912 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:18:58.876353 24065 raft_consensus.cc:3055] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:58.876704 24065 raft_consensus.cc:740] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:18:58.877633 24065 consensus_queue.cc:260] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:58.880851 24599 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:58.882266 23961 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:18:58.884938 29637 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:58.885490 29637 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:18:58.889264 24065 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:58.886981 29637 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:18:58.919245 24065 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
I20260709 12:18:58.951731 23812 catalog_manager.cc:5697] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 13 to 14, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 14 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:59.285981 23996 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:59.288502 29642 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:59.399679 24067 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:18:59.401971 29642 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:59.410355 24599 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:18:59.411836 29535 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:18:59.482257 24067 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:18:59.485055 29522 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:18:59.601881 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:59.606519 29658 log.cc:927] Time spent T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.059s	user 0.000s	sys 0.002s
I20260709 12:18:59.739800 23916 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:34020
I20260709 12:18:59.740455 23916 raft_consensus.cc:606] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:18:59.758757 23992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:18:59.759387 23992 raft_consensus.cc:606] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:18:59.761263 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:18:59.762991 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:59.763715 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:59.860852 23918 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
W20260709 12:18:59.911681 23886 consensus_peers.cc:597] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c11fc035985e44dfa44a64cfba349977. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:59.914836 23996 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:59.918509 24067 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:18:59.923269 29598 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:59.925792 29598 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:59.979158 29633 raft_consensus.cc:993] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:59.979976 29633 raft_consensus.cc:1081] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:18:59.982781 23918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:18:59.983264 23918 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.983564 23918 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:18:59.998594 23918 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:00.002004 23918 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:00.015453 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:19:00.016103 24065 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:00.016343 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:19:00.016909 23996 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:00.017474 23996 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:19:00.016937 29665 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.018380 23996 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:00.021276 23996 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:00.026690 24065 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 18.
I20260709 12:19:00.044957 23812 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 13 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:00.040621 24067 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:00.066892 23992 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.078477 24065 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.086719 23887 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:00.088076 29642 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:00.088605 29642 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:19:00.089481 29652 raft_consensus.cc:993] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:19:00.089977 29652 raft_consensus.cc:1081] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:19:00.089516 29642 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:00.098995 24063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57828
I20260709 12:19:00.099602 24063 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:00.099944 24063 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.111466 23996 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 18.
W20260709 12:19:00.120337 24035 consensus_peers.cc:597] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1298b4797007440ca5cc586fd47928e8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:00.121706 23992 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:00.123961 29516 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:00.112138 24063 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:00.132504 23918 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:00.133301 23916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:19:00.133868 23916 raft_consensus.cc:3055] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:00.134176 23916 raft_consensus.cc:740] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:19:00.136284 23916 consensus_queue.cc:260] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:00.137152 23916 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.144556 23916 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:19:00.146394 24063 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:00.147334 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "675e57b981c1430ba502ba18c21dd0a4" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:00.160148 24597 raft_consensus.cc:3060] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.156675 29514 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:00.173991 24034 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:00.175956 29514 raft_consensus.cc:2804] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:00.176997 29514 raft_consensus.cc:697] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:00.178181 29514 consensus_queue.cc:237] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:00.184514 24597 raft_consensus.cc:2468] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:19:00.205343 29516 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.215718 23991 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.226650 23810 catalog_manager.cc:5697] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 10 to 11, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:00.226758 23815 catalog_manager.cc:5697] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 17 to 18, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 18 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:00.269068 23815 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 10, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.294176 23996 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:00.305496 23918 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.351459 24065 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:00.351987 23918 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:00.355515 29681 ts_tablet_manager.cc:933] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:19:00.354324 29535 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 12:19:00.363343 23961 consensus_peers.cc:597] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3aeb6bd2fca4ca5933e1f4a8ae01c71. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:00.363905 29677 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:00.375559 29681 tablet_copy_client.cc:323] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:19:00.377836 23931 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet c11fc035985e44dfa44a64cfba349977 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:19:00.378511 23931 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet c11fc035985e44dfa44a64cfba349977 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-c11fc035985e44dfa44a64cfba349977
I20260709 12:19:00.396929 29677 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.398840 24063 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.400079 23931 tablet_copy_source_session.cc:215] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:00.413749 29681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c11fc035985e44dfa44a64cfba349977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:00.419078 23918 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Committing config change with OpId 13.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.435503 23810 catalog_manager.cc:5697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.472416 24065 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:00.506507 29681 tablet_copy_client.cc:806] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:00.507227 29681 tablet_copy_client.cc:670] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:00.508354 23996 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:00.509562 23918 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:19:00.510087 24035 consensus_peers.cc:597] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2fb39e36ee084608a322a8fa84ccde2d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:00.511262 29681 tablet_copy_client.cc:538] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:00.518435 29673 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:00.520370 29673 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:00.521083 29681 tablet_bootstrap.cc:492] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:19:00.574821 29673 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.584683 23991 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.598990 23996 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:19:00.614223 29665 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:00.619544 23918 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Committing config change with OpId 11.7: config changed from index -1 to 7, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.650296 23915 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:00.659960 29679 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:00.669441 23810 catalog_manager.cc:5697] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 7, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:00.698755 24599 raft_consensus.cc:1275] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:00.708227 29514 consensus_queue.cc:1048] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:00.743271 29693 ts_tablet_manager.cc:933] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:00.769289 29693 tablet_copy_client.cc:323] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:19:00.776111 24067 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:19:00.796029 29666 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:00.809792 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 1298b4797007440ca5cc586fd47928e8 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:19:00.810539 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 1298b4797007440ca5cc586fd47928e8 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-1298b4797007440ca5cc586fd47928e8
W20260709 12:19:00.844553 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 57871.3us
I20260709 12:19:00.867236 29681 tablet_bootstrap.cc:492] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:00.868299 29681 tablet_bootstrap.cc:492] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:19:00.869028 29681 ts_tablet_manager.cc:1403] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.348s	user 0.027s	sys 0.032s
I20260709 12:19:00.876058 29681 raft_consensus.cc:359] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:00.880020 29681 raft_consensus.cc:740] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:19:00.880821 29681 consensus_queue.cc:260] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:00.882526 24079 tablet_copy_source_session.cc:215] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:00.883836 29681 ts_tablet_manager.cc:1434] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
W20260709 12:19:00.946251 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 108579us
I20260709 12:19:00.921758 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:00.998179 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 47952.9us
W20260709 12:19:01.038620 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 54264.9us
I20260709 12:19:01.055109 29693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1298b4797007440ca5cc586fd47928e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:01.059479 24599 raft_consensus.cc:1217] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:19:01.182826 29708 ts_tablet_manager.cc:933] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:01.213335 23931 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-c11fc035985e44dfa44a64cfba349977 received from {username='slave'} at 127.0.0.1:56870
I20260709 12:19:01.214129 23931 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-c11fc035985e44dfa44a64cfba349977 on tablet c11fc035985e44dfa44a64cfba349977 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:01.289464 29711 ts_tablet_manager.cc:933] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:01.345856 29708 tablet_copy_client.cc:323] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.2:43801
I20260709 12:19:01.348026 24006 tablet_copy_service.cc:140] P ef0dd15ac654478b8371c22b8909240e: Received BeginTabletCopySession request for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:60542)
I20260709 12:19:01.348598 24006 tablet_copy_service.cc:161] P ef0dd15ac654478b8371c22b8909240e: Beginning new tablet copy session on tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:60542: session id = 71a48f59ff764d249519c6a53ec57f02-e3aeb6bd2fca4ca5933e1f4a8ae01c71
I20260709 12:19:01.358647 29711 tablet_copy_client.cc:323] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:19:01.374795 24006 tablet_copy_source_session.cc:215] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:01.380251 29708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:01.389966 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 2fb39e36ee084608a322a8fa84ccde2d from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:19:01.390623 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 2fb39e36ee084608a322a8fa84ccde2d from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-2fb39e36ee084608a322a8fa84ccde2d
I20260709 12:19:01.403069 24079 tablet_copy_source_session.cc:215] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:01.416134 29693 tablet_copy_client.cc:806] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:01.416869 29693 tablet_copy_client.cc:670] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:01.420960 29711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2fb39e36ee084608a322a8fa84ccde2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:01.444149 29693 tablet_copy_client.cc:538] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:01.479485 29693 tablet_bootstrap.cc:492] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:19:01.481343 29711 tablet_copy_client.cc:806] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:01.490571 29705 raft_consensus.cc:1064] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:19:01.495649 29711 tablet_copy_client.cc:670] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:01.490947 29708 tablet_copy_client.cc:806] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:01.514127 29711 tablet_copy_client.cc:538] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:01.503752 29705 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:01.523332 29708 tablet_copy_client.cc:670] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:01.556329 29708 tablet_copy_client.cc:538] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:01.560141 29711 tablet_bootstrap.cc:492] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:19:01.571014 24061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:19:01.571813 24061 raft_consensus.cc:606] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:01.588155 23917 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:34020
I20260709 12:19:01.588757 23917 raft_consensus.cc:606] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Received request to transfer leadership to TS ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:01.589272 24065 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:01.587378 24593 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:01.593045 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:01.594758 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:01.595332 29707 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:01.595952 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:01.596103 23992 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:01.601395 29642 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:01.602659 29665 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:01.607439 29707 raft_consensus.cc:993] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: : Instructing follower ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:19:01.608016 29707 raft_consensus.cc:1081] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Signalling peer ef0dd15ac654478b8371c22b8909240e to start an election
I20260709 12:19:01.612310 23993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
 from {username='slave'} at 127.0.0.1:37418
I20260709 12:19:01.612926 23993 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:01.613441 23993 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:01.646312 23993 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:01.649137 23993 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:01.649832 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:19:01.650117 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:01.650664 23917 raft_consensus.cc:3055] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:01.650735 24599 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:01.651063 23917 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:19:01.651948 23917 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:01.653043 23917 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:01.665975 24599 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:19:01.667503 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:19:01.716813 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 49496.5us
I20260709 12:19:01.706904 24061 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:01.702093 29707 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:01.666224 29708 tablet_bootstrap.cc:492] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:19:01.722833 29633 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:01.723330 29633 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:19:01.724304 29633 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:01.727591 23917 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 10.
I20260709 12:19:01.754215 23992 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:01.811750 23810 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:19:01.940505 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 162368us
W20260709 12:19:02.096256 29719 log.cc:927] Time spent T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 12:19:02.098313 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 162895us
W20260709 12:19:02.102454 23961 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 134749us
W20260709 12:19:02.208343 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 64516.8us
W20260709 12:19:02.224247 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 71003.3us
I20260709 12:19:02.227911 23918 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:02.231034 29701 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:02.264424 29732 raft_consensus.cc:993] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:19:02.264973 29732 raft_consensus.cc:1081] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
W20260709 12:19:02.264986 29711 log.cc:927] Time spent T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:19:02.267571 23815 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 9 to 10, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 10 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:02.295789 24592 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:02.319638 29711 tablet_bootstrap.cc:492] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:02.320679 29711 tablet_bootstrap.cc:492] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:19:02.321412 29711 ts_tablet_manager.cc:1403] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.762s	user 0.029s	sys 0.037s
I20260709 12:19:02.330667 24599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37704
I20260709 12:19:02.331365 24599 raft_consensus.cc:493] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:02.331772 24599 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:19:02.338418 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 169609us
I20260709 12:19:02.370581 24599 raft_consensus.cc:515] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:02.376039 24599 leader_election.cc:290] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 19 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:02.381804 24595 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:02.384153 29677 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:19:02.398720 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 130639us
I20260709 12:19:02.389278 29711 raft_consensus.cc:359] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:02.402199 29711 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:19:02.445638 29711 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:02.448606 29711 ts_tablet_manager.cc:1434] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.127s	user 0.010s	sys 0.000s
I20260709 12:19:02.458441 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:19:02.460426 24065 raft_consensus.cc:3055] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:02.460726 24065 raft_consensus.cc:740] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:02.466208 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04e684c6cc9c44a496daa6c45678df59" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:19:02.466846 23988 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:02.475980 24065 consensus_queue.cc:260] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:02.479243 24065 raft_consensus.cc:3060] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:02.510161 23988 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 19.
I20260709 12:19:02.522686 24566 leader_election.cc:304] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:19:02.548655 29699 raft_consensus.cc:2804] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:02.549217 29699 raft_consensus.cc:697] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 19 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:19:02.550133 29699 consensus_queue.cc:237] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:02.567850 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-2fb39e36ee084608a322a8fa84ccde2d received from {username='slave'} at 127.0.0.1:42676
I20260709 12:19:02.568498 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-2fb39e36ee084608a322a8fa84ccde2d on tablet 2fb39e36ee084608a322a8fa84ccde2d with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:02.592146 29693 tablet_bootstrap.cc:492] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:02.609532 29693 tablet_bootstrap.cc:492] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:19:02.615069 29693 ts_tablet_manager.cc:1403] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 1.136s	user 0.049s	sys 0.015s
I20260709 12:19:02.616518 24065 raft_consensus.cc:2468] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 19.
I20260709 12:19:02.654014 24593 raft_consensus.cc:1217] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.6->[11.7-11.7]   Dedup: 11.7->[]
I20260709 12:19:02.647646 29693 raft_consensus.cc:359] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:02.661924 29693 raft_consensus.cc:740] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:19:02.662822 29693 consensus_queue.cc:260] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:02.680493 29693 ts_tablet_manager.cc:1434] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260709 12:19:02.682802 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-1298b4797007440ca5cc586fd47928e8 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:19:02.683236 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-1298b4797007440ca5cc586fd47928e8 on tablet 1298b4797007440ca5cc586fd47928e8 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:02.693022 23810 catalog_manager.cc:5697] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 18 to 19, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 19 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:02.711994 29708 tablet_bootstrap.cc:492] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:02.713109 29708 tablet_bootstrap.cc:492] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:19:02.714044 29708 ts_tablet_manager.cc:1403] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 1.048s	user 0.025s	sys 0.031s
I20260709 12:19:02.731662 23918 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:02.756539 24593 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:02.761293 29707 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:02.759099 29708 raft_consensus.cc:359] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:02.773114 24069 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:02.774065 29708 raft_consensus.cc:740] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:19:02.773172 29652 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:02.779433 29707 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:02.784574 24594 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:02.777009 29708 consensus_queue.cc:260] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:02.811514 29708 ts_tablet_manager.cc:1434] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.097s	user 0.002s	sys 0.006s
I20260709 12:19:02.820338 24006 tablet_copy_service.cc:342] P ef0dd15ac654478b8371c22b8909240e: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-e3aeb6bd2fca4ca5933e1f4a8ae01c71 received from {username='slave'} at 127.0.0.1:60542
I20260709 12:19:02.820843 24006 tablet_copy_service.cc:434] P ef0dd15ac654478b8371c22b8909240e: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-e3aeb6bd2fca4ca5933e1f4a8ae01c71 on tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:02.822764 23804 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c11fc035985e44dfa44a64cfba349977 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:02.832743 23810 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 9 to 10, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 13 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:02.848572 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet c11fc035985e44dfa44a64cfba349977 with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:58656
I20260709 12:19:02.856026 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:02.867439 24069 raft_consensus.cc:2955] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:02.868412 29757 tablet_replica.cc:333] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:02.872040 24594 raft_consensus.cc:1217] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 12:19:02.949656 23988 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:19:02.951905 29730 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:02.963673 23996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
mode: GRACEFUL
new_leader_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:35252
I20260709 12:19:02.964349 23996 raft_consensus.cc:606] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Received request to transfer leadership to TS 0829ddf18f07439086398756b9c6d216
I20260709 12:19:02.967394 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:02.969551 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:02.970361 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:03.015208 29757 raft_consensus.cc:2243] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:03.016201 29757 raft_consensus.cc:2272] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:03.017326 24065 raft_consensus.cc:1275] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:19:03.023339 29757 ts_tablet_manager.cc:1916] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:03.029572 29742 consensus_queue.cc:1048] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:03.084200 29729 raft_consensus.cc:993] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: : Instructing follower 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:19:03.084781 29729 raft_consensus.cc:1081] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Signalling peer 0829ddf18f07439086398756b9c6d216 to start an election
I20260709 12:19:03.091044 23918 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
 from {username='slave'} at 127.0.0.1:45120
I20260709 12:19:03.091526 23918 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:03.091807 23918 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:03.084789 29757 ts_tablet_manager.cc:1929] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 12:19:03.099009 29757 log.cc:1199] T c11fc035985e44dfa44a64cfba349977 P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/c11fc035985e44dfa44a64cfba349977
I20260709 12:19:03.101208 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet c11fc035985e44dfa44a64cfba349977 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:19:03.117003 23918 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:03.141101 23918 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:03.144188 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:19:03.144865 23996 raft_consensus.cc:3055] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:03.145172 23996 raft_consensus.cc:740] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:19:03.145961 23996 consensus_queue.cc:260] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:03.150954 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: true dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:03.151463 23996 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:03.151618 24593 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:03.164592 24593 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:19:03.173545 23886 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02; no voters: 
I20260709 12:19:03.174563 29705 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:03.176319 29705 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Becoming Leader. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:19:03.177320 29705 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:03.179050 23996 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0829ddf18f07439086398756b9c6d216 in term 11.
I20260709 12:19:03.193005 23810 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 reported cstate change: term changed from 10 to 11, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 0829ddf18f07439086398756b9c6d216 (127.22.48.1). New cstate: current_term: 11 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.234349 29696 raft_consensus.cc:1064] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:19:03.237206 29696 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 5, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:03.264588 24593 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:03.266333 29720 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:03.283018 23996 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:03.283285 24594 raft_consensus.cc:1217] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:19:03.282045 23913 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:03.285446 29745 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:03.287257 29745 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:03.372048 29696 raft_consensus.cc:1064] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:19:03.371663 23996 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.378615 29720 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.383189 29696 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:03.394990 24593 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.425239 23810 catalog_manager.cc:5697] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 7 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.472220 23913 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index 7 to 8, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.487241 24065 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:03.488818 24593 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:03.496968 29745 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:03.497329 24594 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:03.499253 23988 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:03.500191 29768 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:03.506352 29745 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:03.513270 24594 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.519625 29745 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.527918 23988 raft_consensus.cc:2955] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.556207 23996 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:03.558517 29696 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:03.560369 23913 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:03.566115 23812 catalog_manager.cc:5697] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 8 to 9, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.591717 29720 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:03.606300 23907 tablet_service.cc:1558] Processing DeleteTablet for tablet 2fb39e36ee084608a322a8fa84ccde2d with delete_type TABLET_DATA_TOMBSTONED (TS 0829ddf18f07439086398756b9c6d216 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:34022
I20260709 12:19:03.634260 29774 tablet_replica.cc:333] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:03.632028 29771 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.635700 29774 raft_consensus.cc:2243] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:03.647862 29774 raft_consensus.cc:2272] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:03.651868 23913 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.658411 23996 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.657138 29774 ts_tablet_manager.cc:1916] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:03.666924 24594 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:19:03.687836 29707 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:03.679314 23810 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.701601 24593 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.711480 23993 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:19:03.714011 29726 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:03.714524 24069 consensus_queue.cc:237] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:03.732427 23917 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:03.734598 24593 raft_consensus.cc:1275] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:03.735671 29771 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:03.767387 29767 consensus_queue.cc:1048] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:19:03.804121 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2fb39e36ee084608a322a8fa84ccde2d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:03.806792 23913 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.809028 24593 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:19:03.922892 29775 log.cc:927] Time spent T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:19:03.818594 29771 raft_consensus.cc:2955] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:03.933144 29774 ts_tablet_manager.cc:1929] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 12:19:03.936734 29774 log.cc:1199] T 2fb39e36ee084608a322a8fa84ccde2d P 0829ddf18f07439086398756b9c6d216: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/wals/2fb39e36ee084608a322a8fa84ccde2d
W20260709 12:19:03.987072 23960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 68109.1us
I20260709 12:19:04.030751 23817 catalog_manager.cc:5697] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 11 to 12, VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2) evicted. New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:19:04.032174 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 80539.2us
I20260709 12:19:04.074151 23804 catalog_manager.cc:5028] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): tablet 2fb39e36ee084608a322a8fa84ccde2d (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:19:04.125154 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:04.147921 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1298b4797007440ca5cc586fd47928e8 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:04.152519 23986 tablet_service.cc:1558] Processing DeleteTablet for tablet 1298b4797007440ca5cc586fd47928e8 with delete_type TABLET_DATA_TOMBSTONED (TS ef0dd15ac654478b8371c22b8909240e not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:58656
W20260709 12:19:04.194721 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 88218.2us
I20260709 12:19:04.213223 29779 raft_consensus.cc:1064] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:19:04.215943 29779 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 6, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:04.262063 29796 tablet_replica.cc:333] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:04.263234 29796 raft_consensus.cc:2243] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:04.264128 29796 raft_consensus.cc:2272] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:04.294317 24594 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:04.311404 29796 ts_tablet_manager.cc:1916] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:04.336247 24069 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:04.337275 23918 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:04.366926 29788 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:04.369009 29780 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:04.374003 29782 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
W20260709 12:19:04.390470 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 211943us
I20260709 12:19:04.391463 23918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "0829ddf18f07439086398756b9c6d216"
mode: GRACEFUL
new_leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:34020
I20260709 12:19:04.392148 23918 raft_consensus.cc:606] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Received request to transfer leadership to TS a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:04.434092 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:04.436115 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:04.436988 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:04.478504 29782 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:04.480370 23918 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:04.482822 29796 ts_tablet_manager.cc:1929] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 12:19:04.483312 29796 log.cc:1199] T 1298b4797007440ca5cc586fd47928e8 P ef0dd15ac654478b8371c22b8909240e: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/wals/1298b4797007440ca5cc586fd47928e8
I20260709 12:19:04.485478 23806 catalog_manager.cc:5028] TS ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): tablet 1298b4797007440ca5cc586fd47928e8 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:19:04.518141 24067 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:04.525786 23815 catalog_manager.cc:5697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:04.534583 24593 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:04.591177 23987 consensus_queue.cc:237] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:04.596846 24593 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:04.599050 29780 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:04.607312 29707 raft_consensus.cc:993] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: : Instructing follower a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:19:04.607851 29707 raft_consensus.cc:1081] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Signalling peer a46beb8868d749fdbaa732dd1ef6b89b to start an election
I20260709 12:19:04.612447 24067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
 from {username='slave'} at 127.0.0.1:57828
I20260709 12:19:04.612962 24067 raft_consensus.cc:493] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.613148 23918 raft_consensus.cc:1275] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:04.613307 24067 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:04.627614 24067 raft_consensus.cc:515] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:04.630379 23917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "0829ddf18f07439086398756b9c6d216"
I20260709 12:19:04.630985 23917 raft_consensus.cc:3055] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:04.631302 23917 raft_consensus.cc:740] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0829ddf18f07439086398756b9c6d216, State: Running, Role: LEADER
I20260709 12:19:04.618716 29780 consensus_queue.cc:1048] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:19:04.632073 23917 consensus_queue.cc:260] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:04.633199 23917 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:04.634261 29782 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:04.640710 24594 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:04.651741 23987 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ac362fb6ce545719be79028c2676d8f" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:19:04.657816 23987 raft_consensus.cc:3060] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:04.653719 23917 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 19.
I20260709 12:19:04.667605 24034 leader_election.cc:304] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:04.668537 29767 raft_consensus.cc:2804] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:04.668996 29767 raft_consensus.cc:697] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 19 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:04.669796 29767 consensus_queue.cc:237] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:04.654104 24067 leader_election.cc:290] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:04.653194 23918 raft_consensus.cc:2955] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:04.712255 23812 catalog_manager.cc:5697] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index 9 to 10, VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) evicted. New cstate: current_term: 13 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:04.721729 23987 raft_consensus.cc:2468] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 19.
I20260709 12:19:04.733978 24051 tablet_service.cc:1558] Processing DeleteTablet for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71 with delete_type TABLET_DATA_TOMBSTONED (TS a46beb8868d749fdbaa732dd1ef6b89b not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:59384
I20260709 12:19:04.738449 23812 catalog_manager.cc:5697] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 18 to 19, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 19 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:04.740068 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:04.767431 29803 tablet_replica.cc:333] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:04.768968 29803 raft_consensus.cc:2243] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:04.772390 29803 raft_consensus.cc:2272] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:04.777040 29803 ts_tablet_manager.cc:1916] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:04.810112 29803 ts_tablet_manager.cc:1929] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.9
I20260709 12:19:04.814445 29803 log.cc:1199] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P a46beb8868d749fdbaa732dd1ef6b89b: Deleting WAL directory at /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/wals/e3aeb6bd2fca4ca5933e1f4a8ae01c71
I20260709 12:19:04.816239 23806 catalog_manager.cc:5028] TS a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): tablet e3aeb6bd2fca4ca5933e1f4a8ae01c71 (table test-workload [id=2f1e12cfa6d149909dc46310e730c2da]) successfully deleted
I20260709 12:19:05.332511 23996 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:05.335088 29767 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:05.379832 23918 raft_consensus.cc:1275] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 19 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:19:05.385841 29745 consensus_queue.cc:1048] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:05.581967 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:05.844866 24061 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d"
dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
mode: GRACEFUL
new_leader_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:58520
I20260709 12:19:05.845495 24061 raft_consensus.cc:606] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Received request to transfer leadership to TS 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:05.852494 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:05.853749 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:05.855126 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:06.040699 24067 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:06.088164 23917 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:06.090770 29768 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:06.100190 23988 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:19:06.107425 24035 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58aa4c7f8ec14db884253c7b025e4c26. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:06.116951 29745 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:06.143554 29805 raft_consensus.cc:2955] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.153399 23918 raft_consensus.cc:2955] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.220616 23810 catalog_manager.cc:5697] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 reported cstate change: config changed from index -1 to 9, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
W20260709 12:19:06.234922 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 54790.5us
W20260709 12:19:06.259095 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 51230us
I20260709 12:19:06.288726 29805 raft_consensus.cc:993] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: : Instructing follower 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:19:06.289275 29805 raft_consensus.cc:1081] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Signalling peer 71a48f59ff764d249519c6a53ec57f02 to start an election
I20260709 12:19:06.294126 24594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d"
dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
 from {username='slave'} at 127.0.0.1:37704
I20260709 12:19:06.294979 24594 raft_consensus.cc:493] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:06.295925 24594 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.367883 23994 raft_consensus.cc:2955] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Committing config change with OpId 13.9: config changed from index -1 to 9, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.385914 23918 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:06.395370 24594 raft_consensus.cc:515] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:06.415670 24594 leader_election.cc:290] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:06.417244 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:19:06.418099 23996 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.418229 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2fb39e36ee084608a322a8fa84ccde2d" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:19:06.418874 24067 raft_consensus.cc:3055] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:06.419158 24067 raft_consensus.cc:740] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:06.420101 24067 consensus_queue.cc:260] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:06.421272 24067 raft_consensus.cc:3060] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:06.462998 24067 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
W20260709 12:19:06.471724 23886 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 368f96220d5b4469885774acf06e4475. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:06.494827 24566 leader_election.cc:304] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:06.496017 29831 raft_consensus.cc:2804] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:06.496672 29831 raft_consensus.cc:697] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:19:06.497771 29831 consensus_queue.cc:237] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:06.469921 23996 raft_consensus.cc:2468] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:19:06.535676 23996 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:06.535774 24063 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:06.584779 29827 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:06.614694 29827 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:06.631901 29813 raft_consensus.cc:2955] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.634016 24061 raft_consensus.cc:2955] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.660092 29839 ts_tablet_manager.cc:933] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:06.668812 23817 catalog_manager.cc:5697] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 11 to 12, leader changed from a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 12 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:06.671777 23996 raft_consensus.cc:2955] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.706027 23812 catalog_manager.cc:5697] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 8, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 9 leader_uuid: "0829ddf18f07439086398756b9c6d216" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.717548 24061 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:06.724165 29839 tablet_copy_client.cc:323] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:19:06.726915 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 58aa4c7f8ec14db884253c7b025e4c26 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:19:06.727569 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 58aa4c7f8ec14db884253c7b025e4c26 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-58aa4c7f8ec14db884253c7b025e4c26
W20260709 12:19:06.749821 24035 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 432ae242d4354d208df9f37d432ef3f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:06.750612 23989 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:06.750892 23915 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:06.752204 29824 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:06.753014 29768 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:06.741739 24079 tablet_copy_source_session.cc:215] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:06.769917 29839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58aa4c7f8ec14db884253c7b025e4c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:06.795189 29745 raft_consensus.cc:2955] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.804149 23918 raft_consensus.cc:2955] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.805354 29839 tablet_copy_client.cc:806] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:06.805986 29839 tablet_copy_client.cc:670] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:06.811115 29839 tablet_copy_client.cc:538] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:06.822315 23989 raft_consensus.cc:2955] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.832227 24061 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:06.825336 23815 catalog_manager.cc:5697] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index -1 to 9, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:06.835207 29839 tablet_bootstrap.cc:492] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
W20260709 12:19:06.850068 24035 consensus_peers.cc:597] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635): Couldn't send request to peer 71a48f59ff764d249519c6a53ec57f02. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ccf053e06f514bffaa9c442a8ea2c144. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:06.850430 23996 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:06.853813 29824 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:06.860663 23918 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:06.865414 29745 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:06.924065 29819 raft_consensus.cc:2955] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.926492 23989 raft_consensus.cc:2955] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.936231 23996 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:06.937901 29770 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:06.950003 23810 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index -1 to 12, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New cstate: current_term: 16 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.952127 29848 ts_tablet_manager.cc:933] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685)
I20260709 12:19:06.951431 23915 raft_consensus.cc:2955] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } }
I20260709 12:19:06.993594 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.009891 24063 raft_consensus.cc:1275] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:07.015029 29825 consensus_queue.cc:1048] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:07.029878 23886 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 45128us
I20260709 12:19:07.089072 29848 tablet_copy_client.cc:323] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.1:35685
I20260709 12:19:07.107913 29839 tablet_bootstrap.cc:492] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:07.108958 29839 tablet_bootstrap.cc:492] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:19:07.109652 29839 ts_tablet_manager.cc:1403] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.275s	user 0.036s	sys 0.012s
I20260709 12:19:07.160419 29839 raft_consensus.cc:359] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:07.161247 29839 raft_consensus.cc:740] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:19:07.161917 29839 consensus_queue.cc:260] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:07.163810 29839 ts_tablet_manager.cc:1434] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:19:07.179821 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-58aa4c7f8ec14db884253c7b025e4c26 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:19:07.181775 23931 tablet_copy_service.cc:140] P 0829ddf18f07439086398756b9c6d216: Received BeginTabletCopySession request for tablet 368f96220d5b4469885774acf06e4475 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:56870)
I20260709 12:19:07.181985 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-58aa4c7f8ec14db884253c7b025e4c26 on tablet 58aa4c7f8ec14db884253c7b025e4c26 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:07.182420 23931 tablet_copy_service.cc:161] P 0829ddf18f07439086398756b9c6d216: Beginning new tablet copy session on tablet 368f96220d5b4469885774acf06e4475 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:56870: session id = 71a48f59ff764d249519c6a53ec57f02-368f96220d5b4469885774acf06e4475
I20260709 12:19:07.199640 23931 tablet_copy_source_session.cc:215] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:07.256657 29848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 368f96220d5b4469885774acf06e4475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:07.276364 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:07.282269 29848 tablet_copy_client.cc:806] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:07.287830 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:07.318715 29839 ts_tablet_manager.cc:933] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:07.329106 29848 tablet_copy_client.cc:670] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:07.333312 29848 tablet_copy_client.cc:538] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:07.339675 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.352102 29839 tablet_copy_client.cc:323] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:19:07.354147 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet 432ae242d4354d208df9f37d432ef3f7 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:19:07.354719 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet 432ae242d4354d208df9f37d432ef3f7 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-432ae242d4354d208df9f37d432ef3f7
I20260709 12:19:07.361758 29848 tablet_bootstrap.cc:492] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:19:07.364727 24079 tablet_copy_source_session.cc:215] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:07.369042 29839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 432ae242d4354d208df9f37d432ef3f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:07.413779 29839 tablet_copy_client.cc:806] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:07.420491 29839 tablet_copy_client.cc:670] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:07.445219 29839 tablet_copy_client.cc:538] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:07.454727 29839 tablet_bootstrap.cc:492] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
I20260709 12:19:07.467448 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:07.508961 29862 ts_tablet_manager.cc:933] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: Initiating tablet copy from peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:07.522467 29862 tablet_copy_client.cc:323] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Beginning tablet copy session from remote peer at address 127.22.48.3:42409
I20260709 12:19:07.524082 24079 tablet_copy_service.cc:140] P a46beb8868d749fdbaa732dd1ef6b89b: Received BeginTabletCopySession request for tablet ccf053e06f514bffaa9c442a8ea2c144 from peer 71a48f59ff764d249519c6a53ec57f02 ({username='slave'} at 127.0.0.1:42676)
I20260709 12:19:07.524605 24079 tablet_copy_service.cc:161] P a46beb8868d749fdbaa732dd1ef6b89b: Beginning new tablet copy session on tablet ccf053e06f514bffaa9c442a8ea2c144 from peer 71a48f59ff764d249519c6a53ec57f02 at {username='slave'} at 127.0.0.1:42676: session id = 71a48f59ff764d249519c6a53ec57f02-ccf053e06f514bffaa9c442a8ea2c144
I20260709 12:19:07.532332 24079 tablet_copy_source_session.cc:215] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:07.535662 29862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccf053e06f514bffaa9c442a8ea2c144. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:07.569427 29848 tablet_bootstrap.cc:492] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:07.604080 29848 tablet_bootstrap.cc:492] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:19:07.604862 29848 ts_tablet_manager.cc:1403] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.243s	user 0.036s	sys 0.004s
I20260709 12:19:07.600862 29862 tablet_copy_client.cc:806] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:07.606163 29862 tablet_copy_client.cc:670] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:07.608228 29848 raft_consensus.cc:359] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:07.611052 29862 tablet_copy_client.cc:538] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:07.617235 29848 raft_consensus.cc:740] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:19:07.618007 29848 consensus_queue.cc:260] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:07.629173 29839 tablet_bootstrap.cc:492] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:07.630179 29839 tablet_bootstrap.cc:492] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:19:07.630894 29839 ts_tablet_manager.cc:1403] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.176s	user 0.035s	sys 0.008s
I20260709 12:19:07.633467 29839 raft_consensus.cc:359] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:07.634443 29839 raft_consensus.cc:740] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:19:07.635111 29839 consensus_queue.cc:260] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:07.637697 29839 ts_tablet_manager.cc:1434] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:07.639309 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-432ae242d4354d208df9f37d432ef3f7 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:19:07.639724 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-432ae242d4354d208df9f37d432ef3f7 on tablet 432ae242d4354d208df9f37d432ef3f7 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:07.639880 29848 ts_tablet_manager.cc:1434] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:19:07.643869 23931 tablet_copy_service.cc:342] P 0829ddf18f07439086398756b9c6d216: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-368f96220d5b4469885774acf06e4475 received from {username='slave'} at 127.0.0.1:56870
I20260709 12:19:07.644317 23931 tablet_copy_service.cc:434] P 0829ddf18f07439086398756b9c6d216: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-368f96220d5b4469885774acf06e4475 on tablet 368f96220d5b4469885774acf06e4475 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:07.654242 24593 raft_consensus.cc:1217] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.8->[13.9-13.9]   Dedup: 13.9->[]
I20260709 12:19:07.668020 22720 tablet_server.cc:179] TabletServer@127.22.48.1:0 shutting down...
I20260709 12:19:07.686265 29862 tablet_bootstrap.cc:492] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap starting.
W20260709 12:19:07.734251 23960 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:19:07.773947 23960 consensus_peers.cc:597] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.775568 24564 consensus_peers.cc:597] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.794155 23960 consensus_peers.cc:597] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.800194 23960 consensus_peers.cc:597] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.832321 23960 consensus_peers.cc:597] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.844337 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 93671us
W20260709 12:19:07.851289 24564 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.854440 24564 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.881069 24564 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.882088 23960 consensus_peers.cc:597] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.888363 24034 consensus_peers.cc:597] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.891674 24034 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.904863 24034 consensus_peers.cc:597] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.906751 24035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34635, user_credentials={real_user=slave}} blocked reactor thread for 47051.5us
I20260709 12:19:07.912909 24593 raft_consensus.cc:1217] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
W20260709 12:19:07.921682 23960 consensus_peers.cc:597] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.937908 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 72451.1us
W20260709 12:19:07.943174 24034 consensus_peers.cc:597] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:07.951165 24599 raft_consensus.cc:1217] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.7->[9.8-9.8]   Dedup: 9.8->[]
W20260709 12:19:07.978487 24564 consensus_peers.cc:597] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.979377 23960 consensus_peers.cc:597] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.990231 24034 consensus_peers.cc:597] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.990891 24034 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:07.998879 23960 consensus_peers.cc:597] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:08.010972 24564 consensus_peers.cc:597] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:08.020895 24034 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:08.034405 23960 consensus_peers.cc:597] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:08.065774 24034 consensus_peers.cc:597] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:08.067123 24564 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:08.068261 24564 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:08.082592 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:08.089757 22720 tablet_replica.cc:333] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.090807 22720 raft_consensus.cc:2243] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.091583 22720 raft_consensus.cc:2272] T 58aa4c7f8ec14db884253c7b025e4c26 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:08.099690 24034 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:08.103936 24564 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:08.107205 24034 consensus_peers.cc:597] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:08.111358 24034 consensus_peers.cc:597] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:08.118423 29862 tablet_bootstrap.cc:492] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:08.119376 29862 tablet_bootstrap.cc:492] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: Bootstrap complete.
I20260709 12:19:08.120072 29862 ts_tablet_manager.cc:1403] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: Time spent bootstrapping tablet: real 0.444s	user 0.039s	sys 0.010s
W20260709 12:19:08.131351 23960 consensus_peers.cc:597] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:08.138505 22720 tablet_replica.cc:333] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.141873 29872 raft_consensus.cc:1064] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:19:08.142652 22720 raft_consensus.cc:2243] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.144673 29872 consensus_queue.cc:237] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 7, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:08.161324 22720 raft_consensus.cc:2272] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.164405 22720 tablet_replica.cc:333] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.169109 29862 raft_consensus.cc:359] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:08.170979 22720 raft_consensus.cc:2243] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.171785 22720 raft_consensus.cc:2272] T 392f06df3ae54cb5a9746fdbb980ad3d P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.181753 22720 tablet_replica.cc:333] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.182673 22720 raft_consensus.cc:2243] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.183805 22720 raft_consensus.cc:2272] T 4db304f4ee46489296e4f0f6b21cac26 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.170115 29862 raft_consensus.cc:740] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Initialized, Role: LEARNER
I20260709 12:19:08.186296 29862 consensus_queue.cc:260] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:08.188925 29862 ts_tablet_manager.cc:1434] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 12:19:08.190106 22720 tablet_replica.cc:333] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.194263 22720 raft_consensus.cc:2243] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.195209 22720 raft_consensus.cc:2272] T 675e57b981c1430ba502ba18c21dd0a4 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.201934 24079 tablet_copy_service.cc:342] P a46beb8868d749fdbaa732dd1ef6b89b: Request end of tablet copy session 71a48f59ff764d249519c6a53ec57f02-ccf053e06f514bffaa9c442a8ea2c144 received from {username='slave'} at 127.0.0.1:42676
I20260709 12:19:08.202423 24079 tablet_copy_service.cc:434] P a46beb8868d749fdbaa732dd1ef6b89b: ending tablet copy session 71a48f59ff764d249519c6a53ec57f02-ccf053e06f514bffaa9c442a8ea2c144 on tablet ccf053e06f514bffaa9c442a8ea2c144 with peer 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:08.212741 24599 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:08.213547 23989 raft_consensus.cc:1275] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:08.214538 29871 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:08.215942 22720 tablet_replica.cc:333] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.216378 29873 consensus_queue.cc:1048] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:08.216866 22720 raft_consensus.cc:2243] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.218606 22720 raft_consensus.cc:2272] T d7f76f3699ab4bae8da2e38abd9f9348 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.228528 22720 tablet_replica.cc:333] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.229373 22720 raft_consensus.cc:2243] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:08.239253 24034 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:08.242908 22720 raft_consensus.cc:2272] T 91e7023603694b9d8a378858f72b4532 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.245524 22720 tablet_replica.cc:333] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.246371 22720 raft_consensus.cc:2243] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:08.247514 22720 raft_consensus.cc:2272] T 8dc5fe36cbf643f18c228bc420036e0c P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.250012 22720 tablet_replica.cc:333] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.250864 22720 raft_consensus.cc:2243] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.251446 22720 raft_consensus.cc:2272] T 3d2e07822f804c3c9a8ff2c0177d5d72 P 0829ddf18f07439086398756b9c6d216 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.254197 22720 tablet_replica.cc:333] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.254956 22720 raft_consensus.cc:2243] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:08.256016 22720 raft_consensus.cc:2272] T 371c317c26eb44cd875c5925f4b31bd6 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.268728 22720 tablet_replica.cc:333] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.269591 22720 raft_consensus.cc:2243] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.271145 22720 raft_consensus.cc:2272] T ccf053e06f514bffaa9c442a8ea2c144 P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.297161 29872 raft_consensus.cc:2955] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:08.303956 29871 raft_consensus.cc:1064] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:19:08.321741 29871 consensus_queue.cc:237] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:08.304090 24599 raft_consensus.cc:2955] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:08.311899 22720 tablet_replica.cc:333] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.342614 22720 raft_consensus.cc:2243] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.343246 22720 raft_consensus.cc:2272] T 8ac362fb6ce545719be79028c2676d8f P 0829ddf18f07439086398756b9c6d216 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.346077 22720 tablet_replica.cc:333] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.346961 22720 raft_consensus.cc:2243] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.348129 23989 raft_consensus.cc:2955] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index 9 to 10, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:08.350363 22720 raft_consensus.cc:2272] T c59becc061884c78add6c7ec0be6583c P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.353566 23988 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:08.356380 29819 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:08.358505 24593 raft_consensus.cc:1275] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:19:08.362708 24034 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:08.362994 29873 consensus_queue.cc:1048] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:08.382951 22720 tablet_replica.cc:333] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.385040 22720 raft_consensus.cc:2243] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:08.386173 22720 raft_consensus.cc:2272] T 0740227aa014467da8e8269927b1cfda P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.393335 22720 tablet_replica.cc:333] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.395337 22720 raft_consensus.cc:2243] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.398913 22720 raft_consensus.cc:2272] T 5db9cea3b8f64883a51327db383cd13e P 0829ddf18f07439086398756b9c6d216 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.406662 22720 tablet_replica.cc:333] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.407570 22720 raft_consensus.cc:2243] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.410539 22720 raft_consensus.cc:2272] T 6850e6a4a82a49d689423ed8fb40c891 P 0829ddf18f07439086398756b9c6d216 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.412940 22720 tablet_replica.cc:333] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.418516 22720 raft_consensus.cc:2243] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.419445 22720 raft_consensus.cc:2272] T 432ae242d4354d208df9f37d432ef3f7 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.425099 24599 raft_consensus.cc:1217] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 12:19:08.427822 23812 catalog_manager.cc:5697] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: config changed from index 9 to 10, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:08.439193 29795 raft_consensus.cc:1064] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:19:08.442243 29795 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:08.553958 22720 tablet_replica.cc:333] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.555138 22720 raft_consensus.cc:2243] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.577931 22720 raft_consensus.cc:2272] T 9a0df8b4c2674e279e8740ab00a67267 P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.637065 29813 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:08.637603 29813 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:08.660593 22720 tablet_replica.cc:333] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.662544 22720 raft_consensus.cc:2243] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:08.662750 29813 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:08.663208 22720 raft_consensus.cc:2272] T 1a27cf3ad031452fa9b230da94f82f48 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.664697 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:08.685166 24593 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 9 LEARNER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:08.686105 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "295a8f22b14a4f92b8abb10a4a03e184" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:08.693063 29707 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:08.696441 24063 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:08.757539 29891 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:19:08.823050 29813 raft_consensus.cc:493] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:08.823851 29813 raft_consensus.cc:515] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:08.826205 29813 leader_election.cc:290] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:08.837882 24593 raft_consensus.cc:2955] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:08.867543 23887 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:08.761534 29894 raft_consensus.cc:2955] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:08.883040 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:08.903779 23988 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e002c45f325450c832f48fca5627fcd" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:08.905936 23989 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Refusing update from remote peer 0829ddf18f07439086398756b9c6d216: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:08.906212 22720 tablet_replica.cc:333] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.907119 22720 raft_consensus.cc:2243] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:08.908021 29891 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:08.887284 29910 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:08.916287 22720 raft_consensus.cc:2272] T 10cd478aa7e9411bba254e94713f91de P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:08.890051 29813 raft_consensus.cc:493] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:19:08.908564 29891 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:08.936363 29891 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:08.939263 29813 raft_consensus.cc:515] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:08.941512 29813 leader_election.cc:290] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:08.963654 29795 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:08.967795 29915 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:08.970922 29915 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:08.977556 29915 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:08.973296 29707 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
W20260709 12:19:08.979061 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 359597us
I20260709 12:19:08.972628 22720 tablet_replica.cc:333] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:08.982031 29911 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:08.982483 29813 raft_consensus.cc:493] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:19:08.982939 29911 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:08.983064 29813 raft_consensus.cc:515] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:08.985193 29813 leader_election.cc:290] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:08.985491 29911 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:08.981343 29707 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:08.998533 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:08.999707 29795 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.002744 29795 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:08.986896 22720 raft_consensus.cc:2243] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.003769 22720 raft_consensus.cc:2272] T 49b6c160a80f417b89957aa0a1f5dd34 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.007833 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6869b2949cb848a79c8263a5be455d66" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.009323 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:09.008405 22720 tablet_replica.cc:333] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.013307 22720 raft_consensus.cc:2243] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.013427 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.022794 22720 pending_rounds.cc:70] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Trying to abort 1 pending ops.
I20260709 12:19:09.025303 24069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f761e3dc48440849d367f5e28b48adb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.026459 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.025075 29795 raft_consensus.cc:493] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:19:09.035734 29795 raft_consensus.cc:515] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.023087 22720 pending_rounds.cc:77] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216: Aborting op as it isn't in flight: id { term: 9 index: 9 } timestamp: 7305623750412513280 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "368f96220d5b4469885774acf06e4475" old_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } } new_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } } }
I20260709 12:19:09.036751 22720 raft_consensus.cc:2917] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: Aborting config change with OpId 9.9: Aborted: Op aborted
I20260709 12:19:09.037139 22720 raft_consensus.cc:2889] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 9 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:19:09.037487 22720 raft_consensus.cc:2272] T 368f96220d5b4469885774acf06e4475 P 0829ddf18f07439086398756b9c6d216 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.049089 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.049324 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.061587 29707 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:09.060644 23992 raft_consensus.cc:2955] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:09.065922 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.069979 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdddb53d197e4af78460302ce75bc88c" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.068840 23887 leader_election.cc:304] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:09.059078 23810 catalog_manager.cc:5697] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 9 to 10, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:09.095294 29922 raft_consensus.cc:2749] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:09.098063 29922 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:09.098649 29922 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.101177 29922 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:09.102108 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.109244 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3aeb6bd2fca4ca5933e1f4a8ae01c71" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:09.123276 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1298b4797007440ca5cc586fd47928e8" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.123467 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea07088f87a54d2194bc706db4279d24" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.124585 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e9a767edf8b423cb0ef561b055f670a" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.129617 22720 tablet_replica.cc:333] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.130427 22720 raft_consensus.cc:2243] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.116992 29922 raft_consensus.cc:493] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 71a48f59ff764d249519c6a53ec57f02)
I20260709 12:19:09.136304 29745 raft_consensus.cc:1064] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: attempting to promote NON_VOTER 71a48f59ff764d249519c6a53ec57f02 to VOTER
I20260709 12:19:09.140926 29745 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.142555 29707 raft_consensus.cc:493] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:09.143061 29707 raft_consensus.cc:515] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:09.144786 29707 leader_election.cc:290] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:09.148238 29795 leader_election.cc:290] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:09.148402 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.150133 22720 raft_consensus.cc:2272] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.152920 22720 tablet_replica.cc:333] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.153682 22720 raft_consensus.cc:2243] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.159227 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e22d6a51d8e04f7bbcad59376624aa20" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:09.164746 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.172485 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e905a7d4b6d64ec49ad9485c349179cb" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:09.178253 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8132db9882c041d1845d0a8815c39788" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:09.182435 22720 raft_consensus.cc:2272] T 5ccb15a6c98843f3836da9918c1195dc P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.185398 22720 tablet_replica.cc:333] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.160326 29922 raft_consensus.cc:515] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.165387 23887 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
W20260709 12:19:09.212006 23887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 46715.2us
I20260709 12:19:09.212182 22720 raft_consensus.cc:2243] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.213850 23887 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:09.220150 29922 leader_election.cc:290] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:09.222672 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.224962 22720 raft_consensus.cc:2272] T 15e681cfd0fe4e6f9e747ba4c2345a95 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.213094 29911 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:09.236356 29911 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:09.227769 22720 tablet_replica.cc:333] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.238425 22720 raft_consensus.cc:2243] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.238731 23887 leader_election.cc:304] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:09.239133 22720 raft_consensus.cc:2272] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.242220 29911 raft_consensus.cc:2749] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:09.239743 24593 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 LEARNER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:19:09.245626 23887 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:09.247179 29914 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:09.249235 23992 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:19:09.260741 23887 raft_consensus.cc:2686] T 6869b2949cb848a79c8263a5be455d66 P 0829ddf18f07439086398756b9c6d216: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:09.271530 23887 leader_election.cc:304] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:09.272356 29911 raft_consensus.cc:2749] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:09.272915 22720 tablet_replica.cc:333] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.273676 22720 raft_consensus.cc:2243] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.275270 22720 raft_consensus.cc:2272] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.274189 29896 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:19:09.276731 23887 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:09.281589 29911 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:09.282831 23887 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:09.283337 29903 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.284484 29903 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:09.290341 23960 leader_election.cc:336] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.294339 29903 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:19:09.295080 23887 raft_consensus.cc:2686] T 1298b4797007440ca5cc586fd47928e8 P 0829ddf18f07439086398756b9c6d216: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:09.295861 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.297413 23887 leader_election.cc:304] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:09.297683 23961 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:09.300405 29903 raft_consensus.cc:2749] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:09.303906 22720 tablet_replica.cc:333] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.304948 22720 raft_consensus.cc:2243] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.318172 22720 raft_consensus.cc:2272] T 9f761e3dc48440849d367f5e28b48adb P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.321271 23887 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:09.314766 29911 raft_consensus.cc:2749] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:09.322391 22720 tablet_replica.cc:333] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.323308 22720 raft_consensus.cc:2243] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:19:09.323668 23887 raft_consensus.cc:2686] T 2e9a767edf8b423cb0ef561b055f670a P 0829ddf18f07439086398756b9c6d216: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:19:09.324370 22720 raft_consensus.cc:2272] T 84a22fee7e714048af4a1d40001e99de P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.326977 22720 tablet_replica.cc:333] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.327099 23887 leader_election.cc:304] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:09.327883 29911 raft_consensus.cc:2749] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:09.327863 22720 raft_consensus.cc:2243] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.329417 22720 raft_consensus.cc:2272] T c11fc035985e44dfa44a64cfba349977 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.331897 22720 tablet_replica.cc:333] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.332684 22720 raft_consensus.cc:2243] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.333662 22720 raft_consensus.cc:2272] T 479416b99927471b8600549d94ad4873 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.336030 22720 tablet_replica.cc:333] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.336827 22720 raft_consensus.cc:2243] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.337468 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f58a6c8f74504786b09cf0261ea665c7" candidate_uuid: "0829ddf18f07439086398756b9c6d216" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.342358 22720 raft_consensus.cc:2272] T bdddb53d197e4af78460302ce75bc88c P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.345224 29896 raft_consensus.cc:2955] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:09.352339 23992 raft_consensus.cc:2955] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:09.365757 23887 leader_election.cc:304] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0829ddf18f07439086398756b9c6d216; no voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:09.366654 29911 raft_consensus.cc:2749] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:09.371158 24034 consensus_peers.cc:597] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:09.384804 24597 raft_consensus.cc:2955] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:09.389658 22720 tablet_replica.cc:333] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.390594 22720 raft_consensus.cc:2243] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.391669 22720 raft_consensus.cc:2272] T 238addf610d94f84b346a29e1e4b0e52 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.392618 23810 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 12 to 13, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } attrs { replace: true } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:09.394129 22720 tablet_replica.cc:333] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.394950 22720 raft_consensus.cc:2243] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.398895 22720 raft_consensus.cc:2272] T 5e9f2592cbef4c2d92a345546231175a P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.401731 22720 tablet_replica.cc:333] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.402524 22720 raft_consensus.cc:2243] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.403143 22720 raft_consensus.cc:2272] T 295a8f22b14a4f92b8abb10a4a03e184 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.406981 22720 tablet_replica.cc:333] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.408792 22720 raft_consensus.cc:2243] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.418748 22720 raft_consensus.cc:2272] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 0829ddf18f07439086398756b9c6d216 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.436048 29894 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.436617 29894 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.439852 29894 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:09.448738 29901 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.449317 29901 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.457159 22720 tablet_replica.cc:333] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.458567 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:09.459223 24597 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:19:09.461197 24035 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:09.462239 29914 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:09.462620 29914 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.462952 29914 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:09.464643 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.457239 29901 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:09.470803 24564 leader_election.cc:336] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.458185 22720 raft_consensus.cc:2243] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.475310 22720 raft_consensus.cc:2272] T e905a7d4b6d64ec49ad9485c349179cb P 0829ddf18f07439086398756b9c6d216 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.474970 24063 consensus_queue.cc:237] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:09.485356 24034 leader_election.cc:336] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.486172 23996 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:19:09.493556 24593 raft_consensus.cc:1275] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:19:09.497514 29745 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:09.499795 22720 tablet_replica.cc:333] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.501884 29745 consensus_queue.cc:1048] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:09.501230 22720 raft_consensus.cc:2243] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.512665 22720 raft_consensus.cc:2272] T ea07088f87a54d2194bc706db4279d24 P 0829ddf18f07439086398756b9c6d216 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.514084 29871 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.513202 29745 raft_consensus.cc:2955] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:09.514645 29871 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:09.516603 29871 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:09.519152 24597 raft_consensus.cc:2955] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:09.526187 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:09.528116 29914 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.530226 23992 raft_consensus.cc:2955] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Committing config change with OpId 16.14: config changed from index 13 to 14, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:19:09.540143 24034 leader_election.cc:336] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.544787 22720 tablet_replica.cc:333] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.562618 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:09.563135 22720 raft_consensus.cc:2243] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.552596 23815 catalog_manager.cc:5697] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: config changed from index 13 to 14, VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1) evicted. New cstate: current_term: 16 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:09.563896 23806 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ccf053e06f514bffaa9c442a8ea2c144 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:09.564306 22720 raft_consensus.cc:2272] T 7e53ff7433274cdf9c150f141d03e1f5 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.565292 29894 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:09.568542 24067 raft_consensus.cc:2393] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 71a48f59ff764d249519c6a53ec57f02 in current term 17: Already voted for candidate a46beb8868d749fdbaa732dd1ef6b89b in this term.
I20260709 12:19:09.572139 24566 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:09.574402 29887 raft_consensus.cc:3060] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:09.576409 29914 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:09.577217 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dc5fe36cbf643f18c228bc420036e0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:09.579802 22720 tablet_replica.cc:333] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.587752 22720 raft_consensus.cc:2243] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.593519 22720 raft_consensus.cc:2272] T f58a6c8f74504786b09cf0261ea665c7 P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.602108 22720 tablet_replica.cc:333] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.602949 22720 raft_consensus.cc:2243] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.604449 22720 raft_consensus.cc:2272] T 3e002c45f325450c832f48fca5627fcd P 0829ddf18f07439086398756b9c6d216 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.588402 29887 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:09.592648 24034 leader_election.cc:336] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.626328 24597 raft_consensus.cc:2468] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 17.
I20260709 12:19:09.634459 22720 tablet_replica.cc:333] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.634547 24035 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:09.635492 29745 raft_consensus.cc:2804] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:09.635708 22720 raft_consensus.cc:2243] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.635938 29745 raft_consensus.cc:697] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 17 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:09.637233 29745 consensus_queue.cc:237] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:09.641333 23804 catalog_manager.cc:4755] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ccf053e06f514bffaa9c442a8ea2c144: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:19:09.648700 22720 raft_consensus.cc:2272] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.653334 22720 tablet_replica.cc:333] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.677686 29887 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.687822 29887 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.684178 23815 catalog_manager.cc:5697] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 16 to 17, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 17 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:09.690019 29887 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:09.692281 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:09.692929 23992 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
I20260709 12:19:09.694538 24566 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:19:09.695659 29887 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:09.696115 29887 raft_consensus.cc:493] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.696566 29887 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:09.706073 24564 leader_election.cc:336] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.707808 22720 raft_consensus.cc:2243] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:09.709527 22720 raft_consensus.cc:2272] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 0829ddf18f07439086398756b9c6d216 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.717824 29887 raft_consensus.cc:515] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:09.727111 24564 leader_election.cc:336] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.735241 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "371c317c26eb44cd875c5925f4b31bd6" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:19:09.735759 29887 leader_election.cc:290] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:09.735803 23992 raft_consensus.cc:3060] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:09.745855 29903 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.746774 29903 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:09.748767 29903 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:09.750516 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:09.751253 22720 tablet_replica.cc:333] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.751148 24067 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 14.
W20260709 12:19:09.751614 29930 log.cc:927] Time spent T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: Append to log took a long time: real 0.086s	user 0.000s	sys 0.008s
I20260709 12:19:09.759017 22720 raft_consensus.cc:2243] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.759148 23962 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:19:09.759769 22720 raft_consensus.cc:2272] T 8132db9882c041d1845d0a8815c39788 P 0829ddf18f07439086398756b9c6d216 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:09.760073 29880 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:09.760529 29880 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.760869 29880 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:09.763018 22720 tablet_replica.cc:333] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216: stopping tablet replica
I20260709 12:19:09.763849 22720 raft_consensus.cc:2243] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:09.764469 22720 raft_consensus.cc:2272] T e22d6a51d8e04f7bbcad59376624aa20 P 0829ddf18f07439086398756b9c6d216 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:09.774523 23960 leader_election.cc:336] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.780089 23992 raft_consensus.cc:2468] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
I20260709 12:19:09.782802 24566 leader_election.cc:304] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:09.783056 29880 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:09.787012 29825 raft_consensus.cc:2804] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:09.787546 29825 raft_consensus.cc:697] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 15 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
W20260709 12:19:09.787782 23960 leader_election.cc:336] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.788522 29903 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:09.789196 29903 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } }
I20260709 12:19:09.791321 29903 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:09.788492 29825 consensus_queue.cc:237] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:09.792642 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:19:09.796114 23960 leader_election.cc:336] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:09.796600 23960 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:09.797919 29903 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:09.874209 29880 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:09.898887 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0740227aa014467da8e8269927b1cfda" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:19:09.899468 24061 raft_consensus.cc:3060] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:09.914841 24061 raft_consensus.cc:2468] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 15.
I20260709 12:19:09.923043 23962 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:09.924402 29880 raft_consensus.cc:2804] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:09.924930 29880 raft_consensus.cc:697] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:19:09.925778 29880 consensus_queue.cc:237] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:09.973068 23815 catalog_manager.cc:5697] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 14 to 15, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 15 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.005170 23812 catalog_manager.cc:5697] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 14 to 15, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 15 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:10.008647 23960 consensus_peers.cc:597] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.046783 23960 consensus_peers.cc:597] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.066071 29880 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.066776 29880 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:19:10.073171 23960 leader_election.cc:336] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:10.075320 29880 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:10.075539 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:10.076370 29934 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.076843 23962 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:10.076900 29934 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.078128 29880 raft_consensus.cc:2749] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:10.079403 29934 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:10.080775 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:19:10.083735 24564 leader_election.cc:336] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:10.084206 24564 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:10.086381 29934 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:10.127820 24564 consensus_peers.cc:597] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.174801 29934 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.175402 29934 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.177546 29934 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:10.185681 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:19:10.190809 24564 leader_election.cc:336] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:19:10.191267 24564 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:10.193311 29933 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:10.199344 23992 raft_consensus.cc:1275] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:10.202581 29901 consensus_queue.cc:1048] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:10.252012 24593 raft_consensus.cc:1275] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:19:10.254132 29871 consensus_queue.cc:1048] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:19:10.268788 24564 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:10.271179 24564 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.341425 24034 consensus_peers.cc:597] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:10.352793 24067 raft_consensus.cc:1275] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:10.367867 29903 consensus_queue.cc:1048] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:19:10.408386 23960 consensus_peers.cc:597] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.423802 29933 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.442266 29745 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.444003 29745 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:10.426105 29878 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.428578 29933 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.461229 29745 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:10.467622 24564 consensus_peers.cc:597] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.448045 29914 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.471170 29914 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:10.473680 29914 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:10.456470 29878 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.481487 29878 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:10.482698 29933 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:10.514000 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:10.514694 23992 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
I20260709 12:19:10.517341 24566 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
W20260709 12:19:10.528321 24034 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:10.531028 23960 consensus_peers.cc:597] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.531489 23960 consensus_peers.cc:597] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.531876 23960 leader_election.cc:336] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:10.535446 24564 leader_election.cc:336] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.521978 29933 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.540283 29901 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:10.543761 29901 raft_consensus.cc:493] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.543489 29933 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.544138 29901 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:10.545620 29933 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:10.556218 24034 leader_election.cc:336] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:10.557415 24564 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.557919 24564 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.558403 24564 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.560915 24564 leader_election.cc:336] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.566213 29887 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.567015 29887 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:10.577113 24034 consensus_peers.cc:597] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.579075 24564 leader_election.cc:336] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.583499 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:10.587229 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:10.587888 23996 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:19:10.592159 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:10.585439 29894 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.594585 29894 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.597366 29894 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:10.598368 29933 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.599107 29933 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:10.600557 24034 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.603917 24034 leader_election.cc:336] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:10.606634 24564 leader_election.cc:336] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.607085 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:10.608203 29933 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:10.609021 29933 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:10.610893 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:10.615029 29901 raft_consensus.cc:515] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.616158 24566 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:10.617213 29889 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:10.617630 29887 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:10.620549 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:10.621137 24063 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 9.
I20260709 12:19:10.623152 24566 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:19:10.623878 24564 leader_election.cc:336] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.623934 29894 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.624521 29887 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:10.625406 29887 raft_consensus.cc:493] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.625204 29894 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.625854 29887 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:10.628068 29894 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:19:10.632544 24034 leader_election.cc:336] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.636054 29887 raft_consensus.cc:515] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.644093 29901 leader_election.cc:290] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:10.646325 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:19:10.647007 23996 raft_consensus.cc:3060] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:10.649356 29880 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.649915 29880 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.652115 29880 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:10.656972 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:10.657618 23992 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 15.
W20260709 12:19:10.660843 24564 leader_election.cc:336] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:10.662827 23960 consensus_peers.cc:597] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.663326 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
W20260709 12:19:10.663352 23960 consensus_peers.cc:597] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.664016 23992 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 9.
I20260709 12:19:10.661914 23996 raft_consensus.cc:2468] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
I20260709 12:19:10.665067 29952 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
W20260709 12:19:10.664220 23960 consensus_peers.cc:597] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.665729 23960 consensus_peers.cc:597] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:10.666159 23960 leader_election.cc:336] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.666951 23992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:19:10.667009 24034 consensus_peers.cc:597] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.667503 23992 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:10.667147 29952 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.669349 29948 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.669658 29889 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.669888 29948 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:10.670241 29889 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.670773 24566 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.672004 29948 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:10.672653 29889 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:10.672693 29933 raft_consensus.cc:2804] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:10.673725 29933 raft_consensus.cc:697] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 15 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:19:10.674580 29933 consensus_queue.cc:237] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:10.680231 23960 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:10.680773 23960 consensus_peers.cc:597] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.681849 29887 leader_election.cc:290] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:10.681869 24034 leader_election.cc:336] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.683393 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:19:10.683817 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:10.684051 24063 raft_consensus.cc:3060] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:10.684474 23996 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:19:10.685525 24566 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:19:10.687740 29954 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:10.690753 29952 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:10.688156 29954 raft_consensus.cc:493] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.692581 29954 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.693203 23992 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
W20260709 12:19:10.693816 24564 consensus_peers.cc:597] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.694332 24564 leader_election.cc:336] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.695639 29889 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.696241 29889 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.697002 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "368f96220d5b4469885774acf06e4475" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:10.697777 24593 raft_consensus.cc:2393] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a46beb8868d749fdbaa732dd1ef6b89b in current term 10: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:19:10.699887 24065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:10.700732 29951 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.701275 29951 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:10.695089 24564 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.703534 29951 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:10.703200 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:10.716394 24593 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 15.
I20260709 12:19:10.713593 29889 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:10.715358 24034 leader_election.cc:336] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.709012 24063 raft_consensus.cc:2468] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 10.
I20260709 12:19:10.722041 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:10.723317 24035 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:10.725139 24594 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:19:10.723663 24597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10cd478aa7e9411bba254e94713f91de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:10.725508 24035 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.727018 29871 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:10.727329 29949 raft_consensus.cc:2749] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:10.727476 29871 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.728092 29871 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:10.723829 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:10.729100 24593 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
W20260709 12:19:10.736774 23960 consensus_peers.cc:597] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:10.745925 24564 leader_election.cc:336] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.747131 24067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:10.747174 24566 leader_election.cc:304] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.747793 29871 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.750582 24067 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 17.
I20260709 12:19:10.751339 24564 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:10.749172 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:10.752292 29871 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:19:10.748661 24034 consensus_peers.cc:597] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.755275 29952 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:10.756426 24035 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.757589 29952 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:10.758055 29952 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.758536 29952 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:10.759876 24035 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.760699 29950 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:10.761157 29950 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.761730 29950 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:10.761111 23961 leader_election.cc:304] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:10.766566 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.767485 29887 raft_consensus.cc:2804] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:10.768795 29887 raft_consensus.cc:697] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:19:10.769821 29887 consensus_queue.cc:237] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.770578 29889 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:10.770938 29953 raft_consensus.cc:2749] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:10.773692 24034 leader_election.cc:336] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.774947 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ccb15a6c98843f3836da9918c1195dc" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:10.775547 24593 raft_consensus.cc:3060] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:10.779088 29871 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:10.779508 29871 raft_consensus.cc:493] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.779882 29871 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:10.780371 29950 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.786159 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:19:10.790371 24034 leader_election.cc:336] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.791571 29950 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:19:10.768059 24564 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 47113.6us
I20260709 12:19:10.783209 24593 raft_consensus.cc:2468] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:19:10.790940 29954 raft_consensus.cc:515] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.800822 24599 raft_consensus.cc:2393] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0dd15ac654478b8371c22b8909240e in current term 12: Already voted for candidate 71a48f59ff764d249519c6a53ec57f02 in this term.
I20260709 12:19:10.801183 24035 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.804790 29949 raft_consensus.cc:2804] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:10.805311 29949 raft_consensus.cc:697] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:10.805811 29954 leader_election.cc:290] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:10.806169 29949 consensus_queue.cc:237] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.810561 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84a22fee7e714048af4a1d40001e99de" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:19:10.811121 23996 raft_consensus.cc:3060] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:10.824396 24564 leader_election.cc:336] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.832544 23996 raft_consensus.cc:2468] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:19:10.833791 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c11fc035985e44dfa44a64cfba349977" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:10.834434 24593 raft_consensus.cc:3060] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:10.838490 29914 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.842973 29914 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.840224 29894 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.852281 29894 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.854645 29914 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:19:10.845849 24034 consensus_peers.cc:597] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.861943 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:10.862578 24598 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 18.
W20260709 12:19:10.863508 24034 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.863873 24035 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:10.827729 29952 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.851063 23961 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216, 71a48f59ff764d249519c6a53ec57f02
I20260709 12:19:10.872828 29894 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:10.873620 29880 raft_consensus.cc:2749] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:10.866739 24566 leader_election.cc:304] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.874367 29871 raft_consensus.cc:515] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:10.874773 29951 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:19:10.875193 29951 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.875569 29951 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:19:10.877238 24034 leader_election.cc:336] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:10.878000 24034 leader_election.cc:336] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:10.878506 24034 consensus_peers.cc:597] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:10.883411 29934 raft_consensus.cc:2804] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:10.889308 24593 raft_consensus.cc:2468] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:19:10.890587 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:10.896347 24599 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 14.
I20260709 12:19:10.891523 29887 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.892271 29934 raft_consensus.cc:697] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:19:10.896835 24035 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.897286 29887 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.897780 29934 consensus_queue.cc:237] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.898365 24035 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.899358 29950 raft_consensus.cc:2804] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:10.899828 29950 raft_consensus.cc:697] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:10.900285 29894 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:10.891723 23815 catalog_manager.cc:5697] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 14 to 15, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 15 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:10.901563 24063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:10.889487 23812 catalog_manager.cc:5697] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 15 to 16, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 16 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:10.906948 29950 consensus_queue.cc:237] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.899870 29887 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:10.905158 29894 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.913337 29894 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:10.916287 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 80405.8us
I20260709 12:19:10.917780 23962 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:10.918627 29958 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:10.919098 29958 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.919517 29958 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:10.910122 29951 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.923184 29951 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:10.924912 29871 leader_election.cc:290] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:10.927814 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e53ff7433274cdf9c150f141d03e1f5" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:10.928478 24599 raft_consensus.cc:3060] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:10.929437 29954 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:10.929958 29954 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:10.931421 24034 leader_election.cc:336] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.932987 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e" is_pre_election: true
I20260709 12:19:10.933555 23996 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 17.
I20260709 12:19:10.934780 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:19:10.942106 24599 raft_consensus.cc:2468] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 19.
I20260709 12:19:10.943706 24035 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
W20260709 12:19:10.959494 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 56047.6us
I20260709 12:19:10.936296 29954 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:10.957871 29887 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:10.957320 29871 raft_consensus.cc:2804] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:10.969808 23996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15e681cfd0fe4e6f9e747ba4c2345a95" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
I20260709 12:19:10.970515 23996 raft_consensus.cc:3060] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:10.978132 29894 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:10.978107 23996 raft_consensus.cc:2468] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 16.
I20260709 12:19:10.988481 24036 leader_election.cc:304] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:19:10.989423 29959 raft_consensus.cc:2804] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:10.989982 29959 raft_consensus.cc:697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:10.990912 29959 consensus_queue.cc:237] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:10.994230 29871 raft_consensus.cc:697] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:10.995162 29871 consensus_queue.cc:237] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:10.999053 24564 leader_election.cc:336] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:10.965049 29887 raft_consensus.cc:493] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:11.003922 29887 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:11.009233 29894 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:11.012823 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238addf610d94f84b346a29e1e4b0e52" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:11.013401 24598 raft_consensus.cc:3060] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:11.013475 29952 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:11.013717 29894 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:11.014202 29894 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:11.015043 24034 leader_election.cc:336] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:11.000120 24564 leader_election.cc:336] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:11.016929 24564 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:11.017241 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "479416b99927471b8600549d94ad4873" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:11.017783 24593 raft_consensus.cc:3060] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:11.017910 24564 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:11.019002 29889 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:11.019214 29894 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:11.030670 24599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:11.031409 24599 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:19:11.035048 24593 raft_consensus.cc:2468] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 15.
I20260709 12:19:11.036448 24598 raft_consensus.cc:2468] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 15.
I20260709 12:19:11.033233 24035 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:11.038895 24035 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:11.040462 29745 raft_consensus.cc:2804] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:11.040589 24035 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:11.041098 29745 raft_consensus.cc:697] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:11.043097 29952 raft_consensus.cc:2804] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:11.044090 29745 consensus_queue.cc:237] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:11.042012 29959 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:11.064190 29958 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:19:11.068317 24034 leader_election.cc:336] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:11.069072 24034 leader_election.cc:336] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:11.069518 29958 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 18 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:11.070009 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e9f2592cbef4c2d92a345546231175a" candidate_uuid: "ef0dd15ac654478b8371c22b8909240e" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:19:11.074935 24061 raft_consensus.cc:3060] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:11.048611 29952 raft_consensus.cc:697] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:11.083940 24061 raft_consensus.cc:2468] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0dd15ac654478b8371c22b8909240e in term 18.
I20260709 12:19:11.053833 29959 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0829ddf18f07439086398756b9c6d216)
I20260709 12:19:11.095808 29959 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:11.096519 23962 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e; no voters: 
I20260709 12:19:11.097416 29958 raft_consensus.cc:2804] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:11.097887 29958 raft_consensus.cc:697] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 18 LEADER]: Becoming Leader. State: Replica: ef0dd15ac654478b8371c22b8909240e, State: Running, Role: LEADER
I20260709 12:19:11.099447 29958 consensus_queue.cc:237] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:11.101907 29952 consensus_queue.cc:237] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:11.106205 23960 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:11.113749 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 81273.8us
W20260709 12:19:11.137991 24034 leader_election.cc:336] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:11.146292 29959 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:11.162000 29959 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:11.164065 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b80ceeebb5c4f0aaaecd9da202550b0" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:11.164887 24593 raft_consensus.cc:3060] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:11.167235 24564 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.173249 24034 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:11.146289 29887 raft_consensus.cc:515] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:11.176424 29887 leader_election.cc:290] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 election: Requested vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:11.181535 24564 leader_election.cc:336] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:11.186647 24034 leader_election.cc:336] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:11.188390 24593 raft_consensus.cc:2468] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:19:11.231840 24035 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:11.227151 23994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c6dc6b578324215a52f1a0a5f46c3d4" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "ef0dd15ac654478b8371c22b8909240e"
W20260709 12:19:11.241151 22720 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23942)
W20260709 12:19:11.268515 24034 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:11.266146 23994 raft_consensus.cc:3060] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:11.276917 24564 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.278290 29959 raft_consensus.cc:2804] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:11.287114 29959 raft_consensus.cc:697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
W20260709 12:19:11.293735 23804 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 176435us
I20260709 12:19:11.302112 23988 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:11.303516 29959 consensus_queue.cc:237] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:11.305727 23996 raft_consensus.cc:1275] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:11.307614 23989 raft_consensus.cc:1275] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:19:11.316119 29934 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:11.326705 29934 consensus_queue.cc:1048] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:11.327087 29887 consensus_queue.cc:1048] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:19:11.328763 24034 consensus_peers.cc:597] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.346520 23994 raft_consensus.cc:2468] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 18.
W20260709 12:19:11.354724 23804 catalog_manager.cc:4755] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ccf053e06f514bffaa9c442a8ea2c144: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:11.390569 24566 leader_election.cc:304] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e; no voters: 0829ddf18f07439086398756b9c6d216
I20260709 12:19:11.393460 29889 raft_consensus.cc:2804] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:11.394198 29889 raft_consensus.cc:697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 18 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:19:11.395702 29889 consensus_queue.cc:237] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:11.460711 24034 consensus_peers.cc:597] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.463565 24034 consensus_peers.cc:597] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:11.473026 24065 raft_consensus.cc:1275] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:11.472232 23810 catalog_manager.cc:5697] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 17 to 18, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to ef0dd15ac654478b8371c22b8909240e (127.22.48.2). New cstate: current_term: 18 leader_uuid: "ef0dd15ac654478b8371c22b8909240e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:11.480997 29887 consensus_queue.cc:1048] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:19:11.518180 24564 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.536921 24593 raft_consensus.cc:1275] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:11.546101 24599 raft_consensus.cc:1275] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:11.564599 29894 consensus_queue.cc:1048] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:11.570305 29951 consensus_queue.cc:1048] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:19:11.570542 23960 consensus_peers.cc:597] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.594314 24065 raft_consensus.cc:1275] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Refusing update from remote peer ef0dd15ac654478b8371c22b8909240e: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:19:11.603117 29947 consensus_queue.cc:1048] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:11.610189 23992 raft_consensus.cc:1275] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:11.636615 24599 raft_consensus.cc:1275] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:19:11.646888 29959 consensus_queue.cc:1048] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:11.649905 23812 catalog_manager.cc:5697] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 9 to 10, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4), now has a pending config: VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1), VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2), VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3), VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 10 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: NON_VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: true } } } pending_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:11.653151 23812 catalog_manager.cc:5697] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e reported cstate change: term changed from 11 to 12, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 12 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:19:11.685720 24034 consensus_peers.cc:597] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.693101 29889 raft_consensus.cc:2955] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:11.695181 24063 raft_consensus.cc:2955] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
W20260709 12:19:11.702361 24034 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 139793us
I20260709 12:19:11.724550 29952 consensus_queue.cc:1048] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:19:11.747061 23989 raft_consensus.cc:2955] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:11.774668 23815 catalog_manager.cc:5697] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 13 to 14, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 14 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:11.776711 23815 catalog_manager.cc:5697] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 14 to 15, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 15 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:11.780701 24598 raft_consensus.cc:1275] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:19:11.784473 24034 consensus_peers.cc:597] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.785881 23815 catalog_manager.cc:5697] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 15 to 16, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 16 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:11.788110 23815 catalog_manager.cc:5697] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 11 to 12, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 12 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:11.796015 24564 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:11.797366 24034 consensus_peers.cc:597] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.790098 23815 catalog_manager.cc:5697] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 14 to 15, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 15 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:11.800688 23815 catalog_manager.cc:5697] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 18 to 19, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 19 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:11.803828 24034 consensus_peers.cc:597] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.832054 24593 raft_consensus.cc:1275] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:19:11.825507 29959 consensus_queue.cc:1048] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:19:11.851276 23994 raft_consensus.cc:1275] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:19:11.864118 29966 consensus_queue.cc:1048] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:19:11.855223 23812 catalog_manager.cc:5697] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e reported cstate change: config changed from index 8 to 9, 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 0829ddf18f07439086398756b9c6d216 (127.22.48.1), VOTER ef0dd15ac654478b8371c22b8909240e (127.22.48.2), VOTER a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3), VOTER 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 10 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } attrs { replace: true } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } } }
I20260709 12:19:11.876199 29959 consensus_queue.cc:1048] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
W20260709 12:19:11.899438 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 96329.1us
I20260709 12:19:11.929610 23810 catalog_manager.cc:5697] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 17 to 18, leader changed from 0829ddf18f07439086398756b9c6d216 (127.22.48.1) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 18 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:11.945114 24036 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:43801, user_credentials={real_user=slave}} blocked reactor thread for 113981us
W20260709 12:19:11.967849 24034 consensus_peers.cc:597] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:11.998353 24598 raft_consensus.cc:1275] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:12.003722 29950 consensus_queue.cc:1048] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
W20260709 12:19:12.267699 22720 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23942)
W20260709 12:19:12.462522 23804 catalog_manager.cc:4755] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ccf053e06f514bffaa9c442a8ea2c144: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:12.647578 24564 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:12.650575 24564 consensus_peers.cc:597] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:12.718945 24564 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:12.744088 23960 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111) [suppressed 384 similar messages]
W20260709 12:19:12.773908 23960 consensus_peers.cc:597] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:12.787431 24564 consensus_peers.cc:597] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:12.810247 24564 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:12.844821 23960 consensus_peers.cc:597] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:12.925088 23960 consensus_peers.cc:597] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.021265 23960 consensus_peers.cc:597] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.053647 23960 consensus_peers.cc:597] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.083141 23960 consensus_peers.cc:597] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.083976 24034 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.094434 23960 consensus_peers.cc:597] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.105652 24034 consensus_peers.cc:597] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:13.117183 23962 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 55684.1us
W20260709 12:19:13.193821 23960 consensus_peers.cc:597] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.202976 24564 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.237517 23960 consensus_peers.cc:597] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.249625 24564 consensus_peers.cc:597] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.268203 22720 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 23942)
W20260709 12:19:13.308204 24034 consensus_peers.cc:597] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.399680 24034 consensus_peers.cc:597] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.403231 24564 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.417876 24034 consensus_peers.cc:597] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.433064 23960 consensus_peers.cc:597] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.599188 24564 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.608075 24564 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:13.614837 23960 consensus_peers.cc:597] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:13.615774 24034 consensus_peers.cc:597] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.617172 24034 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.620095 24564 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.727337 24034 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.734517 24034 consensus_peers.cc:597] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.759425 24564 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:13.770112 24034 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.900092 24564 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:13.923300 24034 consensus_peers.cc:597] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:13.978041 24034 consensus_peers.cc:597] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.058347 24034 consensus_peers.cc:597] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.091042 24034 consensus_peers.cc:597] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.151175 24034 consensus_peers.cc:597] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.158684 23960 consensus_peers.cc:597] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.264693 24034 consensus_peers.cc:597] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.280385 24034 consensus_peers.cc:597] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.449949 24564 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.463011 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800241e60 after lost signal to thread 22723
W20260709 12:19:14.464495 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800241b00 after lost signal to thread 23853
W20260709 12:19:14.465837 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800352d20 after lost signal to thread 24020
W20260709 12:19:14.466952 23850 debug-util.cc:398] Leaking SignalData structure 0x7b08001fb320 after lost signal to thread 24094
W20260709 12:19:14.469102 23850 debug-util.cc:398] Leaking SignalData structure 0x7b0800323e00 after lost signal to thread 24624
W20260709 12:19:14.510397 24034 consensus_peers.cc:597] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:14.642805 23804 catalog_manager.cc:4755] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ccf053e06f514bffaa9c442a8ea2c144: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:15.018342 22720 tablet_server.cc:196] TabletServer@127.22.48.1:0 shutdown complete.
W20260709 12:19:15.142556 24564 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:15.190793 24564 consensus_peers.cc:597] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.248095 23960 consensus_peers.cc:597] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.291355 24564 consensus_peers.cc:597] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.300325 24564 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.415010 24564 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.468252 22720 tablet_server.cc:179] TabletServer@127.22.48.2:0 shutting down...
W20260709 12:19:15.478711 23960 consensus_peers.cc:597] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.489805 23960 consensus_peers.cc:597] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.499321 24036 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.515192 24036 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.518993 23960 consensus_peers.cc:597] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.538334 23960 consensus_peers.cc:597] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.544384 24566 consensus_peers.cc:597] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.569620 24036 consensus_peers.cc:597] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.575210 24034 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.576663 23960 consensus_peers.cc:597] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.596686 24036 consensus_peers.cc:597] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.600493 23960 consensus_peers.cc:597] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.614579 24566 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.655921 24566 consensus_peers.cc:597] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.657533 24036 consensus_peers.cc:597] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.657684 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:19:15.658985 23960 consensus_peers.cc:597] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.661700 22720 tablet_replica.cc:333] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.662782 22720 raft_consensus.cc:2243] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.663632 22720 raft_consensus.cc:2272] T 58aa4c7f8ec14db884253c7b025e4c26 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.666611 22720 tablet_replica.cc:333] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.671993 22720 raft_consensus.cc:2243] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.673650 22720 raft_consensus.cc:2272] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.676525 22720 tablet_replica.cc:333] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
W20260709 12:19:15.678225 24566 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.689185 24566 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.692516 22720 raft_consensus.cc:2243] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:15.693746 24564 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.694310 24564 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.700537 24034 consensus_peers.cc:597] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.694221 22720 raft_consensus.cc:2272] T 4db304f4ee46489296e4f0f6b21cac26 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.703831 23960 consensus_peers.cc:597] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.706151 22720 tablet_replica.cc:333] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.707052 22720 raft_consensus.cc:2243] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.743700 22720 raft_consensus.cc:2272] T 04e684c6cc9c44a496daa6c45678df59 P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.757157 24036 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.765974 22720 tablet_replica.cc:333] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
W20260709 12:19:15.769755 24566 consensus_peers.cc:597] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.770787 24566 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.769397 24036 consensus_peers.cc:597] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.770957 22720 raft_consensus.cc:2243] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.773279 22720 raft_consensus.cc:2272] T d7f76f3699ab4bae8da2e38abd9f9348 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.774852 24036 consensus_peers.cc:597] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.775204 24564 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.776618 22720 tablet_replica.cc:333] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.777556 22720 raft_consensus.cc:2243] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.778139 22720 raft_consensus.cc:2272] T 392f06df3ae54cb5a9746fdbb980ad3d P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.781037 22720 tablet_replica.cc:333] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.781900 22720 raft_consensus.cc:2243] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.782667 22720 raft_consensus.cc:2272] T 2a33810a45fd4e70b0d4411b8c0afdd6 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.788219 22720 tablet_replica.cc:333] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.789179 22720 raft_consensus.cc:2243] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.790401 22720 raft_consensus.cc:2272] T 6869b2949cb848a79c8263a5be455d66 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.793272 22720 tablet_replica.cc:333] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.794212 22720 raft_consensus.cc:2243] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.795073 22720 raft_consensus.cc:2272] T 15e681cfd0fe4e6f9e747ba4c2345a95 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.801326 24036 consensus_peers.cc:597] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.804111 22720 tablet_replica.cc:333] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.806373 22720 raft_consensus.cc:2243] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.807277 22720 raft_consensus.cc:2272] T 8ac362fb6ce545719be79028c2676d8f P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.810075 22720 tablet_replica.cc:333] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.810962 22720 raft_consensus.cc:2243] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.811918 22720 raft_consensus.cc:2272] T b36a4b120beb473694980945af8d8909 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.814324 24566 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.815034 24566 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.818812 24034 consensus_peers.cc:597] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.819845 22720 tablet_replica.cc:333] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.820803 22720 raft_consensus.cc:2243] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.822062 22720 raft_consensus.cc:2272] T 91e7023603694b9d8a378858f72b4532 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.824975 22720 tablet_replica.cc:333] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.825838 22720 raft_consensus.cc:2243] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.826550 22720 raft_consensus.cc:2272] T 3d2e07822f804c3c9a8ff2c0177d5d72 P ef0dd15ac654478b8371c22b8909240e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.829319 22720 tablet_replica.cc:333] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.830245 22720 raft_consensus.cc:2243] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.831423 22720 raft_consensus.cc:2272] T 371c317c26eb44cd875c5925f4b31bd6 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.834514 22720 tablet_replica.cc:333] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.841176 22720 raft_consensus.cc:2243] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:15.843078 23960 consensus_peers.cc:597] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.842677 22720 raft_consensus.cc:2272] T ccf053e06f514bffaa9c442a8ea2c144 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.845974 24034 consensus_peers.cc:597] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:15.851112 23960 consensus_peers.cc:597] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:15.852650 22720 tablet_replica.cc:333] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.853634 22720 raft_consensus.cc:2243] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.854328 22720 raft_consensus.cc:2272] T 5db9cea3b8f64883a51327db383cd13e P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.857267 22720 tablet_replica.cc:333] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.858017 22720 raft_consensus.cc:2243] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.859140 22720 raft_consensus.cc:2272] T 6850e6a4a82a49d689423ed8fb40c891 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.862058 22720 tablet_replica.cc:333] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
W20260709 12:19:15.862303 24566 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.862968 22720 raft_consensus.cc:2243] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.864180 22720 raft_consensus.cc:2272] T 2fb39e36ee084608a322a8fa84ccde2d P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.867105 22720 tablet_replica.cc:333] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.867969 22720 raft_consensus.cc:2243] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.869114 22720 raft_consensus.cc:2272] T 0740227aa014467da8e8269927b1cfda P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.872723 24566 consensus_peers.cc:597] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.873741 22720 tablet_replica.cc:333] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
W20260709 12:19:15.874357 24036 consensus_peers.cc:597] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.874800 22720 raft_consensus.cc:2243] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.876945 22720 raft_consensus.cc:2272] T c59becc061884c78add6c7ec0be6583c P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.879665 22720 tablet_replica.cc:333] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.880486 22720 raft_consensus.cc:2243] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:15.881844 24564 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.882158 22720 raft_consensus.cc:2272] T eac75053172041f285deb68d4418ed57 P ef0dd15ac654478b8371c22b8909240e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.883225 24036 consensus_peers.cc:597] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.891575 24034 consensus_peers.cc:597] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:15.892211 22720 tablet_replica.cc:333] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.893098 22720 raft_consensus.cc:2243] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.894217 22720 raft_consensus.cc:2272] T 49b6c160a80f417b89957aa0a1f5dd34 P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.895339 24566 consensus_peers.cc:597] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.897097 22720 tablet_replica.cc:333] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.897991 22720 raft_consensus.cc:2243] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.898944 22720 raft_consensus.cc:2272] T 368f96220d5b4469885774acf06e4475 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.902774 22720 tablet_replica.cc:333] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.903597 22720 raft_consensus.cc:2243] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.904206 22720 raft_consensus.cc:2272] T 84a22fee7e714048af4a1d40001e99de P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.906790 24566 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.907003 22720 tablet_replica.cc:333] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.907969 22720 raft_consensus.cc:2243] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.909088 22720 raft_consensus.cc:2272] T bdddb53d197e4af78460302ce75bc88c P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.911903 22720 tablet_replica.cc:333] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.912739 22720 raft_consensus.cc:2243] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.913841 22720 raft_consensus.cc:2272] T a3da07aaa60743c193b387e6a20fc83b P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.915432 24566 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.924959 22720 tablet_replica.cc:333] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.925942 22720 raft_consensus.cc:2243] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.927210 22720 raft_consensus.cc:2272] T ea2fd010d40d4400b7b9f1b9cca54a0c P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.930341 22720 tablet_replica.cc:333] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.931218 22720 raft_consensus.cc:2243] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.931878 22720 raft_consensus.cc:2272] T 0caf361b460241abb91679f8f8b6e7e4 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.934989 22720 tablet_replica.cc:333] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.935879 22720 raft_consensus.cc:2243] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.936650 22720 raft_consensus.cc:2272] T 9661e61546884b0aa0c1e828cd13e76e P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.939339 22720 tablet_replica.cc:333] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
W20260709 12:19:15.939929 24034 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.940237 22720 raft_consensus.cc:2243] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.941515 22720 raft_consensus.cc:2272] T ac7e870c1a4544099414fa4aae03e1c2 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.944896 22720 tablet_replica.cc:333] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.945739 22720 raft_consensus.cc:2243] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.946823 22720 raft_consensus.cc:2272] T 33e9bcdb00ec45229c3b370172970a07 P ef0dd15ac654478b8371c22b8909240e [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:15.951604 24566 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:15.953457 24034 consensus_peers.cc:597] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:15.955969 22720 tablet_replica.cc:333] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.957064 22720 raft_consensus.cc:2243] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.957962 22720 raft_consensus.cc:2272] T 5c6dc6b578324215a52f1a0a5f46c3d4 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.962656 22720 tablet_replica.cc:333] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
W20260709 12:19:15.963593 24036 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:15.963667 22720 raft_consensus.cc:2243] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:15.964613 22720 raft_consensus.cc:2272] T 3e002c45f325450c832f48fca5627fcd P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:15.982597 22720 tablet_replica.cc:333] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:15.984676 22720 raft_consensus.cc:2243] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:15.985957 22720 raft_consensus.cc:2272] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P ef0dd15ac654478b8371c22b8909240e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:16.001369 24566 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:16.005116 24564 consensus_peers.cc:597] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:16.025960 22720 tablet_replica.cc:333] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.031070 22720 raft_consensus.cc:2243] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.032328 22720 raft_consensus.cc:2272] T e905a7d4b6d64ec49ad9485c349179cb P ef0dd15ac654478b8371c22b8909240e [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.037396 22720 tablet_replica.cc:333] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.058907 22720 raft_consensus.cc:2243] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:16.060165 24036 consensus_peers.cc:597] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:16.060699 22720 raft_consensus.cc:2272] T da0449b96d0e4a57b82ad92e05c4cea7 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.063715 22720 tablet_replica.cc:333] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.064532 22720 raft_consensus.cc:2243] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.065505 22720 raft_consensus.cc:2272] T 432ae242d4354d208df9f37d432ef3f7 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.083037 22720 tablet_replica.cc:333] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.083900 22720 raft_consensus.cc:2243] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.085035 22720 raft_consensus.cc:2272] T e22d6a51d8e04f7bbcad59376624aa20 P ef0dd15ac654478b8371c22b8909240e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.092839 22720 tablet_replica.cc:333] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.093623 22720 raft_consensus.cc:2243] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.094796 22720 raft_consensus.cc:2272] T def9be339f8f4adc820a6a1320fec425 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.102118 22720 tablet_replica.cc:333] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.103991 22720 raft_consensus.cc:2243] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.104628 22720 raft_consensus.cc:2272] T 8132db9882c041d1845d0a8815c39788 P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:16.111508 24034 consensus_peers.cc:597] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:16.123615 22720 tablet_replica.cc:333] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.126926 22720 raft_consensus.cc:2243] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.131770 22720 raft_consensus.cc:2272] T 295a8f22b14a4f92b8abb10a4a03e184 P ef0dd15ac654478b8371c22b8909240e [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:16.137466 24034 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:16.145156 22720 tablet_replica.cc:333] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.146062 22720 raft_consensus.cc:2243] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.146740 22720 raft_consensus.cc:2272] T 10cd478aa7e9411bba254e94713f91de P ef0dd15ac654478b8371c22b8909240e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.149511 22720 tablet_replica.cc:333] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.150326 22720 raft_consensus.cc:2243] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.151404 22720 raft_consensus.cc:2272] T 1a27cf3ad031452fa9b230da94f82f48 P ef0dd15ac654478b8371c22b8909240e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.154111 22720 tablet_replica.cc:333] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.164052 22720 raft_consensus.cc:2243] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:16.165171 22720 raft_consensus.cc:2272] T 5e9f2592cbef4c2d92a345546231175a P ef0dd15ac654478b8371c22b8909240e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.168717 22720 tablet_replica.cc:333] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
I20260709 12:19:16.169446 22720 raft_consensus.cc:2243] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.170503 22720 raft_consensus.cc:2272] T 9a0df8b4c2674e279e8740ab00a67267 P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:16.173141 22720 tablet_replica.cc:333] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e: stopping tablet replica
W20260709 12:19:16.175025 24564 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:16.184445 22720 raft_consensus.cc:2243] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:16.185647 22720 raft_consensus.cc:2272] T 8b3cbce810b542c7b032e8cbe30abbfd P ef0dd15ac654478b8371c22b8909240e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:16.190358 24034 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:16.296098 24564 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:16.335325 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 69301.6us
W20260709 12:19:16.579352 24034 consensus_peers.cc:597] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:16.603055 24564 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:16.604970 24034 consensus_peers.cc:597] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:16.700415 30011 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:16.701078 30011 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:16.703684 30011 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:16.712827 24034 leader_election.cc:336] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:16.715518 24036 leader_election.cc:336] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:16.720289 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:16.721773 30011 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:16.742619 24034 consensus_peers.cc:597] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:16.756171 24034 consensus_peers.cc:597] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:16.778518 29887 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:16.779101 29887 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:16.781137 29887 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:16.789146 24564 leader_election.cc:336] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:16.808526 24566 leader_election.cc:336] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:16.809059 24566 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:16.809782 29887 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:16.818393 24034 consensus_peers.cc:597] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:16.831699 24034 consensus_peers.cc:597] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:16.882669 30011 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:16.883177 30011 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:16.885430 30011 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:16.886595 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:19:16.893024 24036 leader_election.cc:336] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:16.893494 24036 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:16.894827 30011 raft_consensus.cc:2749] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:16.900789 24034 consensus_peers.cc:597] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:16.961429 29959 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:16.961956 29959 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:16.964098 29959 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:16.965091 24564 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:16.973719 24034 leader_election.cc:336] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:16.975975 24036 leader_election.cc:336] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:16.976413 24036 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:16.977564 30017 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:17.042446 29954 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.043040 29954 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.045117 29954 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:17.047341 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
W20260709 12:19:17.054728 24566 leader_election.cc:336] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.055151 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.055815 29954 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.063511 29954 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.064074 29954 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.066306 29954 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:17.068650 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:17.069290 24061 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 11.
I20260709 12:19:17.070870 24566 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:17.071609 29954 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:17.071985 29954 raft_consensus.cc:493] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.072325 29954 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:17.075116 24566 leader_election.cc:336] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.080273 29954 raft_consensus.cc:515] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.085958 29954 leader_election.cc:290] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:17.088758 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea2fd010d40d4400b7b9f1b9cca54a0c" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:19:17.089354 24061 raft_consensus.cc:3060] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:17.097599 24566 leader_election.cc:336] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.103909 24061 raft_consensus.cc:2468] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 12.
I20260709 12:19:17.105259 24566 leader_election.cc:304] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.105994 29887 raft_consensus.cc:2804] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:17.106478 29887 raft_consensus.cc:697] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:19:17.107286 29887 consensus_queue.cc:237] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.120666 29959 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.121212 29959 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.123073 29959 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:19:17.129158 24036 leader_election.cc:336] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.130651 29959 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.131145 29959 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:17.132987 29959 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:17.139850 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
W20260709 12:19:17.141712 24034 leader_election.cc:336] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:17.142585 24035 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.142968 29954 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.143496 29954 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.145502 29954 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:17.145606 30017 raft_consensus.cc:2749] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:17.144141 23815 catalog_manager.cc:5697] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 11 to 12, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 12 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:17.147502 30017 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.148006 30017 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.150018 30017 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:19:17.150532 24036 leader_election.cc:336] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.150969 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:17.151098 24036 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.153421 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:17.154614 29959 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:17.155573 24566 leader_election.cc:336] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.173004 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.173800 29954 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:17.158226 24036 leader_election.cc:336] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.180146 24036 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 71a48f59ff764d249519c6a53ec57f02, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.182957 30017 raft_consensus.cc:2749] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:17.189025 24034 consensus_peers.cc:597] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:17.197746 29959 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.198372 29959 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.201499 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:17.202174 24598 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 12.
I20260709 12:19:17.203398 24035 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:17.204301 30017 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:17.204747 30017 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.205161 30017 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:17.213290 24036 leader_election.cc:336] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.213779 29959 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:17.239197 30017 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.246767 29959 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.247386 29959 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:17.249359 29959 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:17.249989 24036 leader_election.cc:336] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.252523 29954 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.253033 29954 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.255187 29954 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:17.260573 24566 leader_election.cc:336] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.263083 30011 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.263659 30011 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:17.265686 30011 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:17.275511 24036 leader_election.cc:336] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.275564 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac7e870c1a4544099414fa4aae03e1c2" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:17.276832 24598 raft_consensus.cc:3060] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.276209 30017 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
W20260709 12:19:17.279388 24034 leader_election.cc:336] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:17.279846 24034 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:19:17.280755 24034 leader_election.cc:336] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:17.281495 30017 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.286605 24598 raft_consensus.cc:2468] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 13.
I20260709 12:19:17.287995 24035 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.289057 30017 raft_consensus.cc:2804] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:17.289613 30017 raft_consensus.cc:697] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:17.293092 30017 consensus_queue.cc:237] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:17.301286 24036 leader_election.cc:336] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.306219 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.310465 29959 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.309199 30036 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.310976 29959 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.313763 29959 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:17.315228 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02" is_pre_election: true
I20260709 12:19:17.320561 24598 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 10.
I20260709 12:19:17.321924 24035 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:17.318397 29954 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.322701 30017 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:17.323136 30017 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.322917 29954 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.323541 30017 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.325182 29954 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:17.331108 23815 catalog_manager.cc:5697] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 12 to 13, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 13 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:17.334939 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:17.335551 24061 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 14.
I20260709 12:19:17.338743 30017 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.341712 30017 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4:34635)
I20260709 12:19:17.341899 24598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33e9bcdb00ec45229c3b370172970a07" candidate_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "71a48f59ff764d249519c6a53ec57f02"
I20260709 12:19:17.342551 24598 raft_consensus.cc:3060] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.347841 30017 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.348330 30017 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:17.350152 30017 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:17.350361 24598 raft_consensus.cc:2468] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a46beb8868d749fdbaa732dd1ef6b89b in term 11.
I20260709 12:19:17.351598 24035 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:17.352367 30017 raft_consensus.cc:2804] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:17.352809 30017 raft_consensus.cc:697] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Becoming Leader. State: Replica: a46beb8868d749fdbaa732dd1ef6b89b, State: Running, Role: LEADER
I20260709 12:19:17.353621 30017 consensus_queue.cc:237] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.354115 24566 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
W20260709 12:19:17.354956 24566 leader_election.cc:336] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.355866 29954 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:17.356240 29954 raft_consensus.cc:493] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.356600 29954 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:17.370935 23815 catalog_manager.cc:5697] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b reported cstate change: term changed from 10 to 11, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3). New cstate: current_term: 11 leader_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:17.374061 30017 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.374589 30017 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:17.376636 30017 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:17.382493 30017 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.382962 30017 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:17.384713 30036 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.385020 30017 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:17.385200 30036 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:17.387339 30036 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:17.384478 24036 leader_election.cc:336] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:17.391094 24034 leader_election.cc:336] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:17.400517 29887 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.400995 29887 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.402992 29887 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:17.405146 29954 raft_consensus.cc:515] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.407290 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" is_pre_election: true
I20260709 12:19:17.416884 24061 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 17.
W20260709 12:19:17.409022 24036 leader_election.cc:336] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:17.418115 24036 leader_election.cc:336] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.418610 24036 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:19:17.411446 24034 leader_election.cc:336] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:17.416218 24566 leader_election.cc:336] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:17.426124 24034 leader_election.cc:336] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:17.427930 30036 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.430740 29954 leader_election.cc:290] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:17.432291 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "def9be339f8f4adc820a6a1320fec425" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:19:17.434454 24061 raft_consensus.cc:3060] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:17.441279 24061 raft_consensus.cc:2468] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 15.
W20260709 12:19:17.442600 24034 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:17.446830 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.452858 24566 leader_election.cc:304] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:17.453397 29954 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:17.464214 29954 raft_consensus.cc:493] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting leader election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.464658 29954 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:17.460860 24036 leader_election.cc:336] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.470552 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.471546 30036 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:17.472739 24036 leader_election.cc:336] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.473273 29887 raft_consensus.cc:2804] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:17.478663 29887 raft_consensus.cc:697] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 15 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:19:17.479507 29887 consensus_queue.cc:237] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.498006 24036 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.499075 29954 raft_consensus.cc:515] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:17.500005 24036 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.500063 30017 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.500450 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:17.501118 29954 leader_election.cc:290] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 election: Requested vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:17.501313 30017 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:17.500834 23815 catalog_manager.cc:5697] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 14 to 15, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 15 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:17.506639 24061 raft_consensus.cc:1275] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:19:17.508671 22720 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24017)
I20260709 12:19:17.508875 24061 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da07aaa60743c193b387e6a20fc83b" candidate_uuid: "71a48f59ff764d249519c6a53ec57f02" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a46beb8868d749fdbaa732dd1ef6b89b"
I20260709 12:19:17.509560 24061 raft_consensus.cc:3060] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:17.517606 24061 raft_consensus.cc:2468] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 71a48f59ff764d249519c6a53ec57f02 in term 18.
W20260709 12:19:17.519012 24566 leader_election.cc:336] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.552788 29887 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:17.553587 29887 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:17.555977 29887 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:17.561434 29954 consensus_queue.cc:1048] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:17.564287 24566 leader_election.cc:304] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02, a46beb8868d749fdbaa732dd1ef6b89b; no voters: 
I20260709 12:19:17.570677 29954 raft_consensus.cc:2804] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:17.571177 29954 raft_consensus.cc:697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 18 LEADER]: Becoming Leader. State: Replica: 71a48f59ff764d249519c6a53ec57f02, State: Running, Role: LEADER
I20260709 12:19:17.572028 29954 consensus_queue.cc:237] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:17.581439 24566 leader_election.cc:336] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:17.595728 23815 catalog_manager.cc:5697] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 reported cstate change: term changed from 17 to 18, leader changed from ef0dd15ac654478b8371c22b8909240e (127.22.48.2) to 71a48f59ff764d249519c6a53ec57f02 (127.22.48.4). New cstate: current_term: 18 leader_uuid: "71a48f59ff764d249519c6a53ec57f02" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:19:17.615587 24566 leader_election.cc:336] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:17.743815 24034 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:17.749058 24566 consensus_peers.cc:597] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:17.752229 24566 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111) [suppressed 540 similar messages]
I20260709 12:19:17.820752 24593 raft_consensus.cc:1275] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:17.824800 30036 consensus_queue.cc:1048] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:19:17.875849 24036 consensus_peers.cc:597] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:17.897545 24036 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:17.936213 24061 raft_consensus.cc:1275] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:19:17.938181 29887 consensus_queue.cc:1048] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:19:17.942430 24598 raft_consensus.cc:1275] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Refusing update from remote peer a46beb8868d749fdbaa732dd1ef6b89b: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:17.949245 29959 consensus_queue.cc:1048] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:19:17.970819 24036 consensus_peers.cc:597] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:17.975332 24036 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:17.987649 24036 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:17.992823 24566 consensus_peers.cc:597] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.002851 24036 consensus_peers.cc:597] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.036331 24564 leader_election.cc:336] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:18.037844 24564 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:18.041038 30031 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:18.068531 24566 consensus_peers.cc:597] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:18.079095 24564 leader_election.cc:336] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:18.079941 24564 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:18.080878 30031 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:18.082528 24034 consensus_peers.cc:597] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:18.140072 24566 consensus_peers.cc:597] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:18.146492 24063 raft_consensus.cc:1275] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Refusing update from remote peer 71a48f59ff764d249519c6a53ec57f02: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:19:18.148672 24566 consensus_peers.cc:597] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:18.161404 29954 consensus_queue.cc:1048] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:19:18.175237 24034 consensus_peers.cc:597] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.185376 24564 consensus_peers.cc:597] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.188766 24566 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.205987 24564 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:18.211372 24036 consensus_peers.cc:597] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.213941 24566 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.228277 24566 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.247315 24036 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.250061 24036 consensus_peers.cc:597] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.271996 24036 consensus_peers.cc:597] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.276023 24036 consensus_peers.cc:597] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.284996 24036 consensus_peers.cc:597] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.289757 24566 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.299360 24564 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.336585 24564 consensus_peers.cc:597] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.355310 24566 consensus_peers.cc:597] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.358201 24034 consensus_peers.cc:597] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.380667 24036 consensus_peers.cc:597] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.381312 24566 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.391569 24566 consensus_peers.cc:597] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.397004 24566 consensus_peers.cc:597] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.405838 24036 consensus_peers.cc:597] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.417958 24034 consensus_peers.cc:597] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.428506 24036 consensus_peers.cc:597] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:18.494349 30036 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:18.494976 30036 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:19:18.503602 24036 leader_election.cc:336] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:18.509140 22720 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 24017)
I20260709 12:19:18.508276 30036 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:18.510638 24034 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.512838 24566 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.514056 24034 leader_election.cc:336] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:18.514473 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:18.517330 30036 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:18.536685 24566 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:18.568156 30036 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:18.568809 30036 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:19:18.573143 24034 consensus_peers.cc:597] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:19:18.576347 30036 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:18.583642 29887 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:18.586571 29887 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:18.588594 29887 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:18.586237 24036 leader_election.cc:336] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:18.591725 24034 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.598691 24564 leader_election.cc:336] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:18.614959 24566 leader_election.cc:336] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:18.615937 24566 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:18.616730 29954 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:18.625116 24566 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.635980 24566 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.638489 24034 leader_election.cc:336] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:18.639915 24034 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:18.640674 30036 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:18.650462 24034 consensus_peers.cc:597] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.664772 24564 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.681360 24564 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.726747 24566 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:18.735817 24034 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.748138 24566 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:18.769811 30036 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:18.770443 30036 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:18.775669 30036 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:18.783586 24036 leader_election.cc:336] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:18.784791 24034 leader_election.cc:336] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:18.786024 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:18.786815 30017 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:18.834000 24564 consensus_peers.cc:597] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.848294 24564 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.852926 23804 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.48.1:35685, user_credentials={real_user=slave}} blocked reactor thread for 46978.5us
W20260709 12:19:18.865346 23804 catalog_manager.cc:4755] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ccf053e06f514bffaa9c442a8ea2c144: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:18.900269 24564 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:18.945510 24034 consensus_peers.cc:597] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:18.948210 29959 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:18.948701 29959 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:18.950605 29959 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:18.957516 24034 leader_election.cc:336] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:18.965639 24036 leader_election.cc:336] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:18.966446 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:18.971114 29959 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:19.105116 24034 consensus_peers.cc:597] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:19.120867 24564 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:19.192087 24564 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:19.215322 24564 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:19.224160 24034 consensus_peers.cc:597] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:19.242796 30036 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:19.243319 30036 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:19.245350 30036 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:19.252888 24036 leader_election.cc:336] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:19.254199 24034 leader_election.cc:336] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:19.254591 24034 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:19.256117 30036 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:19.258302 24034 consensus_peers.cc:597] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:19.391520 24034 consensus_peers.cc:597] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:19.441038 30036 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:19.441566 30036 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:19.443840 30036 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
I20260709 12:19:19.450861 30017 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:19.451359 30017 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:19.453344 30017 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:19.460062 24036 leader_election.cc:336] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:19.462839 24034 leader_election.cc:336] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:19.464654 24034 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:19.467983 30017 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:19.464179 24036 leader_election.cc:336] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:19.472637 24034 leader_election.cc:336] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:19.475443 24034 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:19.478790 30036 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:19.504549 24034 consensus_peers.cc:597] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:19.509590 22720 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 24017)
W20260709 12:19:19.535463 24034 consensus_peers.cc:597] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:19.599143 30017 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:19.599669 30017 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:19.601651 30017 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:19.610000 24034 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:19.610821 24036 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:19.611230 24036 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:19.612336 30017 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:19:19.673601 30036 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:19.674149 30036 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:19.676481 30036 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:19.681819 24036 leader_election.cc:336] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:19.682556 24034 consensus_peers.cc:597] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:19.697208 24034 leader_election.cc:336] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:19.697753 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:19.699316 30036 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:19.728078 24564 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:19.838760 30031 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:19.839309 30031 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:19.842176 30031 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:19.847313 24564 leader_election.cc:336] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:19.862885 24566 leader_election.cc:336] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:19.863377 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:19.867147 30031 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:19.877753 24566 consensus_peers.cc:597] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:19.963935 24564 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:19.966143 30052 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:19.966737 30052 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:19.978222 24566 leader_election.cc:336] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:19.974074 30052 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:19.984521 24564 leader_election.cc:336] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:19.985298 24564 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:19.986380 30052 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:20.279839 30053 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:20.280606 30053 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:20.282840 30053 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:20.298130 24566 leader_election.cc:336] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:20.342665 24564 leader_election.cc:336] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:20.343614 24564 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:20.346742 30054 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:20.362407 24566 consensus_peers.cc:597] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.371702 24034 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:20.384315 24036 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.384876 24036 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.422572 24036 consensus_peers.cc:597] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:20.425217 24566 consensus_peers.cc:597] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.456498 24036 consensus_peers.cc:597] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.460613 24564 consensus_peers.cc:597] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:20.483809 24036 consensus_peers.cc:597] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:20.490150 24566 consensus_peers.cc:597] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:20.503226 24564 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:20.510071 22720 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 24017)
W20260709 12:19:20.556576 24034 consensus_peers.cc:597] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:19:20.618248 29959 raft_consensus.cc:493] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:20.624759 29959 raft_consensus.cc:515] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:19:20.625602 24566 consensus_peers.cc:597] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:20.629176 29959 leader_election.cc:290] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:20.636451 24036 leader_election.cc:336] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:20.650416 24034 consensus_peers.cc:597] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:20.650967 24034 leader_election.cc:336] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:20.651387 24034 leader_election.cc:304] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:20.652127 29959 raft_consensus.cc:2749] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:20.673498 24564 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:20.674408 24566 consensus_peers.cc:597] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.693260 24566 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.716869 24036 consensus_peers.cc:597] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.730577 24036 consensus_peers.cc:597] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.739710 24036 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.749758 24036 consensus_peers.cc:597] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.798839 24036 consensus_peers.cc:597] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.804395 24566 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.855638 24564 consensus_peers.cc:597] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:20.871479 24036 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.872747 24566 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.891673 24566 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.894596 24036 consensus_peers.cc:597] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.904948 24566 consensus_peers.cc:597] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:20.965265 24034 consensus_peers.cc:597] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:20.968132 24036 consensus_peers.cc:597] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:20.999883 30036 raft_consensus.cc:493] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:21.000524 30036 raft_consensus.cc:515] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:21.005052 30036 leader_election.cc:290] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:21.015529 24034 consensus_peers.cc:597] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.052882 24036 consensus_peers.cc:597] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:21.057847 24036 leader_election.cc:336] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:21.051167 24566 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:21.059621 24566 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:21.067155 24034 leader_election.cc:336] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:21.067689 24034 leader_election.cc:304] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:21.069357 30036 raft_consensus.cc:2749] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:21.072173 24034 consensus_peers.cc:597] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.097028 24566 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:21.163395 24034 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.165223 24034 consensus_peers.cc:597] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.241487 24036 consensus_peers.cc:597] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:21.271210 24564 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.294637 24564 consensus_peers.cc:597] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.355648 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08003747a0 after lost signal to thread 22723
W20260709 12:19:21.358292 24621 debug-util.cc:398] Leaking SignalData structure 0x7b0800380c60 after lost signal to thread 23853
W20260709 12:19:21.361462 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4480 after lost signal to thread 24094
W20260709 12:19:21.364971 24621 debug-util.cc:398] Leaking SignalData structure 0x7b08003be580 after lost signal to thread 24624
W20260709 12:19:21.377848 24566 consensus_peers.cc:597] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:21.379151 24566 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:21.409142 24564 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:19:21.411018 30060 raft_consensus.cc:493] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:21.412668 30060 raft_consensus.cc:515] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:21.419668 30060 leader_election.cc:290] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:21.436802 24564 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.437222 24034 leader_election.cc:336] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:21.439162 24034 consensus_peers.cc:597] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.448132 24036 leader_election.cc:336] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:21.448606 24566 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:42409, user_credentials={real_user=slave}} blocked reactor thread for 51150.9us
I20260709 12:19:21.448695 24036 leader_election.cc:304] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:21.450301 30061 raft_consensus.cc:2749] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:21.474524 24566 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:21.481613 24566 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:21.492671 30062 raft_consensus.cc:493] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:21.493456 30062 raft_consensus.cc:515] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
W20260709 12:19:21.501111 24034 leader_election.cc:336] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:21.502234 30062 leader_election.cc:290] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:21.502857 24566 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:21.510685 22720 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 24017)
W20260709 12:19:21.519176 24036 leader_election.cc:336] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:21.519732 24036 leader_election.cc:304] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:21.520972 30062 raft_consensus.cc:2749] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:21.555284 24034 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.563666 24564 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.570588 24564 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:21.608002 24034 consensus_peers.cc:597] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:21.661600 24564 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:21.697320 24034 consensus_peers.cc:597] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:19:21.733105 30061 raft_consensus.cc:493] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:21.733763 30061 raft_consensus.cc:515] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:21.741021 30061 leader_election.cc:290] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:21.742141 24034 leader_election.cc:336] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:21.743495 24036 leader_election.cc:336] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:21.743927 24036 leader_election.cc:304] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:21.744728 30061 raft_consensus.cc:2749] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:21.810669 24564 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:19:21.857748 30062 raft_consensus.cc:493] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:21.858758 30062 raft_consensus.cc:515] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:21.860882 30062 leader_election.cc:290] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:21.870226 24034 leader_election.cc:336] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:21.870994 24036 leader_election.cc:336] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:21.871414 24036 leader_election.cc:304] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:21.872126 30062 raft_consensus.cc:2749] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:21.889832 24034 consensus_peers.cc:597] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:22.006763 24034 consensus_peers.cc:597] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:19:22.019335 30062 raft_consensus.cc:493] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:22.020004 30062 raft_consensus.cc:515] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:22.022147 30062 leader_election.cc:290] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:22.036114 24036 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:22.040962 24034 leader_election.cc:336] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:22.041654 24034 leader_election.cc:304] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:22.043708 30062 raft_consensus.cc:2749] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:19:22.058993 24034 consensus_peers.cc:597] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:22.125921 24034 consensus_peers.cc:597] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:19:22.136754 30066 raft_consensus.cc:493] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:22.137356 30066 raft_consensus.cc:515] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:22.139412 30066 leader_election.cc:290] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:22.155249 24036 leader_election.cc:336] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:22.181254 24034 leader_election.cc:336] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:22.184912 24034 leader_election.cc:304] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:22.186408 30067 raft_consensus.cc:2749] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:22.189529 24034 consensus_peers.cc:597] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:22.194134 24034 consensus_peers.cc:597] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:19:22.263456 30061 raft_consensus.cc:493] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:22.264088 30061 raft_consensus.cc:515] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } }
I20260709 12:19:22.266201 30061 leader_election.cc:290] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:22.272294 24034 leader_election.cc:336] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:22.275660 24036 leader_election.cc:336] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:22.276124 24036 leader_election.cc:304] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a46beb8868d749fdbaa732dd1ef6b89b; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:22.277511 30067 raft_consensus.cc:2749] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:22.412849 24564 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:22.658908 24036 consensus_peers.cc:597] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:22.661300 22720 tablet_server.cc:196] TabletServer@127.22.48.2:0 shutdown complete.
W20260709 12:19:22.699172 24566 consensus_peers.cc:597] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:22.700702 24564 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:19:22.756999 24036 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111) [suppressed 692 similar messages]
W20260709 12:19:22.769868 24566 consensus_peers.cc:597] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:22.856432 24036 consensus_peers.cc:597] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:22.870227 24566 consensus_peers.cc:597] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:22.880511 30065 raft_consensus.cc:493] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:22.881378 30065 raft_consensus.cc:515] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:22.884004 30065 leader_election.cc:290] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:22.890105 24564 leader_election.cc:336] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:22.893852 24566 leader_election.cc:336] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:22.894428 24566 leader_election.cc:304] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:22.895267 30065 raft_consensus.cc:2749] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:22.913414 24036 consensus_peers.cc:597] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:19:22.960964 22720 tablet_server.cc:179] TabletServer@127.22.48.3:0 shutting down...
W20260709 12:19:23.009022 24566 consensus_peers.cc:597] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:23.025851 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:23.027204 22720 tablet_replica.cc:333] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.028316 22720 raft_consensus.cc:2243] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.030071 22720 raft_consensus.cc:2272] T 58aa4c7f8ec14db884253c7b025e4c26 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:23.031942 24564 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:23.032739 22720 tablet_replica.cc:333] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.033423 22720 raft_consensus.cc:2243] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.033900 22720 raft_consensus.cc:2272] T 04e684c6cc9c44a496daa6c45678df59 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.036192 22720 tablet_replica.cc:333] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.036769 22720 raft_consensus.cc:2243] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.037250 22720 raft_consensus.cc:2272] T d7f76f3699ab4bae8da2e38abd9f9348 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.039584 22720 tablet_replica.cc:333] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.040412 22720 raft_consensus.cc:2243] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.041729 22720 raft_consensus.cc:2272] T 675e57b981c1430ba502ba18c21dd0a4 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:23.043392 24034 consensus_peers.cc:597] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:23.045382 22720 tablet_replica.cc:333] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.046268 22720 raft_consensus.cc:2243] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.047451 22720 raft_consensus.cc:2272] T 8dc5fe36cbf643f18c228bc420036e0c P a46beb8868d749fdbaa732dd1ef6b89b [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:23.048738 24566 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:23.050122 22720 tablet_replica.cc:333] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.050982 22720 raft_consensus.cc:2243] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.052156 22720 raft_consensus.cc:2272] T 3d2e07822f804c3c9a8ff2c0177d5d72 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.054558 22720 tablet_replica.cc:333] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.055119 22720 raft_consensus.cc:2243] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.055989 22720 raft_consensus.cc:2272] T 2a33810a45fd4e70b0d4411b8c0afdd6 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.058187 22720 tablet_replica.cc:333] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.058935 22720 raft_consensus.cc:2243] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.060048 22720 raft_consensus.cc:2272] T 8ac362fb6ce545719be79028c2676d8f P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.062568 22720 tablet_replica.cc:333] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.063397 22720 raft_consensus.cc:2243] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.064591 22720 raft_consensus.cc:2272] T b36a4b120beb473694980945af8d8909 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:23.064733 24036 consensus_peers.cc:597] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:23.067186 22720 tablet_replica.cc:333] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.067823 22720 raft_consensus.cc:2243] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.068956 22720 raft_consensus.cc:2272] T ccf053e06f514bffaa9c442a8ea2c144 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:23.069756 24566 consensus_peers.cc:597] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.071496 22720 tablet_replica.cc:333] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.072199 22720 raft_consensus.cc:2243] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.072767 22720 raft_consensus.cc:2272] T 6850e6a4a82a49d689423ed8fb40c891 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.074950 22720 tablet_replica.cc:333] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.075513 22720 raft_consensus.cc:2243] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.076428 22720 raft_consensus.cc:2272] T c59becc061884c78add6c7ec0be6583c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.078465 22720 tablet_replica.cc:333] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.078999 22720 raft_consensus.cc:2243] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.079552 22720 raft_consensus.cc:2272] T 2fb39e36ee084608a322a8fa84ccde2d P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.082208 22720 tablet_replica.cc:333] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.083019 22720 raft_consensus.cc:2243] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.083731 22720 raft_consensus.cc:2272] T 0740227aa014467da8e8269927b1cfda P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.085961 22720 tablet_replica.cc:333] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.086545 22720 raft_consensus.cc:2243] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.087158 22720 raft_consensus.cc:2272] T 9661e61546884b0aa0c1e828cd13e76e P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.089239 22720 tablet_replica.cc:333] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.089799 22720 raft_consensus.cc:2243] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.091039 22720 raft_consensus.cc:2272] T 432ae242d4354d208df9f37d432ef3f7 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.092908 22720 tablet_replica.cc:333] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.093437 22720 raft_consensus.cc:2243] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.094385 22720 raft_consensus.cc:2272] T da0449b96d0e4a57b82ad92e05c4cea7 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.096089 22720 tablet_replica.cc:333] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.096668 22720 raft_consensus.cc:2243] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.097605 22720 raft_consensus.cc:2272] T eac75053172041f285deb68d4418ed57 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.099473 22720 tablet_replica.cc:333] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.100163 22720 raft_consensus.cc:2243] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.101169 22720 raft_consensus.cc:2272] T 49b6c160a80f417b89957aa0a1f5dd34 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.104110 22720 tablet_replica.cc:333] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.104918 22720 raft_consensus.cc:2243] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.106168 22720 raft_consensus.cc:2272] T 368f96220d5b4469885774acf06e4475 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:23.107596 24566 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.108711 22720 tablet_replica.cc:333] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.110102 22720 raft_consensus.cc:2243] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:23.110244 24564 consensus_peers.cc:597] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:23.110751 22720 raft_consensus.cc:2272] T 9f761e3dc48440849d367f5e28b48adb P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.113406 22720 tablet_replica.cc:333] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.114153 22720 raft_consensus.cc:2243] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.115247 22720 raft_consensus.cc:2272] T 2e9a767edf8b423cb0ef561b055f670a P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.117576 22720 tablet_replica.cc:333] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.118383 22720 raft_consensus.cc:2243] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.119606 22720 raft_consensus.cc:2272] T 1298b4797007440ca5cc586fd47928e8 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.122774 22720 tablet_replica.cc:333] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.123914 22720 raft_consensus.cc:2243] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.125281 22720 raft_consensus.cc:2272] T ac7e870c1a4544099414fa4aae03e1c2 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.128088 22720 tablet_replica.cc:333] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.128918 22720 raft_consensus.cc:2243] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.130133 22720 raft_consensus.cc:2272] T 5ccb15a6c98843f3836da9918c1195dc P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.132241 22720 tablet_replica.cc:333] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.132771 22720 raft_consensus.cc:2243] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.133463 22720 raft_consensus.cc:2272] T a3da07aaa60743c193b387e6a20fc83b P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.135391 22720 tablet_replica.cc:333] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.135921 22720 raft_consensus.cc:2243] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.136983 22720 raft_consensus.cc:2272] T 15e681cfd0fe4e6f9e747ba4c2345a95 P a46beb8868d749fdbaa732dd1ef6b89b [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.138856 22720 tablet_replica.cc:333] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.139379 22720 raft_consensus.cc:2243] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.139981 22720 raft_consensus.cc:2272] T 6869b2949cb848a79c8263a5be455d66 P a46beb8868d749fdbaa732dd1ef6b89b [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.141799 22720 tablet_replica.cc:333] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.142388 22720 raft_consensus.cc:2243] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.142865 22720 raft_consensus.cc:2272] T 0caf361b460241abb91679f8f8b6e7e4 P a46beb8868d749fdbaa732dd1ef6b89b [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.144747 22720 tablet_replica.cc:333] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.145273 22720 raft_consensus.cc:2243] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.145725 22720 raft_consensus.cc:2272] T def9be339f8f4adc820a6a1320fec425 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.147555 22720 tablet_replica.cc:333] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.148077 22720 raft_consensus.cc:2243] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.148921 22720 raft_consensus.cc:2272] T 8132db9882c041d1845d0a8815c39788 P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.150686 22720 tablet_replica.cc:333] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.151221 22720 raft_consensus.cc:2243] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.152675 22720 raft_consensus.cc:2272] T 2b80ceeebb5c4f0aaaecd9da202550b0 P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.155066 22720 tablet_replica.cc:333] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.155572 22720 raft_consensus.cc:2243] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.156068 22720 raft_consensus.cc:2272] T 295a8f22b14a4f92b8abb10a4a03e184 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.158339 22720 tablet_replica.cc:333] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.158841 22720 raft_consensus.cc:2243] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.160005 22720 raft_consensus.cc:2272] T 238addf610d94f84b346a29e1e4b0e52 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.162267 22720 tablet_replica.cc:333] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.162922 22720 raft_consensus.cc:2243] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:23.163174 24564 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:19:23.163633 22720 raft_consensus.cc:2272] T 1a27cf3ad031452fa9b230da94f82f48 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:23.164007 24566 consensus_peers.cc:597] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.165771 22720 tablet_replica.cc:333] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.166426 22720 raft_consensus.cc:2243] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.166929 22720 raft_consensus.cc:2272] T 5e9f2592cbef4c2d92a345546231175a P a46beb8868d749fdbaa732dd1ef6b89b [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.168807 22720 tablet_replica.cc:333] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.169413 22720 raft_consensus.cc:2243] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.170210 22720 raft_consensus.cc:2272] T ea07088f87a54d2194bc706db4279d24 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.172730 22720 tablet_replica.cc:333] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.173468 22720 raft_consensus.cc:2243] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.174631 22720 raft_consensus.cc:2272] T 7e53ff7433274cdf9c150f141d03e1f5 P a46beb8868d749fdbaa732dd1ef6b89b [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.177177 22720 tablet_replica.cc:333] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.177733 22720 raft_consensus.cc:2243] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:23.177767 24566 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:23.178459 22720 raft_consensus.cc:2272] T 8b3cbce810b542c7b032e8cbe30abbfd P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.180272 22720 tablet_replica.cc:333] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.180785 22720 raft_consensus.cc:2243] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.181361 22720 raft_consensus.cc:2272] T f58a6c8f74504786b09cf0261ea665c7 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.183451 22720 tablet_replica.cc:333] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.184010 22720 raft_consensus.cc:2243] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.185245 22720 raft_consensus.cc:2272] T 3e002c45f325450c832f48fca5627fcd P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.187657 22720 tablet_replica.cc:333] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.188202 22720 raft_consensus.cc:2243] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.189036 22720 raft_consensus.cc:2272] T 479416b99927471b8600549d94ad4873 P a46beb8868d749fdbaa732dd1ef6b89b [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.190985 22720 tablet_replica.cc:333] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.191498 22720 raft_consensus.cc:2243] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.192456 22720 raft_consensus.cc:2272] T c11fc035985e44dfa44a64cfba349977 P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.194664 22720 tablet_replica.cc:333] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.195308 22720 raft_consensus.cc:2243] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.195952 22720 raft_consensus.cc:2272] T bdddb53d197e4af78460302ce75bc88c P a46beb8868d749fdbaa732dd1ef6b89b [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:23.197615 24566 consensus_peers.cc:597] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.198153 22720 tablet_replica.cc:333] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.198714 22720 raft_consensus.cc:2243] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:23.199378 22720 raft_consensus.cc:2272] T ea2fd010d40d4400b7b9f1b9cca54a0c P a46beb8868d749fdbaa732dd1ef6b89b [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.201289 22720 tablet_replica.cc:333] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b: stopping tablet replica
I20260709 12:19:23.201742 22720 raft_consensus.cc:2243] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:19:23.202698 22720 raft_consensus.cc:2272] T 33e9bcdb00ec45229c3b370172970a07 P a46beb8868d749fdbaa732dd1ef6b89b [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:23.253850 30065 raft_consensus.cc:493] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:23.254539 30065 raft_consensus.cc:515] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:23.256758 30065 leader_election.cc:290] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:23.261615 24566 leader_election.cc:336] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:23.262550 24564 leader_election.cc:336] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:23.262986 24564 leader_election.cc:304] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:23.263691 30065 raft_consensus.cc:2749] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:23.265661 24566 consensus_peers.cc:597] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.274899 24564 consensus_peers.cc:597] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:23.280536 24566 consensus_peers.cc:597] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.283032 24566 consensus_peers.cc:597] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.304335 24566 consensus_peers.cc:597] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.331274 24566 consensus_peers.cc:597] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.417191 24566 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.425812 24566 consensus_peers.cc:597] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.429541 24566 consensus_peers.cc:597] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.441506 24566 consensus_peers.cc:597] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:19:23.450562 24564 consensus_peers.cc:597] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:23.456457 24566 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.458781 24566 consensus_peers.cc:597] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.494141 24566 consensus_peers.cc:597] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.503252 24566 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.512456 24566 consensus_peers.cc:597] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:23.525071 24566 consensus_peers.cc:597] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:23.535113 30065 raft_consensus.cc:493] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader ef0dd15ac654478b8371c22b8909240e)
I20260709 12:19:23.535713 30065 raft_consensus.cc:515] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:23.537897 30065 leader_election.cc:290] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801)
W20260709 12:19:23.541002 24564 leader_election.cc:336] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:23.541721 24566 leader_election.cc:336] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:23.542047 24566 leader_election.cc:304] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:23.542642 30065 raft_consensus.cc:2749] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:23.562784 24564 consensus_peers.cc:597] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:23.663458 24566 consensus_peers.cc:597] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.711423 24566 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.752336 24564 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:23.782169 24566 consensus_peers.cc:597] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.787734 24091 debug-util.cc:398] Leaking SignalData structure 0x7b08003799c0 after lost signal to thread 22723
W20260709 12:19:23.788818 24091 debug-util.cc:398] Leaking SignalData structure 0x7b0800321280 after lost signal to thread 23853
W20260709 12:19:23.790056 24091 debug-util.cc:398] Leaking SignalData structure 0x7b080037a580 after lost signal to thread 24094
W20260709 12:19:23.791245 24091 debug-util.cc:398] Leaking SignalData structure 0x7b080037a420 after lost signal to thread 24624
W20260709 12:19:23.850165 24566 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.896028 24566 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:23.912344 24564 consensus_peers.cc:597] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:19:24.025816 24566 consensus_peers.cc:597] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:24.079893 30071 raft_consensus.cc:493] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.080438 30071 raft_consensus.cc:515] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:24.087867 24564 consensus_peers.cc:597] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:24.086588 30071 leader_election.cc:290] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:24.095291 30065 raft_consensus.cc:493] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.095852 30065 raft_consensus.cc:515] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.098433 30065 leader_election.cc:290] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.103787 24566 leader_election.cc:336] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
W20260709 12:19:24.106796 24564 leader_election.cc:336] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:24.107136 24566 leader_election.cc:336] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:24.107296 24564 consensus_peers.cc:597] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:19:24.107583 24566 leader_election.cc:304] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:24.108331 30065 raft_consensus.cc:2749] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:24.109028 24566 leader_election.cc:336] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.109454 24566 leader_election.cc:304] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.110109 30071 raft_consensus.cc:2749] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:24.116920 24566 leader_election.cc:336] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:24.174926 30068 raft_consensus.cc:493] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.175745 30068 raft_consensus.cc:515] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.177934 30068 leader_election.cc:290] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.181870 24566 leader_election.cc:336] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
W20260709 12:19:24.183466 24564 leader_election.cc:336] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:24.183847 24564 leader_election.cc:304] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.184464 30068 raft_consensus.cc:2749] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:24.210928 24564 consensus_peers.cc:597] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:19:24.247540 30073 raft_consensus.cc:493] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.247778 30068 raft_consensus.cc:493] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.248118 30073 raft_consensus.cc:515] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.248296 30068 raft_consensus.cc:515] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.250299 30073 leader_election.cc:290] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:24.250253 30068 leader_election.cc:290] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.257619 24564 leader_election.cc:336] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:24.257798 24566 leader_election.cc:336] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:24.258466 24566 leader_election.cc:336] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.258800 24566 leader_election.cc:304] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:24.259394 30068 raft_consensus.cc:2749] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:24.259565 24566 leader_election.cc:336] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.259981 24566 leader_election.cc:304] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.260643 30073 raft_consensus.cc:2749] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:19:24.297871 22720 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24091)
I20260709 12:19:24.345938 30068 raft_consensus.cc:493] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.347164 30073 raft_consensus.cc:493] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.346624 30068 raft_consensus.cc:515] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.347764 30073 raft_consensus.cc:515] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.349255 30068 leader_election.cc:290] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:24.349961 30073 leader_election.cc:290] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:24.350723 30073 raft_consensus.cc:493] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.351320 30073 raft_consensus.cc:515] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.354802 30073 leader_election.cc:290] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.357273 24564 leader_election.cc:336] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:24.358351 30065 raft_consensus.cc:493] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.358825 30065 raft_consensus.cc:515] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.360440 30065 leader_election.cc:290] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.364360 24564 leader_election.cc:336] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:24.367329 24566 leader_election.cc:336] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:24.368750 24566 leader_election.cc:336] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.369074 24566 leader_election.cc:304] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:24.369673 30065 raft_consensus.cc:2749] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:24.369838 24566 leader_election.cc:336] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.370390 24566 leader_election.cc:304] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.370635 30065 raft_consensus.cc:493] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:19:24.371237 24566 leader_election.cc:336] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.371097 30065 raft_consensus.cc:515] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.372001 30068 raft_consensus.cc:2749] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:24.373605 30065 leader_election.cc:290] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.377902 24566 leader_election.cc:336] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:24.378322 24566 leader_election.cc:304] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:24.378937 30065 raft_consensus.cc:2749] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:24.379508 24566 leader_election.cc:336] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.379930 24566 leader_election.cc:304] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.380556 30065 raft_consensus.cc:2749] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:24.383355 24566 leader_election.cc:336] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:24.384147 24566 leader_election.cc:336] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.384474 24566 leader_election.cc:304] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:24.385016 30065 raft_consensus.cc:2749] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:24.428205 30065 raft_consensus.cc:493] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.428776 30065 raft_consensus.cc:515] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.430572 30065 leader_election.cc:290] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.435559 24566 leader_election.cc:336] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
W20260709 12:19:24.436241 24566 leader_election.cc:336] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.436578 24566 leader_election.cc:304] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:24.437135 30065 raft_consensus.cc:2749] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:24.462270 30065 raft_consensus.cc:493] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.462849 30065 raft_consensus.cc:515] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.465124 30065 leader_election.cc:290] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:24.469417 30065 raft_consensus.cc:493] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
W20260709 12:19:24.469981 24566 leader_election.cc:336] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:24.469949 30065 raft_consensus.cc:515] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
W20260709 12:19:24.471603 24566 leader_election.cc:336] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.472115 24566 leader_election.cc:304] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: a46beb8868d749fdbaa732dd1ef6b89b, ef0dd15ac654478b8371c22b8909240e
I20260709 12:19:24.473142 30068 raft_consensus.cc:2749] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.475732 30065 leader_election.cc:290] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.477878 24564 leader_election.cc:336] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:24.480406 24566 leader_election.cc:336] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.480825 24566 leader_election.cc:304] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.481544 30065 raft_consensus.cc:2749] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:24.516640 30068 raft_consensus.cc:493] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.517222 30068 raft_consensus.cc:515] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "ef0dd15ac654478b8371c22b8909240e" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 43801 } attrs { replace: true } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.520030 30068 leader_election.cc:290] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:24.521199 30068 raft_consensus.cc:493] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.521699 30068 raft_consensus.cc:515] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.523952 30068 leader_election.cc:290] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.525337 24564 leader_election.cc:336] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:24.530138 24566 leader_election.cc:336] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111)
I20260709 12:19:24.530750 24566 leader_election.cc:304] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, ef0dd15ac654478b8371c22b8909240e
W20260709 12:19:24.531170 24564 leader_election.cc:336] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:24.531723 24566 leader_election.cc:336] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.532006 30068 raft_consensus.cc:2749] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:24.532619 24566 leader_election.cc:336] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.533178 24566 leader_election.cc:304] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.533933 30068 raft_consensus.cc:2749] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:24.545320 30068 raft_consensus.cc:493] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.545862 30068 raft_consensus.cc:515] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.549325 30068 leader_election.cc:290] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.554715 24566 leader_election.cc:336] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
W20260709 12:19:24.556051 24564 leader_election.cc:336] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:24.556563 24564 leader_election.cc:304] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.557377 30068 raft_consensus.cc:2749] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:19:24.577896 24564 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:19:24.582983 30068 raft_consensus.cc:493] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.583649 30068 raft_consensus.cc:515] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.584043 30065 raft_consensus.cc:493] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.584597 30065 raft_consensus.cc:515] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.586622 30068 leader_election.cc:290] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
I20260709 12:19:24.590900 30065 leader_election.cc:290] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.595709 24566 leader_election.cc:336] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
W20260709 12:19:24.596549 24564 leader_election.cc:336] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:24.597030 24564 leader_election.cc:304] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.597842 30065 raft_consensus.cc:2749] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:24.604357 24566 leader_election.cc:336] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
W20260709 12:19:24.606961 24564 leader_election.cc:336] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:24.607434 24564 leader_election.cc:304] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.608189 30065 raft_consensus.cc:2749] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:24.655650 30068 raft_consensus.cc:493] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a46beb8868d749fdbaa732dd1ef6b89b)
I20260709 12:19:24.656189 30068 raft_consensus.cc:515] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0829ddf18f07439086398756b9c6d216" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 35685 } } peers { permanent_uuid: "a46beb8868d749fdbaa732dd1ef6b89b" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 42409 } } peers { permanent_uuid: "71a48f59ff764d249519c6a53ec57f02" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34635 } attrs { promote: false } }
I20260709 12:19:24.658187 30068 leader_election.cc:290] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685), a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409)
W20260709 12:19:24.665133 24564 leader_election.cc:336] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
W20260709 12:19:24.667038 24566 leader_election.cc:336] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111)
I20260709 12:19:24.667537 24566 leader_election.cc:304] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 71a48f59ff764d249519c6a53ec57f02; no voters: 0829ddf18f07439086398756b9c6d216, a46beb8868d749fdbaa732dd1ef6b89b
I20260709 12:19:24.668247 30068 raft_consensus.cc:2749] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:24.783100 24564 consensus_peers.cc:597] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:19:24.943739 24566 consensus_peers.cc:597] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:19:25.170069 24566 consensus_peers.cc:597] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:19:25.248323 22720 tablet_server.cc:196] TabletServer@127.22.48.3:0 shutdown complete.
W20260709 12:19:25.346714 24564 consensus_peers.cc:597] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 -> Peer 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): Couldn't send request to peer 0829ddf18f07439086398756b9c6d216. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:19:25.359841 22720 tablet_server.cc:179] TabletServer@127.22.48.4:0 shutting down...
W20260709 12:19:25.392408 24566 consensus_peers.cc:597] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 -> Peer ef0dd15ac654478b8371c22b8909240e (127.22.48.2:43801): Couldn't send request to peer ef0dd15ac654478b8371c22b8909240e. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:43801: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:19:25.409228 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:25.410238 22720 tablet_replica.cc:333] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.411443 22720 raft_consensus.cc:2243] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.412358 22720 raft_consensus.cc:2272] T ccf053e06f514bffaa9c442a8ea2c144 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.416205 22720 tablet_replica.cc:333] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.417667 22720 raft_consensus.cc:2243] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:25.418568 24566 consensus_peers.cc:597] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 -> Peer a46beb8868d749fdbaa732dd1ef6b89b (127.22.48.3:42409): Couldn't send request to peer a46beb8868d749fdbaa732dd1ef6b89b. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:42409: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:25.418728 22720 raft_consensus.cc:2272] T 58aa4c7f8ec14db884253c7b025e4c26 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.422017 22720 tablet_replica.cc:333] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.423072 22720 raft_consensus.cc:2243] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.424045 22720 raft_consensus.cc:2272] T 04e684c6cc9c44a496daa6c45678df59 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.426362 22720 tablet_replica.cc:333] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.427255 22720 raft_consensus.cc:2243] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.428826 22720 raft_consensus.cc:2272] T 371c317c26eb44cd875c5925f4b31bd6 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.431854 22720 tablet_replica.cc:333] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.432461 22720 raft_consensus.cc:2243] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.433352 22720 raft_consensus.cc:2272] T fe5bb4f2e9f04fbb9241a5e24d5ae777 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.435544 22720 tablet_replica.cc:333] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.436152 22720 raft_consensus.cc:2243] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.436635 22720 raft_consensus.cc:2272] T 2b80ceeebb5c4f0aaaecd9da202550b0 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.438796 22720 tablet_replica.cc:333] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.439357 22720 raft_consensus.cc:2243] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.440200 22720 raft_consensus.cc:2272] T 9661e61546884b0aa0c1e828cd13e76e P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.442344 22720 tablet_replica.cc:333] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.442948 22720 raft_consensus.cc:2243] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.443583 22720 raft_consensus.cc:2272] T 238addf610d94f84b346a29e1e4b0e52 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.446161 22720 tablet_replica.cc:333] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.447136 22720 raft_consensus.cc:2243] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.448009 22720 raft_consensus.cc:2272] T e3aeb6bd2fca4ca5933e1f4a8ae01c71 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.450188 22720 tablet_replica.cc:333] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.450809 22720 raft_consensus.cc:2243] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.451671 22720 raft_consensus.cc:2272] T e905a7d4b6d64ec49ad9485c349179cb P 71a48f59ff764d249519c6a53ec57f02 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.453580 22720 tablet_replica.cc:333] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.454108 22720 raft_consensus.cc:2243] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.454963 22720 raft_consensus.cc:2272] T 4db304f4ee46489296e4f0f6b21cac26 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.456880 22720 tablet_replica.cc:333] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.457484 22720 raft_consensus.cc:2243] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.457949 22720 raft_consensus.cc:2272] T 8dc5fe36cbf643f18c228bc420036e0c P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.460059 22720 tablet_replica.cc:333] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.460593 22720 raft_consensus.cc:2243] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.461041 22720 raft_consensus.cc:2272] T b36a4b120beb473694980945af8d8909 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.463052 22720 tablet_replica.cc:333] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.463617 22720 raft_consensus.cc:2243] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.465149 22720 raft_consensus.cc:2272] T def9be339f8f4adc820a6a1320fec425 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.467787 22720 tablet_replica.cc:333] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.468417 22720 raft_consensus.cc:2243] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.469020 22720 raft_consensus.cc:2272] T 479416b99927471b8600549d94ad4873 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.471446 22720 tablet_replica.cc:333] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.472034 22720 raft_consensus.cc:2243] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.472651 22720 raft_consensus.cc:2272] T e22d6a51d8e04f7bbcad59376624aa20 P 71a48f59ff764d249519c6a53ec57f02 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.474612 22720 tablet_replica.cc:333] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.475160 22720 raft_consensus.cc:2243] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.475776 22720 raft_consensus.cc:2272] T 2e9a767edf8b423cb0ef561b055f670a P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.477614 22720 tablet_replica.cc:333] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.478121 22720 raft_consensus.cc:2243] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.478909 22720 raft_consensus.cc:2272] T 9f761e3dc48440849d367f5e28b48adb P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.480806 22720 tablet_replica.cc:333] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.481422 22720 raft_consensus.cc:2243] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.481870 22720 raft_consensus.cc:2272] T 33e9bcdb00ec45229c3b370172970a07 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.484144 22720 tablet_replica.cc:333] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.484866 22720 raft_consensus.cc:2243] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.485940 22720 raft_consensus.cc:2272] T 392f06df3ae54cb5a9746fdbb980ad3d P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.488694 22720 tablet_replica.cc:333] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.489461 22720 raft_consensus.cc:2243] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.490444 22720 raft_consensus.cc:2272] T 5db9cea3b8f64883a51327db383cd13e P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.492493 22720 tablet_replica.cc:333] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.493038 22720 raft_consensus.cc:2243] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.494026 22720 raft_consensus.cc:2272] T 10cd478aa7e9411bba254e94713f91de P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.496183 22720 tablet_replica.cc:333] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.496706 22720 raft_consensus.cc:2243] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.497493 22720 raft_consensus.cc:2272] T 9a0df8b4c2674e279e8740ab00a67267 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.499478 22720 tablet_replica.cc:333] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.499996 22720 raft_consensus.cc:2243] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.500486 22720 raft_consensus.cc:2272] T da0449b96d0e4a57b82ad92e05c4cea7 P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.502506 22720 tablet_replica.cc:333] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.503008 22720 raft_consensus.cc:2243] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.503814 22720 raft_consensus.cc:2272] T ea07088f87a54d2194bc706db4279d24 P 71a48f59ff764d249519c6a53ec57f02 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.505679 22720 tablet_replica.cc:333] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.506211 22720 raft_consensus.cc:2243] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.506747 22720 raft_consensus.cc:2272] T 7e53ff7433274cdf9c150f141d03e1f5 P 71a48f59ff764d249519c6a53ec57f02 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.508782 22720 tablet_replica.cc:333] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.509485 22720 raft_consensus.cc:2243] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.510247 22720 raft_consensus.cc:2272] T 8b3cbce810b542c7b032e8cbe30abbfd P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.512156 22720 tablet_replica.cc:333] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.512678 22720 raft_consensus.cc:2243] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.513470 22720 raft_consensus.cc:2272] T f58a6c8f74504786b09cf0261ea665c7 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.515242 22720 tablet_replica.cc:333] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.515820 22720 raft_consensus.cc:2243] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.516914 22720 raft_consensus.cc:2272] T 368f96220d5b4469885774acf06e4475 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.519291 22720 tablet_replica.cc:333] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.519814 22720 raft_consensus.cc:2243] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.520332 22720 raft_consensus.cc:2272] T eac75053172041f285deb68d4418ed57 P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.522255 22720 tablet_replica.cc:333] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.522950 22720 raft_consensus.cc:2243] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.523864 22720 raft_consensus.cc:2272] T 2fb39e36ee084608a322a8fa84ccde2d P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.526115 22720 tablet_replica.cc:333] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.526634 22720 raft_consensus.cc:2243] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.527752 22720 raft_consensus.cc:2272] T 5c6dc6b578324215a52f1a0a5f46c3d4 P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.529597 22720 tablet_replica.cc:333] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.530124 22720 raft_consensus.cc:2243] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.530587 22720 raft_consensus.cc:2272] T 675e57b981c1430ba502ba18c21dd0a4 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.532650 22720 tablet_replica.cc:333] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.533218 22720 raft_consensus.cc:2243] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.533696 22720 raft_consensus.cc:2272] T 2a33810a45fd4e70b0d4411b8c0afdd6 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.535665 22720 tablet_replica.cc:333] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.536290 22720 raft_consensus.cc:2243] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.536923 22720 raft_consensus.cc:2272] T c11fc035985e44dfa44a64cfba349977 P 71a48f59ff764d249519c6a53ec57f02 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.539204 22720 tablet_replica.cc:333] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.539743 22720 raft_consensus.cc:2243] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.540490 22720 raft_consensus.cc:2272] T 0caf361b460241abb91679f8f8b6e7e4 P 71a48f59ff764d249519c6a53ec57f02 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.542498 22720 tablet_replica.cc:333] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.542990 22720 raft_consensus.cc:2243] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.543567 22720 raft_consensus.cc:2272] T 1298b4797007440ca5cc586fd47928e8 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.545789 22720 tablet_replica.cc:333] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.546353 22720 raft_consensus.cc:2243] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.547269 22720 raft_consensus.cc:2272] T a3da07aaa60743c193b387e6a20fc83b P 71a48f59ff764d249519c6a53ec57f02 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.549271 22720 tablet_replica.cc:333] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.549778 22720 raft_consensus.cc:2243] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.550372 22720 raft_consensus.cc:2272] T ac7e870c1a4544099414fa4aae03e1c2 P 71a48f59ff764d249519c6a53ec57f02 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.552233 22720 tablet_replica.cc:333] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.552747 22720 raft_consensus.cc:2243] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.553805 22720 raft_consensus.cc:2272] T ea2fd010d40d4400b7b9f1b9cca54a0c P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.556164 22720 tablet_replica.cc:333] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.556639 22720 raft_consensus.cc:2243] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:19:25.557511 22720 raft_consensus.cc:2272] T 84a22fee7e714048af4a1d40001e99de P 71a48f59ff764d249519c6a53ec57f02 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.559830 22720 tablet_replica.cc:333] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.560401 22720 raft_consensus.cc:2243] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.560945 22720 raft_consensus.cc:2272] T 5ccb15a6c98843f3836da9918c1195dc P 71a48f59ff764d249519c6a53ec57f02 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.562804 22720 tablet_replica.cc:333] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.563287 22720 raft_consensus.cc:2243] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.563863 22720 raft_consensus.cc:2272] T 432ae242d4354d208df9f37d432ef3f7 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.566205 22720 tablet_replica.cc:333] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02: stopping tablet replica
I20260709 12:19:25.566720 22720 raft_consensus.cc:2243] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:25.567211 22720 raft_consensus.cc:2272] T 91e7023603694b9d8a378858f72b4532 P 71a48f59ff764d249519c6a53ec57f02 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:25.911907 22720 tablet_server.cc:196] TabletServer@127.22.48.4:0 shutdown complete.
I20260709 12:19:25.989913 22720 master.cc:562] Master@127.22.48.62:36189 shutting down...
W20260709 12:19:26.032742 23867 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:19:26.033093 23867 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:19:26.033322 23867 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:19:27.110018 23804 catalog_manager.cc:4755] TS 0829ddf18f07439086398756b9c6d216 (127.22.48.1:35685): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ccf053e06f514bffaa9c442a8ea2c144: Network error: Client connection negotiation failed: client connection to 127.22.48.1:35685: connect: Connection refused (error 111)
I20260709 12:19:27.227927 22720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:27.228710 22720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:27.229091 22720 tablet_replica.cc:333] T 00000000000000000000000000000000 P b335f82e70ec42589bee8577eecf648f: stopping tablet replica
I20260709 12:19:27.451319 22720 master.cc:584] Master@127.22.48.62:36189 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (191836 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:19:27.556257 22720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.48.62:40753
I20260709 12:19:27.557379 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:27.563489 30077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:27.563583 30076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:27.564292 30079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:27.564684 22720 server_base.cc:1061] running on GCE node
I20260709 12:19:27.568068 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:27.568308 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:27.568488 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599567568471 us; error 0 us; skew 500 ppm
I20260709 12:19:27.569054 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:27.571609 22720 webserver.cc:533] Webserver started at http://127.22.48.62:43685/ using document root <none> and password file <none>
I20260709 12:19:27.572106 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:27.572302 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:27.572595 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:27.573778 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/master-0-root/instance:
uuid: "600cb9934c6c471d973261032a31e530"
format_stamp: "Formatted at 2026-07-09 12:19:27 on dist-test-slave-044g"
I20260709 12:19:27.577994 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 12:19:27.581283 30084 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:27.582041 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:27.582403 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/master-0-root
uuid: "600cb9934c6c471d973261032a31e530"
format_stamp: "Formatted at 2026-07-09 12:19:27 on dist-test-slave-044g"
I20260709 12:19:27.582690 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:27.612713 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:27.614063 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:27.654024 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.62:40753
I20260709 12:19:27.654114 30135 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.62:40753 every 8 connection(s)
I20260709 12:19:27.658735 30136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:27.670240 30136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530: Bootstrap starting.
I20260709 12:19:27.675848 30136 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:27.680406 30136 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530: No bootstrap required, opened a new log
I20260709 12:19:27.682950 30136 raft_consensus.cc:359] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "600cb9934c6c471d973261032a31e530" member_type: VOTER }
I20260709 12:19:27.683395 30136 raft_consensus.cc:385] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:27.683691 30136 raft_consensus.cc:740] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 600cb9934c6c471d973261032a31e530, State: Initialized, Role: FOLLOWER
I20260709 12:19:27.684496 30136 consensus_queue.cc:260] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "600cb9934c6c471d973261032a31e530" member_type: VOTER }
I20260709 12:19:27.685098 30136 raft_consensus.cc:399] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:27.685357 30136 raft_consensus.cc:493] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:27.685738 30136 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:27.690652 30136 raft_consensus.cc:515] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "600cb9934c6c471d973261032a31e530" member_type: VOTER }
I20260709 12:19:27.691274 30136 leader_election.cc:304] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 600cb9934c6c471d973261032a31e530; no voters: 
I20260709 12:19:27.692601 30136 leader_election.cc:290] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:27.692898 30139 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:27.694217 30139 raft_consensus.cc:697] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 1 LEADER]: Becoming Leader. State: Replica: 600cb9934c6c471d973261032a31e530, State: Running, Role: LEADER
I20260709 12:19:27.694960 30139 consensus_queue.cc:237] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "600cb9934c6c471d973261032a31e530" member_type: VOTER }
I20260709 12:19:27.695765 30136 sys_catalog.cc:565] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:27.700184 30140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "600cb9934c6c471d973261032a31e530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "600cb9934c6c471d973261032a31e530" member_type: VOTER } }
I20260709 12:19:27.700270 30141 sys_catalog.cc:455] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 600cb9934c6c471d973261032a31e530. Latest consensus state: current_term: 1 leader_uuid: "600cb9934c6c471d973261032a31e530" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "600cb9934c6c471d973261032a31e530" member_type: VOTER } }
I20260709 12:19:27.701014 30141 sys_catalog.cc:458] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:27.700984 30140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:27.703282 30146 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:27.710855 30146 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:27.711838 22720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:27.719964 30146 catalog_manager.cc:1383] Generated new cluster ID: e3e674762722435e98e34633922f7b0f
I20260709 12:19:27.720280 30146 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:27.749351 30146 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:27.750648 30146 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:27.763893 30146 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530: Generated new TSK 0
I20260709 12:19:27.764511 30146 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:27.779217 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:27.785588 30157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:27.786979 30158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:27.788769 30160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:27.790750 22720 server_base.cc:1061] running on GCE node
I20260709 12:19:27.793388 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:27.793577 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:27.793763 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599567793749 us; error 0 us; skew 500 ppm
I20260709 12:19:27.794426 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:27.796782 22720 webserver.cc:533] Webserver started at http://127.22.48.1:42345/ using document root <none> and password file <none>
I20260709 12:19:27.797263 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:27.797472 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:27.797755 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:27.798971 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/instance:
uuid: "777b1410f165436aa725262b964ff0a6"
format_stamp: "Formatted at 2026-07-09 12:19:27 on dist-test-slave-044g"
I20260709 12:19:27.803431 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:19:27.807126 30165 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:27.807914 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:19:27.808255 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "777b1410f165436aa725262b964ff0a6"
format_stamp: "Formatted at 2026-07-09 12:19:27 on dist-test-slave-044g"
I20260709 12:19:27.808589 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:27.824047 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:27.825362 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:27.826956 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:27.832017 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:27.832302 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:27.832621 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:27.832861 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:27.876335 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:33137
I20260709 12:19:27.876441 30227 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:33137 every 8 connection(s)
I20260709 12:19:27.881494 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:27.890126 30233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:27.892210 30232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:27.893814 30235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:27.894294 22720 server_base.cc:1061] running on GCE node
I20260709 12:19:27.897094 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:19:27.897094 30228 heartbeater.cc:344] Connected to a master server at 127.22.48.62:40753
W20260709 12:19:27.897389 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:27.897709 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599567897689 us; error 0 us; skew 500 ppm
I20260709 12:19:27.897799 30228 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:27.898427 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:27.898857 30228 heartbeater.cc:507] Master 127.22.48.62:40753 requested a full tablet report, sending...
I20260709 12:19:27.901207 22720 webserver.cc:533] Webserver started at http://127.22.48.2:36379/ using document root <none> and password file <none>
I20260709 12:19:27.901650 30101 ts_manager.cc:194] Registered new tserver with Master: 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:27.901748 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:27.902057 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:27.902415 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:27.903584 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/instance:
uuid: "f03b88e02d9c4039964e2ab17a35bf52"
format_stamp: "Formatted at 2026-07-09 12:19:27 on dist-test-slave-044g"
I20260709 12:19:27.903627 30101 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35752
I20260709 12:19:27.908432 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:27.912259 30240 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:27.913133 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:19:27.913473 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-1-root
uuid: "f03b88e02d9c4039964e2ab17a35bf52"
format_stamp: "Formatted at 2026-07-09 12:19:27 on dist-test-slave-044g"
I20260709 12:19:27.913803 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:27.923489 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:27.924788 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:27.926625 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:27.928997 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:27.929243 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:27.929526 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:27.929738 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:27.974915 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.2:35801
I20260709 12:19:27.975031 30302 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.2:35801 every 8 connection(s)
I20260709 12:19:27.980324 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:27.988471 30306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:27.990490 30307 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:27.993476 30309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:27.994117 30303 heartbeater.cc:344] Connected to a master server at 127.22.48.62:40753
I20260709 12:19:27.994422 22720 server_base.cc:1061] running on GCE node
I20260709 12:19:27.994629 30303 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:27.995342 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:27.995600 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:27.995517 30303 heartbeater.cc:507] Master 127.22.48.62:40753 requested a full tablet report, sending...
I20260709 12:19:27.996030 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599567996009 us; error 0 us; skew 500 ppm
I20260709 12:19:27.996817 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:27.998476 30101 ts_manager.cc:194] Registered new tserver with Master: f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:27.999590 22720 webserver.cc:533] Webserver started at http://127.22.48.3:37041/ using document root <none> and password file <none>
I20260709 12:19:28.000103 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:28.000326 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:28.000222 30101 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35768
I20260709 12:19:28.000823 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:28.002050 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/instance:
uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
format_stamp: "Formatted at 2026-07-09 12:19:27 on dist-test-slave-044g"
I20260709 12:19:28.007789 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:19:28.011469 30314 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:28.012401 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:19:28.012656 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-2-root
uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
format_stamp: "Formatted at 2026-07-09 12:19:27 on dist-test-slave-044g"
I20260709 12:19:28.013043 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:28.024797 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:28.025949 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:28.027423 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:28.030509 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:28.030745 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:28.031023 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:28.031203 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:28.076020 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.3:46753
I20260709 12:19:28.076156 30376 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.3:46753 every 8 connection(s)
I20260709 12:19:28.080971 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:28.088727 30380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:28.091086 30381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:28.092274 22720 server_base.cc:1061] running on GCE node
W20260709 12:19:28.094039 30383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:28.095616 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:28.095953 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:28.096094 30377 heartbeater.cc:344] Connected to a master server at 127.22.48.62:40753
I20260709 12:19:28.096226 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599568096208 us; error 0 us; skew 500 ppm
I20260709 12:19:28.096789 30377 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:28.097339 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:28.097849 30377 heartbeater.cc:507] Master 127.22.48.62:40753 requested a full tablet report, sending...
I20260709 12:19:28.100631 22720 webserver.cc:533] Webserver started at http://127.22.48.4:46013/ using document root <none> and password file <none>
I20260709 12:19:28.100581 30101 ts_manager.cc:194] Registered new tserver with Master: 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:28.101276 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:28.101559 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:28.101852 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:28.102587 30101 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35784
I20260709 12:19:28.103134 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-3-root/instance:
uuid: "cf45045de3bd40b9a60aaaabe4322659"
format_stamp: "Formatted at 2026-07-09 12:19:28 on dist-test-slave-044g"
I20260709 12:19:28.108222 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:28.112882 30388 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:28.113973 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:19:28.114395 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-3-root
uuid: "cf45045de3bd40b9a60aaaabe4322659"
format_stamp: "Formatted at 2026-07-09 12:19:28 on dist-test-slave-044g"
I20260709 12:19:28.114713 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:28.136096 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:28.137300 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:28.138788 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:28.140975 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:28.141152 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:28.141470 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:28.141618 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:28.183039 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.4:34977
I20260709 12:19:28.183152 30450 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.4:34977 every 8 connection(s)
I20260709 12:19:28.196789 30451 heartbeater.cc:344] Connected to a master server at 127.22.48.62:40753
I20260709 12:19:28.197217 30451 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:28.198009 30451 heartbeater.cc:507] Master 127.22.48.62:40753 requested a full tablet report, sending...
I20260709 12:19:28.199957 30101 ts_manager.cc:194] Registered new tserver with Master: cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:28.200098 22720 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01385402s
I20260709 12:19:28.201454 30101 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35792
I20260709 12:19:28.230957 30101 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35804:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:19:28.472085 30416 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec1ac5431f2413f96552ad10bbd800d (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:28.473876 30416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec1ac5431f2413f96552ad10bbd800d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.476809 30415 tablet_service.cc:1511] Processing CreateTablet for tablet 135faf5d4c1c461f818d5c4131fcf51d (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:28.480314 30414 tablet_service.cc:1511] Processing CreateTablet for tablet 89100a63be0348a1bf66a13a95a3f8c0 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:28.482239 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135faf5d4c1c461f818d5c4131fcf51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.485728 30413 tablet_service.cc:1511] Processing CreateTablet for tablet b715660e336d48828daede8c69a9d353 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:28.486536 30414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89100a63be0348a1bf66a13a95a3f8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.487252 30413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b715660e336d48828daede8c69a9d353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.497356 30412 tablet_service.cc:1511] Processing CreateTablet for tablet a243cb1e81a84b1681899e957182bf40 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:28.498713 30412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a243cb1e81a84b1681899e957182bf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.502732 30411 tablet_service.cc:1511] Processing CreateTablet for tablet 7092c6b1d5ae4678ad3e75eb0bf15237 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:28.504164 30411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092c6b1d5ae4678ad3e75eb0bf15237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.507295 30410 tablet_service.cc:1511] Processing CreateTablet for tablet 3a54afd7ab154ec88c23d17fc3926282 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:28.508852 30410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a54afd7ab154ec88c23d17fc3926282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.512933 30409 tablet_service.cc:1511] Processing CreateTablet for tablet f8f7f948772a44d189f9c2255d68385e (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:28.514212 30409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f7f948772a44d189f9c2255d68385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.518694 30408 tablet_service.cc:1511] Processing CreateTablet for tablet 1e96ebb342bb4ab19893f38827cbfdfc (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:28.519970 30408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e96ebb342bb4ab19893f38827cbfdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.523186 30407 tablet_service.cc:1511] Processing CreateTablet for tablet 71502abf53ca4ef3b1193915fa8c2309 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:28.524498 30407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71502abf53ca4ef3b1193915fa8c2309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.548743 30342 tablet_service.cc:1511] Processing CreateTablet for tablet 752fdec2f7b64590b55660b4d839c0ea (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:28.550308 30342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752fdec2f7b64590b55660b4d839c0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.552547 30193 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec1ac5431f2413f96552ad10bbd800d (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:28.554075 30193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec1ac5431f2413f96552ad10bbd800d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.556134 30341 tablet_service.cc:1511] Processing CreateTablet for tablet 135faf5d4c1c461f818d5c4131fcf51d (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:28.557631 30341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135faf5d4c1c461f818d5c4131fcf51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.560235 30192 tablet_service.cc:1511] Processing CreateTablet for tablet 752fdec2f7b64590b55660b4d839c0ea (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:28.561753 30192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752fdec2f7b64590b55660b4d839c0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.564620 30340 tablet_service.cc:1511] Processing CreateTablet for tablet 89100a63be0348a1bf66a13a95a3f8c0 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:28.566197 30340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89100a63be0348a1bf66a13a95a3f8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.568245 30191 tablet_service.cc:1511] Processing CreateTablet for tablet 135faf5d4c1c461f818d5c4131fcf51d (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:19:28.569591 30191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 135faf5d4c1c461f818d5c4131fcf51d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.579972 30339 tablet_service.cc:1511] Processing CreateTablet for tablet 66ce942f42cf4c98adff100bd7b02ea0 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:28.581357 30339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ce942f42cf4c98adff100bd7b02ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.586464 30413 tablet_service.cc:1511] Processing CreateTablet for tablet 5204ef0b216a4f66889d2612e1f673b5 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:28.587430 30335 tablet_service.cc:1511] Processing CreateTablet for tablet f8f7f948772a44d189f9c2255d68385e (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:28.587734 30333 tablet_service.cc:1511] Processing CreateTablet for tablet 1466b047b58a4d00b64fdb9da5d34c2c (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:28.589123 30334 tablet_service.cc:1511] Processing CreateTablet for tablet 1e96ebb342bb4ab19893f38827cbfdfc (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:28.586090 30268 tablet_service.cc:1511] Processing CreateTablet for tablet 6ec1ac5431f2413f96552ad10bbd800d (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:19:28.590783 30336 tablet_service.cc:1511] Processing CreateTablet for tablet 3e15a1e1f78e426d9a8ca0a51c2b1644 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:28.592372 30337 tablet_service.cc:1511] Processing CreateTablet for tablet 7092c6b1d5ae4678ad3e75eb0bf15237 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:28.597107 30268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ec1ac5431f2413f96552ad10bbd800d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.597896 30335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f7f948772a44d189f9c2255d68385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.597898 30190 tablet_service.cc:1511] Processing CreateTablet for tablet 66ce942f42cf4c98adff100bd7b02ea0 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:28.598469 30267 tablet_service.cc:1511] Processing CreateTablet for tablet 752fdec2f7b64590b55660b4d839c0ea (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:19:28.602845 30413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204ef0b216a4f66889d2612e1f673b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.607527 30409 tablet_service.cc:1511] Processing CreateTablet for tablet 9d78f4a893e8471a8324169a33739e06 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:28.594030 30338 tablet_service.cc:1511] Processing CreateTablet for tablet a243cb1e81a84b1681899e957182bf40 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:28.615542 30261 tablet_service.cc:1511] Processing CreateTablet for tablet 3a54afd7ab154ec88c23d17fc3926282 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:28.615485 30416 tablet_service.cc:1511] Processing CreateTablet for tablet dc2f75df59c846458323e4564150c3d7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:28.618763 30264 tablet_service.cc:1511] Processing CreateTablet for tablet b715660e336d48828daede8c69a9d353 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:28.620203 30334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e96ebb342bb4ab19893f38827cbfdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.627458 30188 tablet_service.cc:1511] Processing CreateTablet for tablet a243cb1e81a84b1681899e957182bf40 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:19:28.627655 30407 tablet_service.cc:1511] Processing CreateTablet for tablet 2db98cf7c8374d57a7606069ab0d00dd (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:28.629505 30187 tablet_service.cc:1511] Processing CreateTablet for tablet 3e15a1e1f78e426d9a8ca0a51c2b1644 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:28.630965 30262 tablet_service.cc:1511] Processing CreateTablet for tablet 3e15a1e1f78e426d9a8ca0a51c2b1644 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:19:28.632884 30266 tablet_service.cc:1511] Processing CreateTablet for tablet 89100a63be0348a1bf66a13a95a3f8c0 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:19:28.634702 30186 tablet_service.cc:1511] Processing CreateTablet for tablet 3a54afd7ab154ec88c23d17fc3926282 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:19:28.635149 30190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ce942f42cf4c98adff100bd7b02ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.638461 30263 tablet_service.cc:1511] Processing CreateTablet for tablet 7092c6b1d5ae4678ad3e75eb0bf15237 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:19:28.640750 30333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1466b047b58a4d00b64fdb9da5d34c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.641784 30184 tablet_service.cc:1511] Processing CreateTablet for tablet 1466b047b58a4d00b64fdb9da5d34c2c (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:28.643587 30185 tablet_service.cc:1511] Processing CreateTablet for tablet f8f7f948772a44d189f9c2255d68385e (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:19:28.645830 30189 tablet_service.cc:1511] Processing CreateTablet for tablet b715660e336d48828daede8c69a9d353 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:19:28.608254 30265 tablet_service.cc:1511] Processing CreateTablet for tablet 66ce942f42cf4c98adff100bd7b02ea0 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:19:28.652895 30267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 752fdec2f7b64590b55660b4d839c0ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.659700 30186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a54afd7ab154ec88c23d17fc3926282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.660550 30184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1466b047b58a4d00b64fdb9da5d34c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.666867 30189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b715660e336d48828daede8c69a9d353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.668440 30340 tablet_service.cc:1511] Processing CreateTablet for tablet 0308f2a10f594ad78170a8bc09436ffe (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:28.671613 30342 tablet_service.cc:1511] Processing CreateTablet for tablet 5204ef0b216a4f66889d2612e1f673b5 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:28.671622 30185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8f7f948772a44d189f9c2255d68385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.676272 30263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092c6b1d5ae4678ad3e75eb0bf15237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.678866 30265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66ce942f42cf4c98adff100bd7b02ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.683099 30266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89100a63be0348a1bf66a13a95a3f8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.688968 30416 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2f75df59c846458323e4564150c3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.689736 30409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d78f4a893e8471a8324169a33739e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.691529 30260 tablet_service.cc:1511] Processing CreateTablet for tablet 1e96ebb342bb4ab19893f38827cbfdfc (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:19:28.692373 30188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a243cb1e81a84b1681899e957182bf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.693495 30259 tablet_service.cc:1511] Processing CreateTablet for tablet 1466b047b58a4d00b64fdb9da5d34c2c (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:19:28.695636 30407 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db98cf7c8374d57a7606069ab0d00dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.702929 30262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e15a1e1f78e426d9a8ca0a51c2b1644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.706359 30187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e15a1e1f78e426d9a8ca0a51c2b1644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.706427 30338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a243cb1e81a84b1681899e957182bf40. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:28.707669 30149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:28.708436 30342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204ef0b216a4f66889d2612e1f673b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.712194 30408 tablet_service.cc:1511] Processing CreateTablet for tablet 9164fff77d194553bf16a7020fb1546a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:28.714699 30340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0308f2a10f594ad78170a8bc09436ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.720283 30415 tablet_service.cc:1511] Processing CreateTablet for tablet 0308f2a10f594ad78170a8bc09436ffe (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:28.725175 30264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b715660e336d48828daede8c69a9d353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.714201 30412 tablet_service.cc:1511] Processing CreateTablet for tablet a9b4e218f7bb4c3aa64bae842061937a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:28.729705 30259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1466b047b58a4d00b64fdb9da5d34c2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.730942 30410 tablet_service.cc:1511] Processing CreateTablet for tablet 783cd53e9f4142348a23db0cbf9cd131 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:28.732230 30410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783cd53e9f4142348a23db0cbf9cd131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.735203 30414 tablet_service.cc:1511] Processing CreateTablet for tablet e44d3048f1f74e7481b0772d32316b86 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:28.736485 30414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44d3048f1f74e7481b0772d32316b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.742372 30337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7092c6b1d5ae4678ad3e75eb0bf15237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.724747 30411 tablet_service.cc:1511] Processing CreateTablet for tablet e1901a31d4f045d7af7afe28951681d6 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:28.750684 30412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b4e218f7bb4c3aa64bae842061937a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.751330 30261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a54afd7ab154ec88c23d17fc3926282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.754580 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0308f2a10f594ad78170a8bc09436ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.758641 30336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e15a1e1f78e426d9a8ca0a51c2b1644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.763010 30411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1901a31d4f045d7af7afe28951681d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.762959 30340 tablet_service.cc:1511] Processing CreateTablet for tablet a5da03165521429c98ebf81c89a7b741 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:28.765304 30340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5da03165521429c98ebf81c89a7b741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.768818 30260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e96ebb342bb4ab19893f38827cbfdfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.770457 30185 tablet_service.cc:1511] Processing CreateTablet for tablet 71502abf53ca4ef3b1193915fa8c2309 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:28.770751 30193 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff5b4e1a9b549f69fa44610140ab684 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:28.779338 30339 tablet_service.cc:1511] Processing CreateTablet for tablet dc2f75df59c846458323e4564150c3d7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:28.787232 30339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2f75df59c846458323e4564150c3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.771906 30185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71502abf53ca4ef3b1193915fa8c2309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.775032 30472 tablet_bootstrap.cc:492] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:28.775419 30408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9164fff77d194553bf16a7020fb1546a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.799316 30473 tablet_bootstrap.cc:492] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:28.815858 30409 tablet_service.cc:1511] Processing CreateTablet for tablet 902e818d7d70457b93827ef5cf71cdaf (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:28.817101 30191 tablet_service.cc:1511] Processing CreateTablet for tablet 5204ef0b216a4f66889d2612e1f673b5 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:19:28.825822 30342 tablet_service.cc:1511] Processing CreateTablet for tablet 9164fff77d194553bf16a7020fb1546a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:28.831527 30341 tablet_service.cc:1511] Processing CreateTablet for tablet 2db98cf7c8374d57a7606069ab0d00dd (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:28.832100 30342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9164fff77d194553bf16a7020fb1546a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.825299 30187 tablet_service.cc:1511] Processing CreateTablet for tablet a5da03165521429c98ebf81c89a7b741 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:28.817404 30409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902e818d7d70457b93827ef5cf71cdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.835810 30184 tablet_service.cc:1511] Processing CreateTablet for tablet 9d78f4a893e8471a8324169a33739e06 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:28.837917 30192 tablet_service.cc:1511] Processing CreateTablet for tablet 9164fff77d194553bf16a7020fb1546a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:19:28.821233 30410 tablet_service.cc:1511] Processing CreateTablet for tablet 8f971b17bc9742d38fdccaea1020084a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:28.840207 30410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f971b17bc9742d38fdccaea1020084a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.842576 30341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db98cf7c8374d57a7606069ab0d00dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.842721 30471 tablet_bootstrap.cc:492] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:28.851012 30262 tablet_service.cc:1511] Processing CreateTablet for tablet 71502abf53ca4ef3b1193915fa8c2309 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:19:28.857338 30184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d78f4a893e8471a8324169a33739e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.872227 30413 tablet_service.cc:1511] Processing CreateTablet for tablet 658e0669fba3478e91574f80953b72b7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:28.903100 30187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5da03165521429c98ebf81c89a7b741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.903668 30413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658e0669fba3478e91574f80953b72b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.904814 30191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204ef0b216a4f66889d2612e1f673b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.907202 30228 heartbeater.cc:499] Master 127.22.48.62:40753 was elected leader, sending a full tablet report...
I20260709 12:19:28.930835 30192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9164fff77d194553bf16a7020fb1546a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:28.916203 30085 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 62276.6us
I20260709 12:19:28.933871 30193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff5b4e1a9b549f69fa44610140ab684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.907706 30262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71502abf53ca4ef3b1193915fa8c2309. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.951128 30190 tablet_service.cc:1511] Processing CreateTablet for tablet ac00a693be1041d8b90ef03408a91eab (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:28.952960 30190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac00a693be1041d8b90ef03408a91eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.955292 30472 tablet_bootstrap.cc:654] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:28.962404 30259 tablet_service.cc:1511] Processing CreateTablet for tablet 9d78f4a893e8471a8324169a33739e06 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:19:28.963232 30474 tablet_bootstrap.cc:492] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:28.968044 30267 tablet_service.cc:1511] Processing CreateTablet for tablet 2db98cf7c8374d57a7606069ab0d00dd (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:19:28.969100 30268 tablet_service.cc:1511] Processing CreateTablet for tablet ac00a693be1041d8b90ef03408a91eab (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:28.970489 30261 tablet_service.cc:1511] Processing CreateTablet for tablet dc2f75df59c846458323e4564150c3d7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:19:28.920929 30335 tablet_service.cc:1511] Processing CreateTablet for tablet ac00a693be1041d8b90ef03408a91eab (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:19:28.975102 30335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac00a693be1041d8b90ef03408a91eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.979298 30415 tablet_service.cc:1511] Processing CreateTablet for tablet 6eecf0b507c246e383799261c8caf613 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:28.980654 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eecf0b507c246e383799261c8caf613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.985863 30259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d78f4a893e8471a8324169a33739e06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.003264 30303 heartbeater.cc:499] Master 127.22.48.62:40753 was elected leader, sending a full tablet report...
I20260709 12:19:29.023582 30261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc2f75df59c846458323e4564150c3d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.996657 30186 tablet_service.cc:1511] Processing CreateTablet for tablet e44d3048f1f74e7481b0772d32316b86 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:29.022774 30340 tablet_service.cc:1511] Processing CreateTablet for tablet 783cd53e9f4142348a23db0cbf9cd131 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:29.034111 30186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44d3048f1f74e7481b0772d32316b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:28.999181 30263 tablet_service.cc:1511] Processing CreateTablet for tablet a5da03165521429c98ebf81c89a7b741 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:19:29.005509 30412 tablet_service.cc:1511] Processing CreateTablet for tablet f2e1e509bcc54ae485169e45c1649db8 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:29.008373 30336 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff5b4e1a9b549f69fa44610140ab684 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:29.026247 30471 tablet_bootstrap.cc:654] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:28.991532 30260 tablet_service.cc:1511] Processing CreateTablet for tablet e44d3048f1f74e7481b0772d32316b86 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:19:29.039319 30412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e1e509bcc54ae485169e45c1649db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.034332 30340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783cd53e9f4142348a23db0cbf9cd131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.006670 30264 tablet_service.cc:1511] Processing CreateTablet for tablet 0308f2a10f594ad78170a8bc09436ffe (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:19:28.990231 30339 tablet_service.cc:1511] Processing CreateTablet for tablet a9b4e218f7bb4c3aa64bae842061937a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:29.080575 30473 tablet_bootstrap.cc:654] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:29.007685 30189 tablet_service.cc:1511] Processing CreateTablet for tablet a9b4e218f7bb4c3aa64bae842061937a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:19:29.086040 30189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b4e218f7bb4c3aa64bae842061937a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.086534 30267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2db98cf7c8374d57a7606069ab0d00dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.087795 30264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0308f2a10f594ad78170a8bc09436ffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.088694 30263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5da03165521429c98ebf81c89a7b741. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.086720 30336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff5b4e1a9b549f69fa44610140ab684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.081966 30184 tablet_service.cc:1511] Processing CreateTablet for tablet e1901a31d4f045d7af7afe28951681d6 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:29.095435 30184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1901a31d4f045d7af7afe28951681d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.096705 30342 tablet_service.cc:1511] Processing CreateTablet for tablet 658e0669fba3478e91574f80953b72b7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:29.097492 30339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9b4e218f7bb4c3aa64bae842061937a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.101024 30260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e44d3048f1f74e7481b0772d32316b86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.102950 30409 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9b5ed70fdf49c0bf254214d8ca297c (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:29.105067 30377 heartbeater.cc:499] Master 127.22.48.62:40753 was elected leader, sending a full tablet report...
I20260709 12:19:29.111491 30338 tablet_service.cc:1511] Processing CreateTablet for tablet 902e818d7d70457b93827ef5cf71cdaf (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:29.112860 30333 tablet_service.cc:1511] Processing CreateTablet for tablet 6e383c3fc4184c4ba49ba4d78433d661 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:29.122864 30342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658e0669fba3478e91574f80953b72b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.135818 30472 tablet_bootstrap.cc:492] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:29.136466 30472 ts_tablet_manager.cc:1403] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.362s	user 0.022s	sys 0.007s
I20260709 12:19:29.137224 30409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9b5ed70fdf49c0bf254214d8ca297c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.142952 30414 tablet_service.cc:1511] Processing CreateTablet for tablet 91938ea259f9468fa8dd1b771846e52a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:29.144408 30414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91938ea259f9468fa8dd1b771846e52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.146932 30338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902e818d7d70457b93827ef5cf71cdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.150051 30474 tablet_bootstrap.cc:654] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:29.150621 30268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac00a693be1041d8b90ef03408a91eab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.150820 30333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e383c3fc4184c4ba49ba4d78433d661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.145895 30266 tablet_service.cc:1511] Processing CreateTablet for tablet 4ff5b4e1a9b549f69fa44610140ab684 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:19:29.171344 30266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ff5b4e1a9b549f69fa44610140ab684. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.155305 30265 tablet_service.cc:1511] Processing CreateTablet for tablet e1901a31d4f045d7af7afe28951681d6 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:19:29.155773 30339 tablet_service.cc:1511] Processing CreateTablet for tablet 6eecf0b507c246e383799261c8caf613 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:29.175370 30265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1901a31d4f045d7af7afe28951681d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.159816 30185 tablet_service.cc:1511] Processing CreateTablet for tablet 6e383c3fc4184c4ba49ba4d78433d661 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:29.175546 30339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eecf0b507c246e383799261c8caf613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.182466 30185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e383c3fc4184c4ba49ba4d78433d661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.159674 30337 tablet_service.cc:1511] Processing CreateTablet for tablet 89955984673a4c1a984a5c1c5569ebe7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:29.184814 30337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89955984673a4c1a984a5c1c5569ebe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.191390 30262 tablet_service.cc:1511] Processing CreateTablet for tablet 902e818d7d70457b93827ef5cf71cdaf (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:19:29.195397 30335 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9b5ed70fdf49c0bf254214d8ca297c (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:29.108840 30188 tablet_service.cc:1511] Processing CreateTablet for tablet 783cd53e9f4142348a23db0cbf9cd131 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:19:29.209306 30451 heartbeater.cc:499] Master 127.22.48.62:40753 was elected leader, sending a full tablet report...
I20260709 12:19:29.215996 30341 tablet_service.cc:1511] Processing CreateTablet for tablet 91938ea259f9468fa8dd1b771846e52a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:29.206877 30262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902e818d7d70457b93827ef5cf71cdaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.207156 30335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9b5ed70fdf49c0bf254214d8ca297c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.235184 30410 tablet_service.cc:1511] Processing CreateTablet for tablet 6b74bb8b13534e8daf883dde16e187ec (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:29.246141 30413 tablet_service.cc:1511] Processing CreateTablet for tablet 513668c5dbf240ab8c90da19361cac60 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:29.248838 30472 raft_consensus.cc:359] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:29.249696 30472 raft_consensus.cc:385] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:29.250046 30472 raft_consensus.cc:740] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:29.252437 30191 tablet_service.cc:1511] Processing CreateTablet for tablet 8f971b17bc9742d38fdccaea1020084a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:29.254522 30341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91938ea259f9468fa8dd1b771846e52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.281301 30192 tablet_service.cc:1511] Processing CreateTablet for tablet 658e0669fba3478e91574f80953b72b7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:19:29.255673 30334 tablet_service.cc:1511] Processing CreateTablet for tablet 513668c5dbf240ab8c90da19361cac60 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:29.284014 30334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513668c5dbf240ab8c90da19361cac60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.256819 30264 tablet_service.cc:1511] Processing CreateTablet for tablet 8f971b17bc9742d38fdccaea1020084a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:19:29.261169 30474 tablet_bootstrap.cc:492] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:29.264122 30410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b74bb8b13534e8daf883dde16e187ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.292068 30474 ts_tablet_manager.cc:1403] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.329s	user 0.017s	sys 0.005s
I20260709 12:19:29.292240 30413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513668c5dbf240ab8c90da19361cac60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.297646 30472 consensus_queue.cc:260] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:29.299952 30473 tablet_bootstrap.cc:492] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:29.300442 30184 tablet_service.cc:1511] Processing CreateTablet for tablet 89955984673a4c1a984a5c1c5569ebe7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:29.305868 30264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f971b17bc9742d38fdccaea1020084a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.307690 30187 tablet_service.cc:1511] Processing CreateTablet for tablet f2e1e509bcc54ae485169e45c1649db8 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:29.308997 30188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 783cd53e9f4142348a23db0cbf9cd131. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.309684 30192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 658e0669fba3478e91574f80953b72b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.310931 30184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89955984673a4c1a984a5c1c5569ebe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.311013 30474 raft_consensus.cc:359] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.312033 30474 raft_consensus.cc:385] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:29.311791 30415 tablet_service.cc:1511] Processing CreateTablet for tablet 4333c8ec1cd04d1d8ec97b1f5a79f8a5 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:29.312120 30471 tablet_bootstrap.cc:492] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:29.312770 30471 ts_tablet_manager.cc:1403] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.516s	user 0.007s	sys 0.018s
I20260709 12:19:29.313112 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4333c8ec1cd04d1d8ec97b1f5a79f8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.316021 30189 tablet_service.cc:1511] Processing CreateTablet for tablet 0a9b5ed70fdf49c0bf254214d8ca297c (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:19:29.317216 30471 raft_consensus.cc:359] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:29.222249 30338 tablet_service.cc:1511] Processing CreateTablet for tablet a07a59f629f04857b16b3ce29fdb6369 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:29.322446 30471 raft_consensus.cc:385] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:29.322985 30471 raft_consensus.cc:740] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:29.323427 30338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07a59f629f04857b16b3ce29fdb6369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.324651 30190 tablet_service.cc:1511] Processing CreateTablet for tablet a07a59f629f04857b16b3ce29fdb6369 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:29.328392 30267 tablet_service.cc:1511] Processing CreateTablet for tablet 6eecf0b507c246e383799261c8caf613 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:19:29.329097 30474 raft_consensus.cc:740] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:29.329650 30267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eecf0b507c246e383799261c8caf613. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.288868 30268 tablet_service.cc:1511] Processing CreateTablet for tablet 6e383c3fc4184c4ba49ba4d78433d661 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:19:29.330243 30474 consensus_queue.cc:260] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.331561 30268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e383c3fc4184c4ba49ba4d78433d661. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.333094 30336 tablet_service.cc:1511] Processing CreateTablet for tablet 4333c8ec1cd04d1d8ec97b1f5a79f8a5 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:29.334355 30336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4333c8ec1cd04d1d8ec97b1f5a79f8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.300457 30473 ts_tablet_manager.cc:1403] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.502s	user 0.036s	sys 0.059s
I20260709 12:19:29.338009 30266 tablet_service.cc:1511] Processing CreateTablet for tablet 89955984673a4c1a984a5c1c5569ebe7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:19:29.339288 30186 tablet_service.cc:1511] Processing CreateTablet for tablet 6b74bb8b13534e8daf883dde16e187ec (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:29.346590 30471 consensus_queue.cc:260] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:29.347496 30263 tablet_service.cc:1511] Processing CreateTablet for tablet f2e1e509bcc54ae485169e45c1649db8 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:19:29.338052 30473 raft_consensus.cc:359] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.317239 30189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a9b5ed70fdf49c0bf254214d8ca297c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.351950 30190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07a59f629f04857b16b3ce29fdb6369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.353320 30187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e1e509bcc54ae485169e45c1649db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.354835 30191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f971b17bc9742d38fdccaea1020084a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.351153 30473 raft_consensus.cc:385] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:29.355278 30473 raft_consensus.cc:740] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:29.355376 30193 tablet_service.cc:1511] Processing CreateTablet for tablet 513668c5dbf240ab8c90da19361cac60 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:19:29.356362 30473 consensus_queue.cc:260] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.357237 30193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 513668c5dbf240ab8c90da19361cac60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.359571 30186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b74bb8b13534e8daf883dde16e187ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.339291 30266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89955984673a4c1a984a5c1c5569ebe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.365396 30263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e1e509bcc54ae485169e45c1649db8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.387260 30262 tablet_service.cc:1511] Processing CreateTablet for tablet 6b74bb8b13534e8daf883dde16e187ec (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:19:29.393170 30265 tablet_service.cc:1511] Processing CreateTablet for tablet 4333c8ec1cd04d1d8ec97b1f5a79f8a5 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:19:29.396283 30339 tablet_service.cc:1511] Processing CreateTablet for tablet 33b3f7db61ad4d6e9464016245ab8079 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:29.398602 30414 tablet_service.cc:1511] Processing CreateTablet for tablet 373645f6f2614fa5a09fd23279ce7973 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:29.417793 30339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b3f7db61ad4d6e9464016245ab8079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.418565 30265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4333c8ec1cd04d1d8ec97b1f5a79f8a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.422927 30414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373645f6f2614fa5a09fd23279ce7973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.381434 30261 tablet_service.cc:1511] Processing CreateTablet for tablet a07a59f629f04857b16b3ce29fdb6369 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:19:29.426256 30261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a07a59f629f04857b16b3ce29fdb6369. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.431279 30472 ts_tablet_manager.cc:1434] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.294s	user 0.004s	sys 0.017s
I20260709 12:19:29.432389 30472 tablet_bootstrap.cc:492] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:29.437083 30185 tablet_service.cc:1511] Processing CreateTablet for tablet 373645f6f2614fa5a09fd23279ce7973 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:29.433930 30192 tablet_service.cc:1511] Processing CreateTablet for tablet 33b3f7db61ad4d6e9464016245ab8079 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:29.438721 30262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b74bb8b13534e8daf883dde16e187ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.438792 30185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373645f6f2614fa5a09fd23279ce7973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.441257 30192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b3f7db61ad4d6e9464016245ab8079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.442665 30260 tablet_service.cc:1511] Processing CreateTablet for tablet 91938ea259f9468fa8dd1b771846e52a (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:19:29.444166 30260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91938ea259f9468fa8dd1b771846e52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.461382 30410 tablet_service.cc:1511] Processing CreateTablet for tablet c9ee34a652a74ed3bac1dc145136bf62 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:29.462752 30410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ee34a652a74ed3bac1dc145136bf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.463321 30334 tablet_service.cc:1511] Processing CreateTablet for tablet c9ee34a652a74ed3bac1dc145136bf62 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:29.464861 30334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ee34a652a74ed3bac1dc145136bf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.473292 30474 ts_tablet_manager.cc:1434] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.181s	user 0.011s	sys 0.000s
I20260709 12:19:29.476563 30474 tablet_bootstrap.cc:492] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
W20260709 12:19:29.489111 30304 tablet.cc:2406] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:19:29.502784 30471 ts_tablet_manager.cc:1434] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.190s	user 0.002s	sys 0.010s
I20260709 12:19:29.503925 30471 tablet_bootstrap.cc:492] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:29.506410 30473 ts_tablet_manager.cc:1434] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.171s	user 0.015s	sys 0.011s
I20260709 12:19:29.507424 30473 tablet_bootstrap.cc:492] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:29.510728 30480 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.511255 30480 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.517707 30473 tablet_bootstrap.cc:654] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:29.482161 30472 tablet_bootstrap.cc:654] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:29.529132 30480 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:29.548255 30259 tablet_service.cc:1511] Processing CreateTablet for tablet 33b3f7db61ad4d6e9464016245ab8079 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:19:29.552474 30474 tablet_bootstrap.cc:654] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:29.557391 30188 tablet_service.cc:1511] Processing CreateTablet for tablet c9ee34a652a74ed3bac1dc145136bf62 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:19:29.558737 30188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9ee34a652a74ed3bac1dc145136bf62. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.560995 30266 tablet_service.cc:1511] Processing CreateTablet for tablet 373645f6f2614fa5a09fd23279ce7973 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:19:29.563253 30266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 373645f6f2614fa5a09fd23279ce7973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.563449 30482 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.563958 30482 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.565570 30259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33b3f7db61ad4d6e9464016245ab8079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.566718 30482 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:29.573099 30479 raft_consensus.cc:493] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.573629 30479 raft_consensus.cc:515] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:29.579859 30479 leader_election.cc:290] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:29.581303 30471 tablet_bootstrap.cc:654] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:29.587906 30338 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce9c549b6414f61af3e10fccd6b5001 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:29.591346 30415 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce9c549b6414f61af3e10fccd6b5001 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:29.595988 30187 tablet_service.cc:1511] Processing CreateTablet for tablet 82b7f80a887443338c7b69d68b9e4886 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:29.610749 30338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce9c549b6414f61af3e10fccd6b5001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.615339 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce9c549b6414f61af3e10fccd6b5001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.633406 30341 tablet_service.cc:1511] Processing CreateTablet for tablet 82b7f80a887443338c7b69d68b9e4886 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:29.633904 30413 tablet_service.cc:1511] Processing CreateTablet for tablet 623336ab8b78487db7b5b817879e958e (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:29.634871 30341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b7f80a887443338c7b69d68b9e4886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.635942 30413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623336ab8b78487db7b5b817879e958e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.645087 30472 tablet_bootstrap.cc:492] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:29.645685 30472 ts_tablet_manager.cc:1403] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.214s	user 0.013s	sys 0.000s
I20260709 12:19:29.647744 30187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b7f80a887443338c7b69d68b9e4886. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.648877 30472 raft_consensus.cc:359] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.649616 30472 raft_consensus.cc:385] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:29.649920 30472 raft_consensus.cc:740] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:29.666749 30472 consensus_queue.cc:260] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.669144 30472 ts_tablet_manager.cc:1434] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 12:19:29.666142 30193 tablet_service.cc:1511] Processing CreateTablet for tablet 623336ab8b78487db7b5b817879e958e (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:29.671543 30193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623336ab8b78487db7b5b817879e958e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.673079 30339 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1ee8472def40b1a4437e3ba0e495f3 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:29.674429 30339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1ee8472def40b1a4437e3ba0e495f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.682587 30481 raft_consensus.cc:493] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.683142 30481 raft_consensus.cc:515] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:29.670151 30472 tablet_bootstrap.cc:492] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:29.700804 30479 raft_consensus.cc:493] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:29.701354 30479 raft_consensus.cc:515] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.702049 30473 tablet_bootstrap.cc:492] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:29.702584 30473 ts_tablet_manager.cc:1403] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.195s	user 0.034s	sys 0.074s
I20260709 12:19:29.706131 30479 leader_election.cc:290] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:29.720484 30262 tablet_service.cc:1511] Processing CreateTablet for tablet 82b7f80a887443338c7b69d68b9e4886 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:19:29.736306 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:29.737649 30262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82b7f80a887443338c7b69d68b9e4886. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:29.738201 30166 leader_election.cc:343] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:29.739101 30267 tablet_service.cc:1511] Processing CreateTablet for tablet 623336ab8b78487db7b5b817879e958e (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:19:29.740437 30267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 623336ab8b78487db7b5b817879e958e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.740221 30190 tablet_service.cc:1511] Processing CreateTablet for tablet dee40afb40fa45f8969bce6b71285204 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:29.741496 30190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee40afb40fa45f8969bce6b71285204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.723946 30481 leader_election.cc:290] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:29.751284 30265 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac3e8c89573415c9575c5a977d36af6 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:29.752044 30191 tablet_service.cc:1511] Processing CreateTablet for tablet 35d4a018024842a99a90f4bcc2a6887c (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:29.771008 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89100a63be0348a1bf66a13a95a3f8c0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:29.771740 30191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d4a018024842a99a90f4bcc2a6887c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.771792 30426 raft_consensus.cc:2468] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
W20260709 12:19:29.753072 30149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:29.754328 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:29.773234 30278 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:29.757716 30186 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1ee8472def40b1a4437e3ba0e495f3 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:29.759353 30266 tablet_service.cc:1511] Processing CreateTablet for tablet 8ce9c549b6414f61af3e10fccd6b5001 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:19:29.765849 30263 tablet_service.cc:1511] Processing CreateTablet for tablet dee40afb40fa45f8969bce6b71285204 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:29.762176 30472 tablet_bootstrap.cc:654] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:29.787194 30315 leader_election.cc:304] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:29.788154 30479 raft_consensus.cc:2804] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:29.788022 30261 tablet_service.cc:1511] Processing CreateTablet for tablet 35d4a018024842a99a90f4bcc2a6887c (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:29.795107 30479 raft_consensus.cc:493] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.801359 30479 raft_consensus.cc:3060] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:29.802009 30192 tablet_service.cc:1511] Processing CreateTablet for tablet 22e1306c0565463d9f7dd00b385e55c7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:29.804945 30192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e1306c0565463d9f7dd00b385e55c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.806046 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:29.806411 30336 tablet_service.cc:1511] Processing CreateTablet for tablet dee40afb40fa45f8969bce6b71285204 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:19:29.806774 30203 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:29.807260 30334 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac3e8c89573415c9575c5a977d36af6 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:29.807683 30336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee40afb40fa45f8969bce6b71285204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.808487 30334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac3e8c89573415c9575c5a977d36af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.809099 30186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1ee8472def40b1a4437e3ba0e495f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.816593 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89100a63be0348a1bf66a13a95a3f8c0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:29.818059 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:29.778141 30473 raft_consensus.cc:359] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:29.819339 30473 raft_consensus.cc:385] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:29.819844 30473 raft_consensus.cc:740] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
W20260709 12:19:29.819994 30317 leader_election.cc:343] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:29.821067 30473 consensus_queue.cc:260] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:29.821123 30317 leader_election.cc:343] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:29.821118 30339 tablet_service.cc:1511] Processing CreateTablet for tablet 22e1306c0565463d9f7dd00b385e55c7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:19:29.826529 30265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac3e8c89573415c9575c5a977d36af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.827028 30339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e1306c0565463d9f7dd00b385e55c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.827175 30263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dee40afb40fa45f8969bce6b71285204. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.839511 30261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d4a018024842a99a90f4bcc2a6887c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.840368 30414 tablet_service.cc:1511] Processing CreateTablet for tablet 2ac3e8c89573415c9575c5a977d36af6 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:19:29.841732 30266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ce9c549b6414f61af3e10fccd6b5001. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.841835 30414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ac3e8c89573415c9575c5a977d36af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.843725 30410 tablet_service.cc:1511] Processing CreateTablet for tablet 35d4a018024842a99a90f4bcc2a6887c (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:19:29.842432 30415 tablet_service.cc:1511] Processing CreateTablet for tablet 5a1ee8472def40b1a4437e3ba0e495f3 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:19:29.851531 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:29.853999 30471 tablet_bootstrap.cc:492] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:29.856881 30471 ts_tablet_manager.cc:1403] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.353s	user 0.026s	sys 0.000s
I20260709 12:19:29.845017 30410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d4a018024842a99a90f4bcc2a6887c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.866503 30471 raft_consensus.cc:359] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:29.867234 30471 raft_consensus.cc:385] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:29.867532 30471 raft_consensus.cc:740] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:29.868355 30471 consensus_queue.cc:260] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:29.872010 30409 tablet_service.cc:1511] Processing CreateTablet for tablet 22e1306c0565463d9f7dd00b385e55c7 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
W20260709 12:19:29.879031 30241 leader_election.cc:343] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:29.880327 30474 tablet_bootstrap.cc:492] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:29.801923 30168 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:29.882092 30474 ts_tablet_manager.cc:1403] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.406s	user 0.019s	sys 0.011s
I20260709 12:19:29.883438 30482 raft_consensus.cc:2804] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:29.883101 30262 tablet_service.cc:1511] Processing CreateTablet for tablet 3d376ce929ab4707a05d036b3f6fdd43 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:29.883888 30482 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.884315 30482 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:29.884825 30262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d376ce929ab4707a05d036b3f6fdd43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.887015 30473 ts_tablet_manager.cc:1434] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.184s	user 0.007s	sys 0.002s
I20260709 12:19:29.892063 30482 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.886593 30474 raft_consensus.cc:359] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:29.894246 30474 raft_consensus.cc:385] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:29.895284 30474 raft_consensus.cc:740] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:29.895988 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
W20260709 12:19:29.894640 30168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 93141.5us
I20260709 12:19:29.897698 30474 consensus_queue.cc:260] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:29.902540 30166 leader_election.cc:343] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:29.902477 30244 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:29.904039 30480 raft_consensus.cc:2804] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:29.904443 30480 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:29.904834 30480 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:29.905649 30474 ts_tablet_manager.cc:1434] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.008s
I20260709 12:19:29.906354 30473 tablet_bootstrap.cc:492] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:29.909996 30471 ts_tablet_manager.cc:1434] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 12:19:29.912460 30472 tablet_bootstrap.cc:492] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:29.912961 30472 ts_tablet_manager.cc:1403] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.243s	user 0.011s	sys 0.004s
I20260709 12:19:29.914683 30338 tablet_service.cc:1511] Processing CreateTablet for tablet 3d376ce929ab4707a05d036b3f6fdd43 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:29.916232 30338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d376ce929ab4707a05d036b3f6fdd43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.916545 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:29.918203 30318 leader_election.cc:343] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:29.918697 30318 leader_election.cc:304] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:29.925530 30471 tablet_bootstrap.cc:492] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:29.927008 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89100a63be0348a1bf66a13a95a3f8c0" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:29.928629 30391 leader_election.cc:343] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:29.931212 30413 tablet_service.cc:1511] Processing CreateTablet for tablet 3d376ce929ab4707a05d036b3f6fdd43 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:19:29.933784 30190 tablet_service.cc:1511] Processing CreateTablet for tablet 786293768cab4265a62418294d3f895b (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:29.910768 30479 raft_consensus.cc:515] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:29.899101 30415 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a1ee8472def40b1a4437e3ba0e495f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.935489 30260 tablet_service.cc:1511] Processing CreateTablet for tablet 786293768cab4265a62418294d3f895b (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:29.936758 30260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 786293768cab4265a62418294d3f895b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.936659 30341 tablet_service.cc:1511] Processing CreateTablet for tablet 786293768cab4265a62418294d3f895b (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:19:29.939640 30341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 786293768cab4265a62418294d3f895b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.941522 30474 tablet_bootstrap.cc:492] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:29.941577 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:29.941996 30413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d376ce929ab4707a05d036b3f6fdd43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.942502 30482 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:29.944344 30409 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22e1306c0565463d9f7dd00b385e55c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.961180 30190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 786293768cab4265a62418294d3f895b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.973106 30472 raft_consensus.cc:359] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:29.973933 30472 raft_consensus.cc:385] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:29.913944 30480 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:29.979043 30277 raft_consensus.cc:2393] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 777b1410f165436aa725262b964ff0a6 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:29.981045 30412 tablet_service.cc:1511] Processing CreateTablet for tablet 4290068162194444a3f4d05ad418ca30 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:29.982067 30168 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:29.982498 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89100a63be0348a1bf66a13a95a3f8c0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:29.983050 30482 raft_consensus.cc:2749] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:19:29.983789 30317 leader_election.cc:343] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:29.982704 30412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4290068162194444a3f4d05ad418ca30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.985384 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
W20260709 12:19:29.987727 30241 leader_election.cc:343] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:29.989827 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:29.990595 30203 raft_consensus.cc:2393] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f03b88e02d9c4039964e2ab17a35bf52 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:29.992123 30193 tablet_service.cc:1511] Processing CreateTablet for tablet 4290068162194444a3f4d05ad418ca30 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:29.993649 30244 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:29.995481 30334 tablet_service.cc:1511] Processing CreateTablet for tablet afd6a0afe3684c689a3587a53a560ec3 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:29.996754 30334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd6a0afe3684c689a3587a53a560ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:29.999415 30193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4290068162194444a3f4d05ad418ca30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.003175 30471 tablet_bootstrap.cc:654] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:30.004623 30318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 86587.8us
I20260709 12:19:30.003328 30267 tablet_service.cc:1511] Processing CreateTablet for tablet 4290068162194444a3f4d05ad418ca30 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:19:30.006073 30474 tablet_bootstrap.cc:654] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.003783 30480 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:30.006996 30480 raft_consensus.cc:2749] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.010038 30473 tablet_bootstrap.cc:654] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.010229 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89100a63be0348a1bf66a13a95a3f8c0" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:30.011250 30352 raft_consensus.cc:2393] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:30.006378 30267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4290068162194444a3f4d05ad418ca30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.018142 30390 leader_election.cc:304] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:30.019450 30481 raft_consensus.cc:3060] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.020767 30414 tablet_service.cc:1511] Processing CreateTablet for tablet afd6a0afe3684c689a3587a53a560ec3 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:30.022300 30414 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd6a0afe3684c689a3587a53a560ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.022522 30479 leader_election.cc:290] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:30.023125 30479 raft_consensus.cc:2749] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:29.974220 30472 raft_consensus.cc:740] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.023643 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89100a63be0348a1bf66a13a95a3f8c0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:30.029986 30472 consensus_queue.cc:260] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.032233 30472 ts_tablet_manager.cc:1434] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.119s	user 0.012s	sys 0.000s
I20260709 12:19:30.043079 30339 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0bb2451c3442cab4eee04748a2baa0 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:30.044526 30339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0bb2451c3442cab4eee04748a2baa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.045799 30408 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0bb2451c3442cab4eee04748a2baa0 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:30.047662 30408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0bb2451c3442cab4eee04748a2baa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.036084 30263 tablet_service.cc:1511] Processing CreateTablet for tablet 0e0bb2451c3442cab4eee04748a2baa0 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:19:30.068279 30192 tablet_service.cc:1511] Processing CreateTablet for tablet afd6a0afe3684c689a3587a53a560ec3 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:19:30.070104 30336 tablet_service.cc:1511] Processing CreateTablet for tablet ff03218495d14467b6f1a3ddc083aed9 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:30.091171 30336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff03218495d14467b6f1a3ddc083aed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.071204 30260 tablet_service.cc:1511] Processing CreateTablet for tablet ff03218495d14467b6f1a3ddc083aed9 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:30.071127 30410 tablet_service.cc:1511] Processing CreateTablet for tablet 54a5db9cc7d848d191162399432049df (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:30.096028 30410 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a5db9cc7d848d191162399432049df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.098657 30482 raft_consensus.cc:493] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.099325 30482 raft_consensus.cc:515] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.104511 30482 leader_election.cc:290] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:30.107623 30474 tablet_bootstrap.cc:492] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:30.108271 30474 ts_tablet_manager.cc:1403] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.011s
I20260709 12:19:30.108349 30425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f7f948772a44d189f9c2255d68385e" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:30.110934 30166 leader_election.cc:343] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.111773 30474 raft_consensus.cc:359] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.112588 30474 raft_consensus.cc:385] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.112924 30474 raft_consensus.cc:740] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.116035 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f7f948772a44d189f9c2255d68385e" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:30.117591 30167 leader_election.cc:343] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:30.064764 30244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 71205.3us
I20260709 12:19:30.038733 30481 raft_consensus.cc:2749] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.089773 30191 tablet_service.cc:1511] Processing CreateTablet for tablet ff03218495d14467b6f1a3ddc083aed9 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:19:30.091121 30263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e0bb2451c3442cab4eee04748a2baa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.091171 30192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd6a0afe3684c689a3587a53a560ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.118042 30167 leader_election.cc:304] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:30.119306 30191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff03218495d14467b6f1a3ddc083aed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.119486 30482 raft_consensus.cc:2749] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.122742 30260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff03218495d14467b6f1a3ddc083aed9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.127797 30473 tablet_bootstrap.cc:492] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.128443 30473 ts_tablet_manager.cc:1403] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.222s	user 0.015s	sys 0.050s
I20260709 12:19:30.131574 30473 raft_consensus.cc:359] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.132287 30473 raft_consensus.cc:385] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.132570 30473 raft_consensus.cc:740] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.133276 30473 consensus_queue.cc:260] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.135129 30509 raft_consensus.cc:493] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.135654 30509 raft_consensus.cc:515] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.136863 30426 raft_consensus.cc:2468] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:30.138600 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:30.138765 30315 leader_election.cc:304] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:30.139876 30479 raft_consensus.cc:2804] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:19:30.139983 30391 leader_election.cc:343] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.140383 30479 raft_consensus.cc:697] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:30.141853 30479 consensus_queue.cc:237] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.113761 30474 consensus_queue.cc:260] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.146087 30187 tablet_service.cc:1511] Processing CreateTablet for tablet 54a5db9cc7d848d191162399432049df (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:30.147636 30187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a5db9cc7d848d191162399432049df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.148624 30473 ts_tablet_manager.cc:1434] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:19:30.149632 30473 tablet_bootstrap.cc:492] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:30.151432 30474 ts_tablet_manager.cc:1434] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:19:30.152590 30474 tablet_bootstrap.cc:492] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:30.085834 30472 tablet_bootstrap.cc:492] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:30.155463 30509 leader_election.cc:290] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:30.154183 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:30.158555 30390 leader_election.cc:343] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.158984 30390 leader_election.cc:304] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:30.160742 30339 tablet_service.cc:1511] Processing CreateTablet for tablet 8cef54b2bf92402f9064be5769a44bd9 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:30.161084 30266 tablet_service.cc:1511] Processing CreateTablet for tablet 54a5db9cc7d848d191162399432049df (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:19:30.162540 30266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54a5db9cc7d848d191162399432049df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.162662 30509 raft_consensus.cc:2749] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.167526 30339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cef54b2bf92402f9064be5769a44bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.179730 30413 tablet_service.cc:1511] Processing CreateTablet for tablet 8cef54b2bf92402f9064be5769a44bd9 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:30.181180 30413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cef54b2bf92402f9064be5769a44bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.183838 30190 tablet_service.cc:1511] Processing CreateTablet for tablet 8cef54b2bf92402f9064be5769a44bd9 (DEFAULT_TABLE table=test-workload [id=fc6dfa27e97a433d9ef3329e6668774e]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:19:30.185218 30190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cef54b2bf92402f9064be5769a44bd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:30.199805 30471 tablet_bootstrap.cc:492] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:30.200366 30471 ts_tablet_manager.cc:1403] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.275s	user 0.016s	sys 0.026s
I20260709 12:19:30.205026 30472 tablet_bootstrap.cc:654] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.209770 30473 tablet_bootstrap.cc:654] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.232419 30471 raft_consensus.cc:359] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.233566 30471 raft_consensus.cc:385] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.237263 30474 tablet_bootstrap.cc:654] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.233968 30471 raft_consensus.cc:740] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
W20260709 12:19:30.294121 30086 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 63153us
I20260709 12:19:30.297214 30100 catalog_manager.cc:5697] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.298753 30471 consensus_queue.cc:260] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.307673 30471 ts_tablet_manager.cc:1434] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.008s
I20260709 12:19:30.308714 30471 tablet_bootstrap.cc:492] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:30.320469 30473 tablet_bootstrap.cc:492] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.321046 30473 ts_tablet_manager.cc:1403] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.172s	user 0.043s	sys 0.048s
I20260709 12:19:30.324048 30473 raft_consensus.cc:359] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.324801 30473 raft_consensus.cc:385] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.325102 30473 raft_consensus.cc:740] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.326260 30505 raft_consensus.cc:493] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.326193 30473 consensus_queue.cc:260] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.326993 30505 raft_consensus.cc:515] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.328862 30473 ts_tablet_manager.cc:1434] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:19:30.329893 30473 tablet_bootstrap.cc:492] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:30.330848 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:30.332010 30482 raft_consensus.cc:493] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:30.333003 30244 leader_election.cc:343] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.332494 30482 raft_consensus.cc:515] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.335160 30505 leader_election.cc:290] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:30.344007 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:30.345490 30168 leader_election.cc:343] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.347059 30482 leader_election.cc:290] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:30.348780 30472 tablet_bootstrap.cc:492] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:30.348642 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:30.349040 30471 tablet_bootstrap.cc:654] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.349289 30472 ts_tablet_manager.cc:1403] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.264s	user 0.028s	sys 0.044s
W20260709 12:19:30.350188 30167 leader_election.cc:343] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.350687 30167 leader_election.cc:304] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:30.352047 30482 raft_consensus.cc:2749] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.352476 30472 raft_consensus.cc:359] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.353243 30472 raft_consensus.cc:385] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.353569 30472 raft_consensus.cc:740] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.358390 30509 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.359114 30509 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.362305 30509 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:30.365499 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:30.367395 30391 leader_election.cc:343] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.367910 30473 tablet_bootstrap.cc:654] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.371235 30479 raft_consensus.cc:493] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.370941 30472 consensus_queue.cc:260] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.371801 30479 raft_consensus.cc:515] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.373288 30474 tablet_bootstrap.cc:492] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:30.373845 30474 ts_tablet_manager.cc:1403] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.221s	user 0.022s	sys 0.006s
I20260709 12:19:30.374571 30479 leader_election.cc:290] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:30.376189 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:30.378247 30318 leader_election.cc:343] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.379935 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:30.381103 30471 tablet_bootstrap.cc:492] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
W20260709 12:19:30.381560 30317 leader_election.cc:343] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.381800 30471 ts_tablet_manager.cc:1403] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.017s
I20260709 12:19:30.382036 30317 leader_election.cc:304] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:30.383245 30479 raft_consensus.cc:2749] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.386397 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:30.386057 30471 raft_consensus.cc:359] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.387200 30471 raft_consensus.cc:385] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.387638 30471 raft_consensus.cc:740] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.377923 30474 raft_consensus.cc:359] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
W20260709 12:19:30.389146 30392 leader_election.cc:343] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.389375 30474 raft_consensus.cc:385] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.389695 30392 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:30.390056 30474 raft_consensus.cc:740] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.391299 30509 raft_consensus.cc:2749] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.391232 30474 consensus_queue.cc:260] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.393151 30471 consensus_queue.cc:260] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.394073 30474 ts_tablet_manager.cc:1434] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:19:30.373339 30472 ts_tablet_manager.cc:1434] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:19:30.395236 30474 tablet_bootstrap.cc:492] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:30.396749 30471 ts_tablet_manager.cc:1434] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:19:30.402616 30471 tablet_bootstrap.cc:492] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:30.396114 30472 tablet_bootstrap.cc:492] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:30.406561 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:30.408231 30242 leader_election.cc:343] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.408977 30471 tablet_bootstrap.cc:654] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.408780 30242 leader_election.cc:304] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:30.409777 30505 raft_consensus.cc:2749] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.411342 30474 tablet_bootstrap.cc:654] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.415894 30472 tablet_bootstrap.cc:654] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.434859 30472 tablet_bootstrap.cc:492] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:30.435633 30472 ts_tablet_manager.cc:1403] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.016s
I20260709 12:19:30.440563 30472 raft_consensus.cc:359] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.441625 30472 raft_consensus.cc:385] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.442247 30472 raft_consensus.cc:740] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.443606 30474 tablet_bootstrap.cc:492] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:30.444250 30474 ts_tablet_manager.cc:1403] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.002s
I20260709 12:19:30.443341 30472 consensus_queue.cc:260] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.447273 30474 raft_consensus.cc:359] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.447988 30474 raft_consensus.cc:385] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.448841 30509 raft_consensus.cc:493] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.449014 30473 tablet_bootstrap.cc:492] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.449524 30473 ts_tablet_manager.cc:1403] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.120s	user 0.028s	sys 0.012s
I20260709 12:19:30.449366 30509 raft_consensus.cc:515] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.451503 30509 leader_election.cc:290] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:30.451581 30472 ts_tablet_manager.cc:1434] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 12:19:30.452586 30473 raft_consensus.cc:359] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.453114 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f7f948772a44d189f9c2255d68385e" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:30.453329 30473 raft_consensus.cc:385] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.453153 30472 tablet_bootstrap.cc:492] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:30.453828 30473 raft_consensus.cc:740] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.463450 30472 tablet_bootstrap.cc:654] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.472710 30473 consensus_queue.cc:260] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.475023 30473 ts_tablet_manager.cc:1434] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:19:30.453771 30203 raft_consensus.cc:2468] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:30.448292 30474 raft_consensus.cc:740] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.476094 30474 consensus_queue.cc:260] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.456367 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f7f948772a44d189f9c2255d68385e" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:30.476411 30392 leader_election.cc:304] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:30.477355 30471 tablet_bootstrap.cc:492] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:30.477710 30509 raft_consensus.cc:2804] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:30.477893 30471 ts_tablet_manager.cc:1403] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.076s	user 0.025s	sys 0.038s
I20260709 12:19:30.478170 30509 raft_consensus.cc:493] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.478605 30509 raft_consensus.cc:3060] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.482267 30471 raft_consensus.cc:359] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:30.483304 30390 leader_election.cc:343] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.483474 30471 raft_consensus.cc:385] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.483938 30471 raft_consensus.cc:740] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.484934 30471 consensus_queue.cc:260] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.488250 30471 ts_tablet_manager.cc:1434] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:30.489817 30471 tablet_bootstrap.cc:492] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:30.493947 30474 ts_tablet_manager.cc:1434] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 12:19:30.495867 30474 tablet_bootstrap.cc:492] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:30.488262 30509 raft_consensus.cc:515] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.477727 30473 tablet_bootstrap.cc:492] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:30.502434 30471 tablet_bootstrap.cc:654] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.505401 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f7f948772a44d189f9c2255d68385e" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:30.506016 30203 raft_consensus.cc:3060] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.506858 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f7f948772a44d189f9c2255d68385e" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
W20260709 12:19:30.509069 30390 leader_election.cc:343] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.512919 30203 raft_consensus.cc:2468] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:30.513614 30509 leader_election.cc:290] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:30.514057 30392 leader_election.cc:304] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:30.516463 30509 raft_consensus.cc:2804] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:30.517588 30473 tablet_bootstrap.cc:654] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.517774 30509 raft_consensus.cc:697] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:30.518792 30509 consensus_queue.cc:237] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.522212 30474 tablet_bootstrap.cc:654] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.531490 30472 tablet_bootstrap.cc:492] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:30.532182 30472 ts_tablet_manager.cc:1403] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.079s	user 0.041s	sys 0.031s
I20260709 12:19:30.533507 30471 tablet_bootstrap.cc:492] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:30.533808 30474 tablet_bootstrap.cc:492] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:30.534117 30471 ts_tablet_manager.cc:1403] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.045s	user 0.004s	sys 0.027s
I20260709 12:19:30.534354 30474 ts_tablet_manager.cc:1403] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.001s
I20260709 12:19:30.537102 30472 raft_consensus.cc:359] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.537864 30471 raft_consensus.cc:359] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.538141 30472 raft_consensus.cc:385] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.538841 30471 raft_consensus.cc:385] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.539147 30472 raft_consensus.cc:740] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.539247 30471 raft_consensus.cc:740] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.540148 30472 consensus_queue.cc:260] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.540596 30473 tablet_bootstrap.cc:492] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.540302 30471 consensus_queue.cc:260] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.543929 30472 ts_tablet_manager.cc:1434] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:19:30.544942 30472 tablet_bootstrap.cc:492] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:30.545701 30473 ts_tablet_manager.cc:1403] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.003s
I20260709 12:19:30.545090 30101 catalog_manager.cc:5697] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:30.548972 30473 raft_consensus.cc:359] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.550854 30472 tablet_bootstrap.cc:654] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.553012 30471 ts_tablet_manager.cc:1434] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:19:30.560617 30473 raft_consensus.cc:385] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.561044 30473 raft_consensus.cc:740] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.537611 30474 raft_consensus.cc:359] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.562207 30471 tablet_bootstrap.cc:492] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:30.562232 30474 raft_consensus.cc:385] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.563885 30474 raft_consensus.cc:740] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.564885 30474 consensus_queue.cc:260] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.561863 30473 consensus_queue.cc:260] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.570710 30471 tablet_bootstrap.cc:654] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.575105 30473 ts_tablet_manager.cc:1434] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.003s
I20260709 12:19:30.576534 30473 tablet_bootstrap.cc:492] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:30.582468 30474 ts_tablet_manager.cc:1434] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 12:19:30.583659 30474 tablet_bootstrap.cc:492] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:30.586704 30473 tablet_bootstrap.cc:654] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.589983 30474 tablet_bootstrap.cc:654] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.592212 30471 tablet_bootstrap.cc:492] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:30.592756 30471 ts_tablet_manager.cc:1403] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.003s
I20260709 12:19:30.592989 30505 raft_consensus.cc:493] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.593641 30505 raft_consensus.cc:515] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.596408 30505 leader_election.cc:290] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:30.597155 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:30.597100 30471 raft_consensus.cc:359] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.597648 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:30.598095 30471 raft_consensus.cc:385] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.598491 30471 raft_consensus.cc:740] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
W20260709 12:19:30.598784 30241 leader_election.cc:343] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:30.599303 30244 leader_election.cc:343] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.599431 30471 consensus_queue.cc:260] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.599824 30244 leader_election.cc:304] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:30.601114 30505 raft_consensus.cc:2749] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.602133 30471 ts_tablet_manager.cc:1434] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:19:30.603497 30471 tablet_bootstrap.cc:492] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:30.605412 30472 tablet_bootstrap.cc:492] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:30.605944 30472 ts_tablet_manager.cc:1403] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.061s	user 0.020s	sys 0.015s
I20260709 12:19:30.606933 30473 tablet_bootstrap.cc:492] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.607564 30473 ts_tablet_manager.cc:1403] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.004s
I20260709 12:19:30.608896 30472 raft_consensus.cc:359] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.609622 30472 raft_consensus.cc:385] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.609927 30472 raft_consensus.cc:740] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.610872 30472 consensus_queue.cc:260] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.611220 30473 raft_consensus.cc:359] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.611893 30474 tablet_bootstrap.cc:492] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:30.612263 30473 raft_consensus.cc:385] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.612488 30474 ts_tablet_manager.cc:1403] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 12:19:30.612708 30473 raft_consensus.cc:740] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.613801 30473 consensus_queue.cc:260] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.616827 30473 ts_tablet_manager.cc:1434] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:30.617072 30472 ts_tablet_manager.cc:1434] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:19:30.618059 30473 tablet_bootstrap.cc:492] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:30.618151 30472 tablet_bootstrap.cc:492] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:30.619820 30474 raft_consensus.cc:359] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.620661 30474 raft_consensus.cc:385] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.620996 30474 raft_consensus.cc:740] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.621824 30474 consensus_queue.cc:260] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.624619 30474 ts_tablet_manager.cc:1434] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:19:30.625738 30474 tablet_bootstrap.cc:492] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:30.627190 30473 tablet_bootstrap.cc:654] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.631286 30471 tablet_bootstrap.cc:654] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.632928 30474 tablet_bootstrap.cc:654] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.638005 30473 tablet_bootstrap.cc:492] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.638484 30473 ts_tablet_manager.cc:1403] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.004s
I20260709 12:19:30.641199 30473 raft_consensus.cc:359] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.641841 30472 tablet_bootstrap.cc:654] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.641901 30473 raft_consensus.cc:385] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.642338 30473 raft_consensus.cc:740] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.643080 30473 consensus_queue.cc:260] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.644905 30473 ts_tablet_manager.cc:1434] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:30.645803 30473 tablet_bootstrap.cc:492] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:30.651125 30471 tablet_bootstrap.cc:492] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:30.651453 30473 tablet_bootstrap.cc:654] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.651958 30471 ts_tablet_manager.cc:1403] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.014s
I20260709 12:19:30.653242 30482 raft_consensus.cc:493] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.653867 30482 raft_consensus.cc:515] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.657351 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:30.657727 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:30.658231 30352 raft_consensus.cc:2468] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:30.658668 30426 raft_consensus.cc:2468] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:30.660502 30166 leader_election.cc:304] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:30.661811 30482 leader_election.cc:290] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:30.662638 30482 raft_consensus.cc:2804] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:30.663184 30482 raft_consensus.cc:493] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.663712 30482 raft_consensus.cc:3060] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.670132 30474 tablet_bootstrap.cc:492] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:30.670843 30474 ts_tablet_manager.cc:1403] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.045s	user 0.028s	sys 0.014s
I20260709 12:19:30.673734 30474 raft_consensus.cc:359] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.674249 30479 consensus_queue.cc:1048] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:30.678267 30474 raft_consensus.cc:385] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.678591 30474 raft_consensus.cc:740] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.679353 30474 consensus_queue.cc:260] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.680025 30472 tablet_bootstrap.cc:492] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:30.680683 30472 ts_tablet_manager.cc:1403] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.063s	user 0.007s	sys 0.011s
I20260709 12:19:30.684506 30472 raft_consensus.cc:359] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.685359 30472 raft_consensus.cc:385] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.676527 30471 raft_consensus.cc:359] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.685712 30472 raft_consensus.cc:740] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.686523 30471 raft_consensus.cc:385] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.687443 30471 raft_consensus.cc:740] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.687028 30472 consensus_queue.cc:260] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.689955 30474 ts_tablet_manager.cc:1434] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:19:30.691164 30474 tablet_bootstrap.cc:492] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:30.689720 30471 consensus_queue.cc:260] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.694253 30471 ts_tablet_manager.cc:1434] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.002s
I20260709 12:19:30.702538 30473 tablet_bootstrap.cc:492] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.702998 30472 ts_tablet_manager.cc:1434] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:19:30.703013 30473 ts_tablet_manager.cc:1403] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.057s	user 0.032s	sys 0.023s
I20260709 12:19:30.706067 30473 raft_consensus.cc:359] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.706684 30479 raft_consensus.cc:493] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.706802 30473 raft_consensus.cc:385] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.707180 30474 tablet_bootstrap.cc:654] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.707261 30479 raft_consensus.cc:515] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.709513 30479 leader_election.cc:290] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:30.707216 30473 raft_consensus.cc:740] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.710811 30473 consensus_queue.cc:260] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.712751 30473 ts_tablet_manager.cc:1434] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:19:30.712806 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:30.713707 30473 tablet_bootstrap.cc:492] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
W20260709 12:19:30.714915 30317 leader_election.cc:343] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.720101 30473 tablet_bootstrap.cc:654] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.724119 30479 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.724834 30479 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.729075 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:30.730751 30479 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
W20260709 12:19:30.731738 30318 leader_election.cc:343] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:30.737699 30317 consensus_peers.cc:597] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:30.741325 30509 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.742033 30509 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.744187 30472 tablet_bootstrap.cc:492] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:30.745808 30509 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:30.747416 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:30.750078 30203 raft_consensus.cc:2393] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:30.748929 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:30.751785 30277 raft_consensus.cc:2393] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:30.753054 30391 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:30.754629 30509 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.769882 30472 tablet_bootstrap.cc:654] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.772810 30473 tablet_bootstrap.cc:492] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.773342 30473 ts_tablet_manager.cc:1403] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.060s	user 0.031s	sys 0.027s
W20260709 12:19:30.775134 30149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:30.776136 30473 raft_consensus.cc:359] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.777004 30473 raft_consensus.cc:385] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.777267 30505 raft_consensus.cc:493] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.777361 30473 raft_consensus.cc:740] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.777951 30505 raft_consensus.cc:515] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.778476 30473 consensus_queue.cc:260] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.780613 30505 leader_election.cc:290] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:30.782099 30471 tablet_bootstrap.cc:492] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:30.782299 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092c6b1d5ae4678ad3e75eb0bf15237" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:30.783751 30242 leader_election.cc:343] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.785495 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092c6b1d5ae4678ad3e75eb0bf15237" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:30.786741 30472 tablet_bootstrap.cc:492] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:30.787273 30472 ts_tablet_manager.cc:1403] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.002s
W20260709 12:19:30.787406 30241 leader_election.cc:343] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.788316 30473 ts_tablet_manager.cc:1434] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.005s
I20260709 12:19:30.788101 30241 leader_election.cc:304] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:30.789623 30505 raft_consensus.cc:2749] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.790306 30472 raft_consensus.cc:359] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.791085 30472 raft_consensus.cc:385] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.791401 30472 raft_consensus.cc:740] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.792490 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:30.793514 30545 raft_consensus.cc:493] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.793978 30545 raft_consensus.cc:515] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:30.794607 30315 leader_election.cc:343] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.795079 30315 leader_election.cc:304] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:30.796140 30545 leader_election.cc:290] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:30.796326 30504 raft_consensus.cc:2749] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.792943 30473 tablet_bootstrap.cc:492] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
W20260709 12:19:30.796463 30166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 136063us
I20260709 12:19:30.800772 30482 raft_consensus.cc:515] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.802968 30473 tablet_bootstrap.cc:654] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.802775 30543 raft_consensus.cc:493] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.792268 30472 consensus_queue.cc:260] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.817878 30543 raft_consensus.cc:515] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.805719 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:30.819180 30472 ts_tablet_manager.cc:1434] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260709 12:19:30.819311 30277 raft_consensus.cc:2468] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:30.820268 30472 tablet_bootstrap.cc:492] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:30.807394 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:30.803694 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:30.824610 30543 leader_election.cc:290] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:30.826362 30315 leader_election.cc:343] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.826918 30315 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:30.827519 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:30.830585 30277 raft_consensus.cc:2468] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:30.831334 30504 raft_consensus.cc:2749] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.828401 30168 leader_election.cc:304] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
W20260709 12:19:30.832566 30166 leader_election.cc:343] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.833693 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:30.834378 30351 raft_consensus.cc:3060] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.834614 30471 tablet_bootstrap.cc:654] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.836320 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:30.837005 30424 raft_consensus.cc:3060] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.839807 30474 tablet_bootstrap.cc:492] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:30.840320 30474 ts_tablet_manager.cc:1403] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.149s	user 0.056s	sys 0.060s
I20260709 12:19:30.841454 30473 tablet_bootstrap.cc:492] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.841943 30473 ts_tablet_manager.cc:1403] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.001s
I20260709 12:19:30.843097 30474 raft_consensus.cc:359] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.829691 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:30.843982 30474 raft_consensus.cc:385] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.844230 30352 raft_consensus.cc:2468] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:30.843538 30543 raft_consensus.cc:2804] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:30.831856 30509 raft_consensus.cc:2749] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:30.844996 30543 raft_consensus.cc:493] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.845417 30543 raft_consensus.cc:3060] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.847553 30473 raft_consensus.cc:359] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.848330 30473 raft_consensus.cc:385] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.848618 30473 raft_consensus.cc:740] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.829833 30472 tablet_bootstrap.cc:654] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.849354 30473 consensus_queue.cc:260] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.851962 30473 ts_tablet_manager.cc:1434] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:19:30.831346 30482 leader_election.cc:290] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:30.852954 30543 raft_consensus.cc:515] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.853888 30351 raft_consensus.cc:2468] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:30.854359 30473 tablet_bootstrap.cc:492] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:30.844308 30474 raft_consensus.cc:740] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.855778 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:30.856098 30471 tablet_bootstrap.cc:492] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:30.856016 30474 consensus_queue.cc:260] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.856650 30471 ts_tablet_manager.cc:1403] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.002s
W20260709 12:19:30.858680 30166 leader_election.cc:343] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.844578 30168 leader_election.cc:304] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:30.859923 30471 raft_consensus.cc:359] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.860710 30471 raft_consensus.cc:385] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.860877 30474 ts_tablet_manager.cc:1434] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:19:30.861038 30471 raft_consensus.cc:740] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.861552 30167 leader_election.cc:304] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:30.861907 30474 tablet_bootstrap.cc:492] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:30.862475 30482 raft_consensus.cc:2804] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:30.863051 30482 raft_consensus.cc:697] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:30.863510 30538 raft_consensus.cc:2804] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:30.863924 30538 raft_consensus.cc:493] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.864431 30538 raft_consensus.cc:3060] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.863948 30482 consensus_queue.cc:237] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.865274 30424 raft_consensus.cc:2468] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:30.868672 30543 leader_election.cc:290] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:30.869277 30543 raft_consensus.cc:493] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.862015 30471 consensus_queue.cc:260] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.875181 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:30.875829 30277 raft_consensus.cc:3060] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.877277 30509 raft_consensus.cc:493] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.877800 30509 raft_consensus.cc:515] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:30.874259 30471 ts_tablet_manager.cc:1434] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.002s
I20260709 12:19:30.876451 30538 raft_consensus.cc:515] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.880910 30473 tablet_bootstrap.cc:654] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.882124 30538 leader_election.cc:290] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:30.882858 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:30.883416 30471 tablet_bootstrap.cc:492] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:30.869760 30543 raft_consensus.cc:515] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.884966 30509 leader_election.cc:290] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:30.885584 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092c6b1d5ae4678ad3e75eb0bf15237" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:30.886003 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092c6b1d5ae4678ad3e75eb0bf15237" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:30.886255 30278 raft_consensus.cc:2468] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:30.887481 30391 leader_election.cc:304] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
W20260709 12:19:30.888329 30390 leader_election.cc:343] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.888543 30277 raft_consensus.cc:2468] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:30.889062 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:30.889705 30278 raft_consensus.cc:3060] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.883543 30351 raft_consensus.cc:3060] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.891742 30474 tablet_bootstrap.cc:654] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.888329 30509 raft_consensus.cc:2804] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:30.893366 30509 raft_consensus.cc:493] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.893739 30509 raft_consensus.cc:3060] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.898506 30481 raft_consensus.cc:493] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.898624 30168 leader_election.cc:304] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:30.899003 30481 raft_consensus.cc:515] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.899703 30538 raft_consensus.cc:2804] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:30.900523 30538 raft_consensus.cc:697] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:30.901120 30481 leader_election.cc:290] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:30.901758 30538 consensus_queue.cc:237] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.903443 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b715660e336d48828daede8c69a9d353" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:30.904183 30203 raft_consensus.cc:2468] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:30.906641 30543 leader_election.cc:290] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:30.904302 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b715660e336d48828daede8c69a9d353" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:30.908185 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:30.908583 30277 raft_consensus.cc:2468] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:30.909623 30392 leader_election.cc:304] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:30.910087 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:30.912127 30167 leader_election.cc:343] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.913800 30481 raft_consensus.cc:2804] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:30.914819 30424 raft_consensus.cc:2468] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:30.915033 30278 raft_consensus.cc:2468] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:30.916276 30166 leader_election.cc:304] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:30.914847 30481 raft_consensus.cc:493] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.917074 30481 raft_consensus.cc:3060] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.917865 30168 leader_election.cc:304] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:30.918818 30545 raft_consensus.cc:2804] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:30.919243 30545 raft_consensus.cc:493] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.919593 30545 raft_consensus.cc:3060] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.924206 30482 raft_consensus.cc:2804] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:30.924883 30482 raft_consensus.cc:697] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:30.927399 30554 raft_consensus.cc:493] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.927990 30554 raft_consensus.cc:515] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.928500 30545 raft_consensus.cc:515] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:30.931465 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:30.933204 30390 leader_election.cc:343] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.934821 30555 consensus_queue.cc:1048] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:30.936491 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:30.937283 30424 raft_consensus.cc:3060] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.926035 30482 consensus_queue.cc:237] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.938994 30473 tablet_bootstrap.cc:492] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:30.914088 30471 tablet_bootstrap.cc:654] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.939539 30473 ts_tablet_manager.cc:1403] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.014s
I20260709 12:19:30.931739 30472 tablet_bootstrap.cc:492] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:30.941555 30472 ts_tablet_manager.cc:1403] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.121s	user 0.013s	sys 0.002s
I20260709 12:19:30.940491 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:30.922077 30351 raft_consensus.cc:2468] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:30.941074 30545 leader_election.cc:290] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:30.924885 30481 raft_consensus.cc:515] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.947615 30472 raft_consensus.cc:359] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.948115 30472 raft_consensus.cc:385] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.948297 30472 raft_consensus.cc:740] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.948730 30472 consensus_queue.cc:260] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.914845 30509 raft_consensus.cc:515] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
W20260709 12:19:30.950968 30167 leader_election.cc:343] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.951682 30509 leader_election.cc:290] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:30.952941 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092c6b1d5ae4678ad3e75eb0bf15237" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:30.953522 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092c6b1d5ae4678ad3e75eb0bf15237" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
W20260709 12:19:30.954646 30390 leader_election.cc:343] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.957033 30481 leader_election.cc:290] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:30.958760 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b715660e336d48828daede8c69a9d353" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:30.959306 30473 raft_consensus.cc:359] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.961004 30473 raft_consensus.cc:385] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:30.960729 30505 raft_consensus.cc:493] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.961318 30202 raft_consensus.cc:3060] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.956945 30098 catalog_manager.cc:5697] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:30.961431 30473 raft_consensus.cc:740] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:30.962651 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:30.962810 30473 consensus_queue.cc:260] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:30.963608 30201 raft_consensus.cc:2393] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:30.961663 30545 raft_consensus.cc:493] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.964098 30545 raft_consensus.cc:515] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.960523 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b715660e336d48828daede8c69a9d353" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:30.964987 30277 raft_consensus.cc:3060] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.965145 30473 ts_tablet_manager.cc:1434] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:19:30.966044 30545 leader_election.cc:290] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:30.966163 30473 tablet_bootstrap.cc:492] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:30.967836 30276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:30.968586 30276 raft_consensus.cc:2468] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:30.961959 30505 raft_consensus.cc:515] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.970597 30168 leader_election.cc:304] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:30.971873 30505 leader_election.cc:290] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:30.972375 30545 raft_consensus.cc:2804] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:30.972743 30545 raft_consensus.cc:493] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:30.973081 30545 raft_consensus.cc:3060] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.960911 30554 leader_election.cc:290] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:30.973846 30392 leader_election.cc:304] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:30.975310 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:30.976716 30472 ts_tablet_manager.cc:1434] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:19:30.977694 30472 tablet_bootstrap.cc:492] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:30.978580 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:30.979303 30278 raft_consensus.cc:3060] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:30.985894 30201 raft_consensus.cc:2468] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:30.990084 30202 raft_consensus.cc:2468] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:30.991511 30392 leader_election.cc:304] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:30.994350 30504 raft_consensus.cc:493] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.994946 30504 raft_consensus.cc:515] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:30.995301 30424 raft_consensus.cc:2468] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:30.996579 30472 tablet_bootstrap.cc:654] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.996699 30166 leader_election.cc:304] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:30.997219 30504 leader_election.cc:290] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:30.998014 30538 raft_consensus.cc:2804] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:30.981211 30473 tablet_bootstrap.cc:654] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:30.978861 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:30.981945 30242 leader_election.cc:343] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:30.982205 30474 tablet_bootstrap.cc:492] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:30.999755 30474 ts_tablet_manager.cc:1403] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.138s	user 0.022s	sys 0.012s
I20260709 12:19:30.999166 30543 raft_consensus.cc:493] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:30.992619 30481 raft_consensus.cc:2804] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.007789 30244 leader_election.cc:304] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:31.010739 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.002512 30351 raft_consensus.cc:2468] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:31.010735 30474 raft_consensus.cc:359] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.013322 30474 raft_consensus.cc:385] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.013839 30474 raft_consensus.cc:740] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.006053 30543 raft_consensus.cc:515] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.015849 30276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:31.016755 30276 raft_consensus.cc:2468] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:31.017560 30543 leader_election.cc:290] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:31.018680 30317 leader_election.cc:304] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:30.999419 30554 raft_consensus.cc:2749] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.025377 30278 raft_consensus.cc:2468] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:31.025875 30277 raft_consensus.cc:2468] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:31.021941 30505 raft_consensus.cc:2804] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.027124 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:31.027397 30505 raft_consensus.cc:493] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.027757 30505 raft_consensus.cc:3060] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.027832 30351 raft_consensus.cc:2468] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:31.029907 30167 leader_election.cc:304] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:31.030054 30538 raft_consensus.cc:697] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:31.030736 30543 raft_consensus.cc:2804] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.031610 30474 consensus_queue.cc:260] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.022167 30504 raft_consensus.cc:2804] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.021423 30481 raft_consensus.cc:697] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:31.031117 30543 raft_consensus.cc:493] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.031282 30276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:31.038091 30543 raft_consensus.cc:3060] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.044852 30505 raft_consensus.cc:515] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.047216 30391 leader_election.cc:304] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:31.048210 30555 raft_consensus.cc:2804] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.049108 30276 raft_consensus.cc:2468] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:31.035421 30504 raft_consensus.cc:493] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.050390 30504 raft_consensus.cc:3060] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.051864 30505 leader_election.cc:290] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:31.052132 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:31.052520 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:31.052829 30203 raft_consensus.cc:3060] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:31.053890 30242 leader_election.cc:343] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.056923 30481 consensus_queue.cc:237] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.064702 30474 ts_tablet_manager.cc:1434] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.064s	user 0.015s	sys 0.011s
I20260709 12:19:31.066035 30474 tablet_bootstrap.cc:492] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:31.062415 30555 raft_consensus.cc:697] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:31.036300 30545 raft_consensus.cc:515] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.072719 30555 consensus_queue.cc:237] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.074962 30560 raft_consensus.cc:493] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.074791 30543 raft_consensus.cc:515] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.067696 30479 raft_consensus.cc:493] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.077607 30471 tablet_bootstrap.cc:492] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:31.078243 30471 ts_tablet_manager.cc:1403] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.195s	user 0.022s	sys 0.020s
I20260709 12:19:31.079800 30479 raft_consensus.cc:515] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.063377 30538 consensus_queue.cc:237] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.082540 30543 leader_election.cc:290] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:31.082738 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:31.083374 30351 raft_consensus.cc:3060] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.083169 30471 raft_consensus.cc:359] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.083905 30471 raft_consensus.cc:385] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.084287 30471 raft_consensus.cc:740] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.085059 30276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:31.084968 30471 consensus_queue.cc:260] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.083045 30479 leader_election.cc:290] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:31.086648 30276 raft_consensus.cc:3060] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.086050 30202 raft_consensus.cc:2393] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:31.090123 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f7f948772a44d189f9c2255d68385e" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.090373 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:31.090494 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8f7f948772a44d189f9c2255d68385e" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.091068 30278 raft_consensus.cc:3060] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.091961 30203 raft_consensus.cc:2468] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:31.092199 30318 leader_election.cc:304] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:31.093384 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:31.075771 30560 raft_consensus.cc:515] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.100708 30244 leader_election.cc:304] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:31.102602 30505 raft_consensus.cc:2804] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.090417 30545 leader_election.cc:290] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:31.096145 30479 raft_consensus.cc:2749] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.108932 30350 raft_consensus.cc:3060] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.110246 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:31.112282 30242 leader_election.cc:343] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.118513 30474 tablet_bootstrap.cc:654] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.120625 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.119359 30560 leader_election.cc:290] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:31.121294 30424 raft_consensus.cc:2468] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:31.123871 30241 leader_election.cc:304] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:31.128156 30560 raft_consensus.cc:2804] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.130213 30560 raft_consensus.cc:493] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.130666 30560 raft_consensus.cc:3060] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.135098 30473 tablet_bootstrap.cc:492] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:31.135609 30473 ts_tablet_manager.cc:1403] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.170s	user 0.006s	sys 0.012s
I20260709 12:19:31.138262 30473 raft_consensus.cc:359] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.140492 30473 raft_consensus.cc:385] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.140865 30473 raft_consensus.cc:740] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.139245 30563 consensus_queue.cc:1048] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:31.141834 30351 raft_consensus.cc:2468] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:31.142807 30474 tablet_bootstrap.cc:492] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:31.143369 30479 raft_consensus.cc:493] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.150079 30545 raft_consensus.cc:493] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.143967 30474 ts_tablet_manager.cc:1403] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.021s
I20260709 12:19:31.144098 30479 raft_consensus.cc:515] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.152630 30543 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.153173 30543 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.152571 30545 raft_consensus.cc:515] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.144737 30167 leader_election.cc:304] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:31.162621 30559 raft_consensus.cc:2804] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.163129 30559 raft_consensus.cc:697] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:31.164005 30559 consensus_queue.cc:237] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.169238 30472 tablet_bootstrap.cc:492] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:31.169899 30472 ts_tablet_manager.cc:1403] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.192s	user 0.013s	sys 0.003s
I20260709 12:19:31.178158 30472 raft_consensus.cc:359] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.178876 30472 raft_consensus.cc:385] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.178958 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.147415 30473 consensus_queue.cc:260] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.179777 30424 raft_consensus.cc:2468] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:31.181478 30473 ts_tablet_manager.cc:1434] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:19:31.182545 30473 tablet_bootstrap.cc:492] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:31.182679 30166 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:31.184130 30482 raft_consensus.cc:2804] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.184572 30482 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.184921 30482 raft_consensus.cc:3060] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.186980 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f75df59c846458323e4564150c3d7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.151490 30504 raft_consensus.cc:515] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.188373 30352 raft_consensus.cc:2393] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 777b1410f165436aa725262b964ff0a6 in current term 1: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
W20260709 12:19:31.188634 30315 leader_election.cc:343] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.179173 30472 raft_consensus.cc:740] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.190028 30504 leader_election.cc:290] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.190559 30472 consensus_queue.cc:260] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.191442 30504 raft_consensus.cc:493] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.191926 30504 raft_consensus.cc:515] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.193930 30504 leader_election.cc:290] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.196482 30482 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.199748 30543 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.200091 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:31.202208 30168 leader_election.cc:343] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.202333 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d78f4a893e8471a8324169a33739e06" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.203383 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f75df59c846458323e4564150c3d7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:31.203930 30166 leader_election.cc:343] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.205444 30545 leader_election.cc:290] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.140275 30278 raft_consensus.cc:2468] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:31.206485 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d78f4a893e8471a8324169a33739e06" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:31.207758 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:31.208555 30277 raft_consensus.cc:2393] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:31.179164 30479 leader_election.cc:290] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
W20260709 12:19:31.209580 30168 leader_election.cc:343] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.210054 30168 leader_election.cc:304] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:31.211329 30168 leader_election.cc:304] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:31.212198 30577 raft_consensus.cc:2749] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.212982 30577 raft_consensus.cc:2804] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.213888 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:31.215704 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:31.216449 30424 raft_consensus.cc:3060] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.217226 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
W20260709 12:19:31.217870 30317 leader_election.cc:343] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.218425 30317 leader_election.cc:304] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
W20260709 12:19:31.218637 30168 leader_election.cc:343] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.219708 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:31.216475 30560 raft_consensus.cc:515] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.221385 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.221956 30482 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.222506 30577 raft_consensus.cc:697] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:31.221215 30474 raft_consensus.cc:359] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.223637 30577 consensus_queue.cc:237] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.224227 30474 raft_consensus.cc:385] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.224431 30471 ts_tablet_manager.cc:1434] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.146s	user 0.009s	sys 0.003s
I20260709 12:19:31.224663 30474 raft_consensus.cc:740] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.225564 30474 consensus_queue.cc:260] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:31.226001 30318 leader_election.cc:343] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.199653 30276 raft_consensus.cc:2468] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:31.226483 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:31.225528 30471 tablet_bootstrap.cc:492] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
W20260709 12:19:31.228076 30242 leader_election.cc:343] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.230319 30424 raft_consensus.cc:2468] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:31.231714 30166 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:31.232841 30482 raft_consensus.cc:2804] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.233035 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:31.233400 30482 raft_consensus.cc:697] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:31.233768 30423 raft_consensus.cc:3060] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.234440 30482 consensus_queue.cc:237] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.237097 30471 tablet_bootstrap.cc:654] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.243570 30504 raft_consensus.cc:2749] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.244853 30472 ts_tablet_manager.cc:1434] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.075s	user 0.011s	sys 0.000s
I20260709 12:19:31.245620 30317 leader_election.cc:304] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:31.246023 30472 tablet_bootstrap.cc:492] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:31.249997 30579 raft_consensus.cc:493] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:31.250025 30317 leader_election.cc:343] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.250702 30317 leader_election.cc:304] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:31.251483 30571 raft_consensus.cc:2749] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.250509 30098 catalog_manager.cc:5697] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.253037 30100 catalog_manager.cc:5697] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.254077 30098 catalog_manager.cc:5697] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:31.255527 30474 ts_tablet_manager.cc:1434] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.011s
I20260709 12:19:31.256098 30471 tablet_bootstrap.cc:492] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:31.256402 30474 tablet_bootstrap.cc:492] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:31.256739 30471 ts_tablet_manager.cc:1403] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.002s
I20260709 12:19:31.256038 30098 catalog_manager.cc:5697] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.259660 30471 raft_consensus.cc:359] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.260317 30471 raft_consensus.cc:385] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.260409 30575 raft_consensus.cc:2749] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.260619 30471 raft_consensus.cc:740] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.261536 30471 consensus_queue.cc:260] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.261958 30423 raft_consensus.cc:2468] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:31.262315 30474 tablet_bootstrap.cc:654] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.263303 30241 leader_election.cc:304] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:31.263877 30471 ts_tablet_manager.cc:1434] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:31.265007 30471 tablet_bootstrap.cc:492] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:31.250656 30579 raft_consensus.cc:515] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.265825 30276 raft_consensus.cc:3060] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.269135 30583 raft_consensus.cc:2804] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.271932 30560 leader_election.cc:290] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:31.271780 30505 raft_consensus.cc:697] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:31.273298 30579 leader_election.cc:290] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:31.274909 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89100a63be0348a1bf66a13a95a3f8c0" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:31.273694 30505 consensus_queue.cc:237] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.277874 30471 tablet_bootstrap.cc:654] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.278810 30473 tablet_bootstrap.cc:654] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.269611 30583 raft_consensus.cc:697] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:31.281862 30583 consensus_queue.cc:237] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.285646 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89100a63be0348a1bf66a13a95a3f8c0" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.287290 30241 leader_election.cc:304] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:31.290109 30099 catalog_manager.cc:5697] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:31.301496 30472 tablet_bootstrap.cc:654] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.303157 30474 tablet_bootstrap.cc:492] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:31.319229 30474 ts_tablet_manager.cc:1403] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.002s
I20260709 12:19:31.325925 30579 raft_consensus.cc:2749] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.329181 30100 catalog_manager.cc:5697] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.330848 30474 raft_consensus.cc:359] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.331911 30474 raft_consensus.cc:385] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.332353 30474 raft_consensus.cc:740] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.333315 30474 consensus_queue.cc:260] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.338596 30474 ts_tablet_manager.cc:1434] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:19:31.339699 30474 tablet_bootstrap.cc:492] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:31.340850 30100 catalog_manager.cc:5697] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.331265 30098 catalog_manager.cc:5697] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.346295 30474 tablet_bootstrap.cc:654] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.347869 30471 tablet_bootstrap.cc:492] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:31.349285 30471 ts_tablet_manager.cc:1403] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.026s
I20260709 12:19:31.352707 30474 tablet_bootstrap.cc:492] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:31.353212 30474 ts_tablet_manager.cc:1403] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:19:31.342906 30100 catalog_manager.cc:5697] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.350299 30473 tablet_bootstrap.cc:492] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:31.354784 30473 ts_tablet_manager.cc:1403] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.172s	user 0.015s	sys 0.007s
I20260709 12:19:31.355223 30471 raft_consensus.cc:359] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.355968 30471 raft_consensus.cc:385] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.355792 30474 raft_consensus.cc:359] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.356333 30471 raft_consensus.cc:740] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.356591 30474 raft_consensus.cc:385] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.356961 30474 raft_consensus.cc:740] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.357156 30471 consensus_queue.cc:260] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.351725 30482 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.351078 30472 tablet_bootstrap.cc:492] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:31.357686 30474 consensus_queue.cc:260] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.358335 30482 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.359112 30472 ts_tablet_manager.cc:1403] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.004s
I20260709 12:19:31.360270 30474 ts_tablet_manager.cc:1434] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:31.360734 30482 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:31.361883 30474 tablet_bootstrap.cc:492] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:31.361892 30481 raft_consensus.cc:493] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.362591 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.362697 30481 raft_consensus.cc:515] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.364300 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:31.365036 30351 raft_consensus.cc:2468] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:31.365981 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d78f4a893e8471a8324169a33739e06" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.366329 30276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d78f4a893e8471a8324169a33739e06" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:31.366710 30166 leader_election.cc:343] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.366770 30203 raft_consensus.cc:2468] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
W20260709 12:19:31.367861 30391 leader_election.cc:343] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.368311 30167 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:31.368734 30481 leader_election.cc:290] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.368871 30474 tablet_bootstrap.cc:654] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.357435 30473 raft_consensus.cc:359] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.369431 30473 raft_consensus.cc:385] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.369740 30473 raft_consensus.cc:740] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.369932 30538 raft_consensus.cc:2804] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.370369 30538 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.370791 30538 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.370501 30473 consensus_queue.cc:260] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.370577 30392 leader_election.cc:304] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:31.372866 30473 ts_tablet_manager.cc:1434] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:19:31.373343 30481 raft_consensus.cc:2804] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.373914 30473 tablet_bootstrap.cc:492] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:31.374018 30481 raft_consensus.cc:493] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.374815 30481 raft_consensus.cc:3060] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.378152 30577 consensus_queue.cc:1048] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.379910 30471 ts_tablet_manager.cc:1434] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:19:31.380331 30482 consensus_queue.cc:1048] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:31.382602 30473 tablet_bootstrap.cc:654] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.386348 30471 tablet_bootstrap.cc:492] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:31.363997 30472 raft_consensus.cc:359] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.395414 30471 tablet_bootstrap.cc:654] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.395478 30472 raft_consensus.cc:385] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.395984 30472 raft_consensus.cc:740] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.396787 30472 consensus_queue.cc:260] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.400581 30538 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.407766 30101 catalog_manager.cc:5697] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:31.408353 30481 raft_consensus.cc:515] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.407789 30472 ts_tablet_manager.cc:1434] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.001s
I20260709 12:19:31.411203 30574 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.411891 30574 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.415001 30574 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:31.416231 30472 tablet_bootstrap.cc:492] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:31.417447 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.421301 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:31.422571 30392 leader_election.cc:343] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.422977 30472 tablet_bootstrap.cc:654] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:31.425582 30390 leader_election.cc:343] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.426270 30390 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:31.428879 30577 consensus_queue.cc:1048] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.428966 30482 consensus_queue.cc:1048] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.434700 30574 raft_consensus.cc:2749] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.452180 30472 tablet_bootstrap.cc:492] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:31.452833 30472 ts_tablet_manager.cc:1403] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.001s
I20260709 12:19:31.449483 30538 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:31.455962 30481 leader_election.cc:290] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.460902 30474 tablet_bootstrap.cc:492] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:31.461463 30472 raft_consensus.cc:359] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.461648 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:31.461681 30474 ts_tablet_manager.cc:1403] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.100s	user 0.017s	sys 0.024s
I20260709 12:19:31.462385 30352 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.464356 30473 tablet_bootstrap.cc:492] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:31.464825 30473 ts_tablet_manager.cc:1403] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.091s	user 0.020s	sys 0.015s
I20260709 12:19:31.462163 30472 raft_consensus.cc:385] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.466588 30472 raft_consensus.cc:740] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.466380 30474 raft_consensus.cc:359] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.467610 30474 raft_consensus.cc:385] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.467409 30472 consensus_queue.cc:260] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.468025 30474 raft_consensus.cc:740] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.469781 30472 ts_tablet_manager.cc:1434] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:19:31.469182 30474 consensus_queue.cc:260] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.460930 30276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d78f4a893e8471a8324169a33739e06" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:31.470809 30472 tablet_bootstrap.cc:492] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:31.473732 30474 ts_tablet_manager.cc:1434] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 12:19:31.474767 30474 tablet_bootstrap.cc:492] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:31.475581 30481 raft_consensus.cc:493] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.475839 30473 raft_consensus.cc:359] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.476773 30481 raft_consensus.cc:515] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.477348 30473 raft_consensus.cc:385] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.477761 30473 raft_consensus.cc:740] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.478916 30471 tablet_bootstrap.cc:492] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:31.478473 30473 consensus_queue.cc:260] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.479435 30471 ts_tablet_manager.cc:1403] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.093s	user 0.018s	sys 0.018s
I20260709 12:19:31.480126 30481 leader_election.cc:290] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.481014 30473 ts_tablet_manager.cc:1434] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:19:31.556710 30473 tablet_bootstrap.cc:492] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:31.558835 30474 tablet_bootstrap.cc:654] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.526113 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.562952 30472 tablet_bootstrap.cc:654] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.526113 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d78f4a893e8471a8324169a33739e06" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:31.530985 30276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:31.550624 30391 leader_election.cc:343] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.553421 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:31.572185 30577 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.572007 30571 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.576740 30579 raft_consensus.cc:493] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.574995 30583 raft_consensus.cc:493] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.578913 30583 raft_consensus.cc:515] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.579289 30571 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.577749 30579 raft_consensus.cc:515] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.586735 30276 raft_consensus.cc:2393] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:31.587150 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.588546 30579 leader_election.cc:290] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:31.590373 30391 leader_election.cc:304] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:31.590950 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.591233 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.591622 30481 raft_consensus.cc:3060] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:31.593262 30244 leader_election.cc:343] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.602447 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:31.605530 30350 raft_consensus.cc:2468] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:31.604445 30545 consensus_queue.cc:1048] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:19:31.599040 30203 raft_consensus.cc:3060] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.612484 30242 leader_election.cc:304] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:31.614192 30505 raft_consensus.cc:2804] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.614773 30505 raft_consensus.cc:493] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.615195 30505 raft_consensus.cc:3060] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.604575 30577 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.598450 30571 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:31.621359 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:31.621675 30315 leader_election.cc:343] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.624629 30574 consensus_queue.cc:1048] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.627136 30577 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:31.627842 30202 raft_consensus.cc:2468] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
W20260709 12:19:31.629976 30241 leader_election.cc:343] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.630920 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:31.631255 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:31.631834 30349 raft_consensus.cc:2468] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:31.631991 30348 raft_consensus.cc:2468] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:31.482575 30471 raft_consensus.cc:359] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.634524 30471 raft_consensus.cc:385] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.634935 30471 raft_consensus.cc:740] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.635949 30471 consensus_queue.cc:260] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.636932 30423 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.644528 30203 raft_consensus.cc:2468] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:31.646097 30167 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:31.647351 30577 consensus_queue.cc:1048] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.648867 30318 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:31.649366 30577 raft_consensus.cc:2804] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.649890 30577 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.651561 30392 leader_election.cc:304] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:31.653501 30563 consensus_queue.cc:1048] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.655539 30563 raft_consensus.cc:2804] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.656183 30571 raft_consensus.cc:2804] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.656834 30571 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.657193 30571 raft_consensus.cc:3060] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.658842 30242 leader_election.cc:304] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:31.660107 30579 raft_consensus.cc:2804] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:31.660149 30577 raft_consensus.cc:3060] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.656148 30563 raft_consensus.cc:697] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:31.680063 30563 consensus_queue.cc:237] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.683046 30352 raft_consensus.cc:2468] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:31.664578 30559 consensus_queue.cc:1048] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.665460 30423 raft_consensus.cc:2468] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
W20260709 12:19:31.666548 30390 consensus_peers.cc:597] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:31.670626 30473 tablet_bootstrap.cc:654] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.670524 30538 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.671319 30574 consensus_queue.cc:1048] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.673169 30575 raft_consensus.cc:493] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.676064 30481 raft_consensus.cc:2749] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.677471 30560 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.628648 30583 leader_election.cc:290] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:31.660633 30579 raft_consensus.cc:493] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.698330 30538 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.702237 30560 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.705086 30560 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:31.705385 30575 raft_consensus.cc:515] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.699224 30579 raft_consensus.cc:3060] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.705101 30538 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.712656 30350 raft_consensus.cc:3060] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.718633 30474 tablet_bootstrap.cc:492] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:31.719003 30422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.719405 30474 ts_tablet_manager.cc:1403] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.245s	user 0.016s	sys 0.020s
I20260709 12:19:31.733098 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:31.733971 30275 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:31.734453 30422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.736761 30575 leader_election.cc:290] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:31.745059 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.750047 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.736783 30422 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:31.758652 30474 raft_consensus.cc:359] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.762750 30167 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:31.763255 30474 raft_consensus.cc:385] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.763746 30474 raft_consensus.cc:740] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.762452 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:31.763686 30167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 47691.6us
I20260709 12:19:31.759584 30577 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.766027 30538 raft_consensus.cc:2804] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:31.780385 30472 tablet_bootstrap.cc:492] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
W20260709 12:19:31.781471 30166 leader_election.cc:343] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.781533 30474 consensus_queue.cc:260] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:31.785982 30166 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:31.787443 30604 raft_consensus.cc:2804] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:31.787920 30474 ts_tablet_manager.cc:1434] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.003s
I20260709 12:19:31.787981 30604 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:31.788803 30604 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:31.791349 30560 raft_consensus.cc:493] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.792205 30560 raft_consensus.cc:515] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.797765 30349 raft_consensus.cc:3060] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.790004 30474 tablet_bootstrap.cc:492] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:31.801898 30538 raft_consensus.cc:697] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:31.814165 30604 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.805182 30315 leader_election.cc:304] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:31.817009 30604 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:31.817305 30482 consensus_queue.cc:1048] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.816992 30538 consensus_queue.cc:237] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:31.804273 30390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 97730.2us
I20260709 12:19:31.820932 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:31.822862 30426 raft_consensus.cc:2393] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f03b88e02d9c4039964e2ab17a35bf52 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:31.825695 30577 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:31.826958 30472 ts_tablet_manager.cc:1403] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.356s	user 0.007s	sys 0.012s
I20260709 12:19:31.829591 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:31.783977 30505 raft_consensus.cc:515] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
W20260709 12:19:31.811842 30392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 45859.4us
I20260709 12:19:31.855847 30422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
W20260709 12:19:31.858408 30166 leader_election.cc:343] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.859506 30241 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:31.859894 30545 consensus_queue.cc:1048] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.862809 30583 consensus_queue.cc:1048] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:31.866535 30473 tablet_bootstrap.cc:492] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:31.867071 30473 ts_tablet_manager.cc:1403] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.311s	user 0.012s	sys 0.008s
I20260709 12:19:31.853039 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
W20260709 12:19:31.877840 30149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:31.884477 30560 leader_election.cc:290] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:31.886014 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:31.886703 30278 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:31.888837 30575 raft_consensus.cc:2749] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.879814 30424 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:31.892915 30579 raft_consensus.cc:515] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.894975 30278 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
W20260709 12:19:31.900822 30610 log.cc:927] Time spent T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.177s	user 0.004s	sys 0.000s
I20260709 12:19:31.900995 30571 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.903796 30471 ts_tablet_manager.cc:1434] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.424s	user 0.012s	sys 0.000s
I20260709 12:19:31.905202 30471 tablet_bootstrap.cc:492] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:31.905956 30348 raft_consensus.cc:2393] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 777b1410f165436aa725262b964ff0a6 in current term 1: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:31.906551 30425 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
W20260709 12:19:31.908291 30315 leader_election.cc:343] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:31.912400 30482 consensus_queue.cc:1048] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:31.913129 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:31.913632 30168 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:31.868427 30545 consensus_queue.cc:1048] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:19:31.915738 30473 raft_consensus.cc:359] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.916229 30545 raft_consensus.cc:2804] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:31.916481 30473 raft_consensus.cc:385] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.884392 30615 raft_consensus.cc:3060] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.916929 30473 raft_consensus.cc:740] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
W20260709 12:19:31.918648 30611 log.cc:927] Time spent T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.139s	user 0.002s	sys 0.000s
I20260709 12:19:31.918694 30543 consensus_queue.cc:1048] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:31.915937 30167 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:31.916827 30545 raft_consensus.cc:697] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:31.933127 30505 leader_election.cc:290] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:31.930881 30545 consensus_queue.cc:237] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.917774 30473 consensus_queue.cc:260] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:31.954172 30571 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:31.960374 30474 tablet_bootstrap.cc:654] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.963222 30473 ts_tablet_manager.cc:1434] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.096s	user 0.007s	sys 0.000s
I20260709 12:19:31.965270 30473 tablet_bootstrap.cc:492] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:31.966231 30424 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:31.940600 30559 raft_consensus.cc:2749] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:31.956844 30472 raft_consensus.cc:359] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:31.986586 30472 raft_consensus.cc:385] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:31.986967 30472 raft_consensus.cc:740] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:31.994920 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:31.995995 30202 raft_consensus.cc:2393] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:31.996958 30504 raft_consensus.cc:493] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:31.997499 30504 raft_consensus.cc:515] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:31.997905 30473 tablet_bootstrap.cc:654] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:31.998857 30318 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.000053 30571 raft_consensus.cc:2749] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.007093 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:32.008522 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:32.008950 30620 consensus_queue.cc:1048] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.009654 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:32.010430 30348 raft_consensus.cc:3060] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:31.975216 30604 raft_consensus.cc:493] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.014688 30604 raft_consensus.cc:515] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.017189 30604 leader_election.cc:290] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:32.018858 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44d3048f1f74e7481b0772d32316b86" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:32.021510 30472 consensus_queue.cc:260] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:31.993058 30244 leader_election.cc:343] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:32.029556 30166 leader_election.cc:343] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.032958 30579 leader_election.cc:290] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
W20260709 12:19:32.033456 30241 leader_election.cc:343] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:32.036087 30242 leader_election.cc:343] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:32.037326 30244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 44308us
W20260709 12:19:32.048390 30617 log.cc:927] Time spent T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:19:32.062418 30472 ts_tablet_manager.cc:1434] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.235s	user 0.009s	sys 0.001s
I20260709 12:19:32.063357 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:32.063810 30472 tablet_bootstrap.cc:492] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:32.064244 30615 raft_consensus.cc:2749] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.065435 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44d3048f1f74e7481b0772d32316b86" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:32.066606 30244 leader_election.cc:343] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.070760 30471 tablet_bootstrap.cc:654] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:32.074755 30168 leader_election.cc:343] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.074865 30348 raft_consensus.cc:2468] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:32.079435 30472 tablet_bootstrap.cc:654] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.084484 30473 tablet_bootstrap.cc:492] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:32.085044 30473 ts_tablet_manager.cc:1403] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.120s	user 0.013s	sys 0.004s
I20260709 12:19:32.084926 30571 raft_consensus.cc:493] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.092415 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:32.092356 30504 leader_election.cc:290] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:32.089721 30571 raft_consensus.cc:515] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.095992 30101 catalog_manager.cc:5697] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:32.097043 30571 leader_election.cc:290] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:32.098305 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:32.086632 30168 leader_election.cc:304] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
W20260709 12:19:32.099682 30318 leader_election.cc:343] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.099627 30473 raft_consensus.cc:359] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.100512 30473 raft_consensus.cc:385] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.099745 30538 raft_consensus.cc:2749] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.100826 30473 raft_consensus.cc:740] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.101008 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.100833 30583 consensus_queue.cc:1048] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.101864 30473 consensus_queue.cc:260] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.103142 30317 leader_election.cc:304] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:32.104503 30571 raft_consensus.cc:2749] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:32.104331 30577 consensus_queue.cc:1048] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:32.107092 30473 ts_tablet_manager.cc:1434] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:19:32.107951 30242 leader_election.cc:304] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:32.108609 30473 tablet_bootstrap.cc:492] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
W20260709 12:19:32.108953 30242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 93789.2us
I20260709 12:19:32.109606 30471 tablet_bootstrap.cc:492] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
W20260709 12:19:32.109733 30242 consensus_peers.cc:597] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:32.110085 30471 ts_tablet_manager.cc:1403] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.205s	user 0.013s	sys 0.000s
I20260709 12:19:32.110432 30579 raft_consensus.cc:2749] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.111066 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:32.113895 30538 consensus_queue.cc:1048] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:32.114771 30472 tablet_bootstrap.cc:492] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:32.115233 30472 ts_tablet_manager.cc:1403] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.000s
W20260709 12:19:32.117892 30315 leader_election.cc:343] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.118808 30315 leader_election.cc:304] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.121057 30472 raft_consensus.cc:359] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.121747 30472 raft_consensus.cc:385] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.122002 30472 raft_consensus.cc:740] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.122656 30472 consensus_queue.cc:260] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.123693 30504 raft_consensus.cc:2749] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:32.125464 30391 consensus_peers.cc:597] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:32.125888 30472 ts_tablet_manager.cc:1434] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:19:32.126008 30474 tablet_bootstrap.cc:492] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:32.130940 30474 ts_tablet_manager.cc:1403] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.341s	user 0.011s	sys 0.004s
I20260709 12:19:32.117895 30471 raft_consensus.cc:359] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.133402 30471 raft_consensus.cc:385] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.133805 30471 raft_consensus.cc:740] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.138507 30474 raft_consensus.cc:359] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.127105 30472 tablet_bootstrap.cc:492] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:32.139240 30474 raft_consensus.cc:385] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.139572 30474 raft_consensus.cc:740] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.140201 30474 consensus_queue.cc:260] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.115907 30473 tablet_bootstrap.cc:654] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.141518 30242 leader_election.cc:304] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.141249 30471 consensus_queue.cc:260] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.144829 30471 ts_tablet_manager.cc:1434] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:19:32.145884 30471 tablet_bootstrap.cc:492] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:32.149710 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:32.150367 30348 raft_consensus.cc:3060] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.152336 30583 raft_consensus.cc:2804] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.152827 30583 raft_consensus.cc:697] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:32.153761 30583 consensus_queue.cc:237] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.162379 30471 tablet_bootstrap.cc:654] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.176718 30472 tablet_bootstrap.cc:654] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.176318 30348 raft_consensus.cc:2468] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:32.176787 30474 ts_tablet_manager.cc:1434] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 12:19:32.179448 30242 leader_election.cc:304] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:32.180820 30579 raft_consensus.cc:2804] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.181317 30579 raft_consensus.cc:697] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:32.182899 30579 consensus_queue.cc:237] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.191699 30474 tablet_bootstrap.cc:492] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:32.201110 30577 raft_consensus.cc:493] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.207067 30577 raft_consensus.cc:515] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.209869 30577 leader_election.cc:290] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:32.211977 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.214116 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:32.225390 30350 raft_consensus.cc:2393] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 777b1410f165436aa725262b964ff0a6 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:32.226989 30167 leader_election.cc:304] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:32.228513 30577 raft_consensus.cc:3060] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.230070 30474 tablet_bootstrap.cc:654] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.240701 30473 tablet_bootstrap.cc:492] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:32.241410 30473 ts_tablet_manager.cc:1403] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.133s	user 0.007s	sys 0.010s
I20260709 12:19:32.245385 30538 raft_consensus.cc:493] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.246047 30538 raft_consensus.cc:515] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.249022 30571 raft_consensus.cc:493] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.249557 30571 raft_consensus.cc:515] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.250355 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:32.250718 30538 leader_election.cc:290] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:32.251701 30571 leader_election.cc:290] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
W20260709 12:19:32.252081 30166 leader_election.cc:343] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.255936 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.258664 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092c6b1d5ae4678ad3e75eb0bf15237" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:32.259121 30168 leader_election.cc:343] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.259727 30168 leader_election.cc:304] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:32.260632 30538 raft_consensus.cc:2749] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.260825 30583 raft_consensus.cc:493] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.261452 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7092c6b1d5ae4678ad3e75eb0bf15237" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.261397 30543 consensus_queue.cc:1048] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.261355 30583 raft_consensus.cc:515] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.263082 30317 leader_election.cc:304] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:32.264338 30571 raft_consensus.cc:2749] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.264679 30583 leader_election.cc:290] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:32.264849 30564 consensus_queue.cc:1048] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.266757 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:32.267481 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:32.268143 30244 leader_election.cc:343] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:32.269098 30242 leader_election.cc:343] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.269707 30242 leader_election.cc:304] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:32.273366 30621 raft_consensus.cc:493] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.273990 30621 raft_consensus.cc:515] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.276789 30621 leader_election.cc:290] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:32.277648 30472 tablet_bootstrap.cc:492] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:32.278209 30472 ts_tablet_manager.cc:1403] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.151s	user 0.016s	sys 0.026s
I20260709 12:19:32.279978 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db98cf7c8374d57a7606069ab0d00dd" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:32.281155 30472 raft_consensus.cc:359] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:32.281672 30242 leader_election.cc:343] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.281891 30472 raft_consensus.cc:385] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.272578 30583 raft_consensus.cc:2749] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.283291 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db98cf7c8374d57a7606069ab0d00dd" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:32.286329 30241 leader_election.cc:343] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.286787 30241 leader_election.cc:304] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.286993 30474 tablet_bootstrap.cc:492] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:32.287608 30474 ts_tablet_manager.cc:1403] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.001s
I20260709 12:19:32.290925 30474 raft_consensus.cc:359] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.291632 30474 raft_consensus.cc:385] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.291962 30474 raft_consensus.cc:740] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.293283 30474 consensus_queue.cc:260] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.293774 30583 raft_consensus.cc:2749] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.295866 30474 ts_tablet_manager.cc:1434] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:19:32.297147 30474 tablet_bootstrap.cc:492] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:32.282260 30472 raft_consensus.cc:740] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.303580 30471 tablet_bootstrap.cc:492] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:32.303270 30472 consensus_queue.cc:260] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.304050 30471 ts_tablet_manager.cc:1403] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.158s	user 0.020s	sys 0.019s
I20260709 12:19:32.305248 30474 tablet_bootstrap.cc:654] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.305462 30472 ts_tablet_manager.cc:1434] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.000s
I20260709 12:19:32.307503 30472 tablet_bootstrap.cc:492] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:32.311307 30482 consensus_queue.cc:1048] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:32.313452 30472 tablet_bootstrap.cc:654] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.317214 30474 tablet_bootstrap.cc:492] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:32.318048 30474 ts_tablet_manager.cc:1403] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 12:19:32.321071 30474 raft_consensus.cc:359] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.321982 30474 raft_consensus.cc:385] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.322330 30474 raft_consensus.cc:740] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.323199 30474 consensus_queue.cc:260] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.324883 30473 raft_consensus.cc:359] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.325623 30473 raft_consensus.cc:385] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.325902 30473 raft_consensus.cc:740] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.326071 30474 ts_tablet_manager.cc:1434] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:19:32.327620 30474 tablet_bootstrap.cc:492] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:32.330852 30471 raft_consensus.cc:359] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.331879 30471 raft_consensus.cc:385] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.332232 30471 raft_consensus.cc:740] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.333374 30471 consensus_queue.cc:260] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.335098 30474 tablet_bootstrap.cc:654] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.336490 30473 consensus_queue.cc:260] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.339035 30473 ts_tablet_manager.cc:1434] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.097s	user 0.006s	sys 0.004s
I20260709 12:19:32.340425 30473 tablet_bootstrap.cc:492] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:32.340812 30471 ts_tablet_manager.cc:1434] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 12:19:32.342022 30471 tablet_bootstrap.cc:492] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:32.342800 30577 raft_consensus.cc:2749] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.346980 30474 tablet_bootstrap.cc:492] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:32.347514 30474 ts_tablet_manager.cc:1403] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:19:32.351099 30472 tablet_bootstrap.cc:492] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:32.351558 30472 ts_tablet_manager.cc:1403] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.027s
I20260709 12:19:32.352645 30100 catalog_manager.cc:5697] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:32.354408 30473 tablet_bootstrap.cc:654] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.355475 30579 raft_consensus.cc:493] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.355273 30472 raft_consensus.cc:359] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.356233 30472 raft_consensus.cc:385] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.356061 30579 raft_consensus.cc:515] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.356603 30472 raft_consensus.cc:740] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.357477 30472 consensus_queue.cc:260] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.359714 30471 tablet_bootstrap.cc:654] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.360512 30472 ts_tablet_manager.cc:1434] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:19:32.360759 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44d3048f1f74e7481b0772d32316b86" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:32.361673 30472 tablet_bootstrap.cc:492] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
W20260709 12:19:32.362860 30241 leader_election.cc:343] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.364495 30579 leader_election.cc:290] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:32.354511 30100 catalog_manager.cc:5697] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:32.365144 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44d3048f1f74e7481b0772d32316b86" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:32.365593 30473 tablet_bootstrap.cc:492] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:32.365890 30201 raft_consensus.cc:2468] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:32.366081 30473 ts_tablet_manager.cc:1403] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.006s
I20260709 12:19:32.367274 30244 leader_election.cc:304] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.368407 30472 tablet_bootstrap.cc:654] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.368628 30579 raft_consensus.cc:2804] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.368778 30571 raft_consensus.cc:493] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.369048 30579 raft_consensus.cc:493] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.369510 30579 raft_consensus.cc:3060] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.369351 30571 raft_consensus.cc:515] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.371764 30571 leader_election.cc:290] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:32.374518 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db98cf7c8374d57a7606069ab0d00dd" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.375205 30274 raft_consensus.cc:2468] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:32.376323 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db98cf7c8374d57a7606069ab0d00dd" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:32.377205 30579 raft_consensus.cc:515] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.369045 30473 raft_consensus.cc:359] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.378734 30473 raft_consensus.cc:385] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.378999 30473 raft_consensus.cc:740] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
W20260709 12:19:32.377898 30315 leader_election.cc:343] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.380385 30317 leader_election.cc:304] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.381886 30472 tablet_bootstrap.cc:492] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:32.382376 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44d3048f1f74e7481b0772d32316b86" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:32.383069 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44d3048f1f74e7481b0772d32316b86" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:32.382901 30473 consensus_queue.cc:260] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.383690 30201 raft_consensus.cc:3060] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.383848 30571 raft_consensus.cc:2804] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.384294 30571 raft_consensus.cc:493] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.384618 30571 raft_consensus.cc:3060] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.385370 30473 ts_tablet_manager.cc:1434] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:19:32.382405 30472 ts_tablet_manager.cc:1403] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
W20260709 12:19:32.386968 30241 leader_election.cc:343] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.389918 30472 raft_consensus.cc:359] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.391211 30472 raft_consensus.cc:385] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.393646 30472 raft_consensus.cc:740] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.393153 30579 leader_election.cc:290] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:32.392727 30201 raft_consensus.cc:2468] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:32.395123 30472 consensus_queue.cc:260] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.386504 30473 tablet_bootstrap.cc:492] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:32.392846 30474 raft_consensus.cc:359] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.397001 30474 raft_consensus.cc:385] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.396898 30244 leader_election.cc:304] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.398232 30474 raft_consensus.cc:740] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.400393 30474 consensus_queue.cc:260] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.401439 30563 raft_consensus.cc:493] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.399513 30472 ts_tablet_manager.cc:1434] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:19:32.401813 30583 raft_consensus.cc:2804] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.401949 30563 raft_consensus.cc:515] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.402514 30583 raft_consensus.cc:697] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:32.403180 30472 tablet_bootstrap.cc:492] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:32.403577 30583 consensus_queue.cc:237] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.407660 30471 tablet_bootstrap.cc:492] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:32.408193 30471 ts_tablet_manager.cc:1403] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.066s	user 0.016s	sys 0.003s
I20260709 12:19:32.408452 30474 ts_tablet_manager.cc:1434] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.001s
I20260709 12:19:32.409129 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f75df59c846458323e4564150c3d7" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.409785 30274 raft_consensus.cc:2468] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:32.408375 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f75df59c846458323e4564150c3d7" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:32.410835 30348 raft_consensus.cc:2468] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:32.412139 30390 leader_election.cc:304] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:32.413010 30481 raft_consensus.cc:2804] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.413388 30481 raft_consensus.cc:493] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.413728 30481 raft_consensus.cc:3060] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.414445 30471 raft_consensus.cc:359] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.415258 30471 raft_consensus.cc:385] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.415570 30471 raft_consensus.cc:740] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.393307 30571 raft_consensus.cc:515] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.420158 30571 leader_election.cc:290] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:32.420950 30471 consensus_queue.cc:260] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.421432 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db98cf7c8374d57a7606069ab0d00dd" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:32.422057 30424 raft_consensus.cc:3060] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.423629 30473 tablet_bootstrap.cc:654] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.428058 30471 ts_tablet_manager.cc:1434] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:19:32.429297 30471 tablet_bootstrap.cc:492] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:32.430730 30424 raft_consensus.cc:2468] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:32.431689 30472 tablet_bootstrap.cc:654] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.432914 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2db98cf7c8374d57a7606069ab0d00dd" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:32.433563 30274 raft_consensus.cc:3060] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.434831 30315 leader_election.cc:304] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:32.435931 30571 raft_consensus.cc:2804] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.436872 30571 raft_consensus.cc:697] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:32.436165 30471 tablet_bootstrap.cc:654] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.438248 30571 consensus_queue.cc:237] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.409795 30474 tablet_bootstrap.cc:492] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:32.439531 30563 leader_election.cc:290] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:32.443439 30274 raft_consensus.cc:2468] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:32.444862 30481 raft_consensus.cc:515] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.456629 30471 tablet_bootstrap.cc:492] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:32.457182 30471 ts_tablet_manager.cc:1403] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 12:19:32.460280 30471 raft_consensus.cc:359] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.460947 30471 raft_consensus.cc:385] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.461242 30471 raft_consensus.cc:740] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.461941 30471 consensus_queue.cc:260] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.464200 30471 ts_tablet_manager.cc:1434] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:19:32.473701 30474 tablet_bootstrap.cc:654] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.492054 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f75df59c846458323e4564150c3d7" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:32.492978 30348 raft_consensus.cc:3060] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.476452 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc2f75df59c846458323e4564150c3d7" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:32.494954 30275 raft_consensus.cc:3060] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.501573 30481 leader_election.cc:290] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:32.504679 30471 tablet_bootstrap.cc:492] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:32.504942 30350 raft_consensus.cc:3060] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.507548 30348 raft_consensus.cc:2468] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:32.526031 30473 tablet_bootstrap.cc:492] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:32.525894 30390 leader_election.cc:304] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:32.526795 30473 ts_tablet_manager.cc:1403] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.141s	user 0.037s	sys 0.012s
I20260709 12:19:32.527366 30481 raft_consensus.cc:2804] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.530369 30471 tablet_bootstrap.cc:654] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.532032 30424 raft_consensus.cc:1275] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:32.534845 30482 consensus_queue.cc:1048] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.537062 30614 raft_consensus.cc:493] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.537803 30614 raft_consensus.cc:515] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.540937 30614 leader_election.cc:290] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:32.542676 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.545936 30423 raft_consensus.cc:3060] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.532027 30473 raft_consensus.cc:359] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.552798 30473 raft_consensus.cc:385] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.553249 30473 raft_consensus.cc:740] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.560010 30472 tablet_bootstrap.cc:492] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:32.560523 30472 ts_tablet_manager.cc:1403] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.158s	user 0.023s	sys 0.037s
I20260709 12:19:32.552080 30481 raft_consensus.cc:697] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:32.562883 30473 consensus_queue.cc:260] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.564641 30471 tablet_bootstrap.cc:492] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:32.568903 30471 ts_tablet_manager.cc:1403] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.009s
I20260709 12:19:32.570722 30481 consensus_queue.cc:237] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.571841 30471 raft_consensus.cc:359] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.572515 30471 raft_consensus.cc:385] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.572772 30471 raft_consensus.cc:740] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.578661 30583 consensus_queue.cc:1048] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:32.581036 30472 raft_consensus.cc:359] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.581744 30472 raft_consensus.cc:385] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.582016 30472 raft_consensus.cc:740] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.558092 30275 raft_consensus.cc:2468] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:32.562145 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:32.583703 30472 consensus_queue.cc:260] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.578104 30471 consensus_queue.cc:260] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.561069 30097 catalog_manager.cc:5697] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:32.610538 30348 raft_consensus.cc:2393] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:32.621980 30474 tablet_bootstrap.cc:492] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:32.622593 30474 ts_tablet_manager.cc:1403] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.213s	user 0.047s	sys 0.061s
I20260709 12:19:32.623026 30473 ts_tablet_manager.cc:1434] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.096s	user 0.018s	sys 0.017s
I20260709 12:19:32.624608 30472 ts_tablet_manager.cc:1434] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.064s	user 0.006s	sys 0.005s
I20260709 12:19:32.625753 30472 tablet_bootstrap.cc:492] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:32.626247 30097 catalog_manager.cc:5697] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:32.626959 30390 leader_election.cc:304] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:32.633138 30563 raft_consensus.cc:2749] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.629026 30474 raft_consensus.cc:359] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.633598 30474 raft_consensus.cc:385] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.633881 30474 raft_consensus.cc:740] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.635147 30571 raft_consensus.cc:493] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.628053 30473 tablet_bootstrap.cc:492] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:32.635644 30471 ts_tablet_manager.cc:1434] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.066s	user 0.015s	sys 0.004s
I20260709 12:19:32.635648 30571 raft_consensus.cc:515] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.637027 30471 tablet_bootstrap.cc:492] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:32.634629 30474 consensus_queue.cc:260] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.639236 30474 ts_tablet_manager.cc:1434] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:19:32.632352 30275 raft_consensus.cc:1275] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:32.639544 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902e818d7d70457b93827ef5cf71cdaf" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:32.641944 30315 leader_election.cc:343] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.642855 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902e818d7d70457b93827ef5cf71cdaf" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.643579 30274 raft_consensus.cc:2468] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:32.643123 30474 tablet_bootstrap.cc:492] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:32.645009 30471 tablet_bootstrap.cc:654] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.644939 30317 leader_election.cc:304] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.645952 30504 raft_consensus.cc:2804] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.646325 30504 raft_consensus.cc:493] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.646643 30504 raft_consensus.cc:3060] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.648851 30472 tablet_bootstrap.cc:654] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.649658 30543 raft_consensus.cc:493] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.650143 30543 raft_consensus.cc:515] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.650632 30473 tablet_bootstrap.cc:654] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.652295 30543 leader_election.cc:290] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:32.654807 30474 tablet_bootstrap.cc:654] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.644179 30097 catalog_manager.cc:5697] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:32.664645 30472 tablet_bootstrap.cc:492] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:32.669927 30472 ts_tablet_manager.cc:1403] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.000s
I20260709 12:19:32.667258 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.670818 30274 raft_consensus.cc:2468] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:32.667905 30571 leader_election.cc:290] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:32.679718 30583 consensus_queue.cc:1048] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.673617 30577 raft_consensus.cc:493] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.682943 30577 raft_consensus.cc:515] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.685243 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:32.685648 30577 leader_election.cc:290] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:32.685945 30350 raft_consensus.cc:2468] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:32.686933 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:32.687835 30347 raft_consensus.cc:2468] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:32.689356 30472 raft_consensus.cc:359] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.692569 30472 raft_consensus.cc:385] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.692876 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:32.693053 30472 raft_consensus.cc:740] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.693712 30426 raft_consensus.cc:2468] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:32.694327 30472 consensus_queue.cc:260] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.690210 30167 leader_election.cc:304] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:32.694906 30583 consensus_queue.cc:1048] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.695986 30559 consensus_queue.cc:1048] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:32.691529 30504 raft_consensus.cc:515] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.704005 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902e818d7d70457b93827ef5cf71cdaf" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:32.704650 30275 raft_consensus.cc:3060] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.697459 30471 tablet_bootstrap.cc:492] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:32.706180 30471 ts_tablet_manager.cc:1403] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.069s	user 0.008s	sys 0.012s
I20260709 12:19:32.704573 30472 ts_tablet_manager.cc:1434] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:19:32.710191 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902e818d7d70457b93827ef5cf71cdaf" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
W20260709 12:19:32.711634 30315 leader_election.cc:343] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.712504 30504 leader_election.cc:290] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:32.712244 30471 raft_consensus.cc:359] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.713357 30471 raft_consensus.cc:385] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.713762 30471 raft_consensus.cc:740] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.715934 30472 tablet_bootstrap.cc:492] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:32.724699 30167 leader_election.cc:304] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:32.725256 30471 consensus_queue.cc:260] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.725925 30099 catalog_manager.cc:5697] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:32.727183 30604 raft_consensus.cc:2804] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.727588 30604 raft_consensus.cc:493] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.727905 30604 raft_consensus.cc:3060] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.731485 30472 tablet_bootstrap.cc:654] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.732189 30545 raft_consensus.cc:2804] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.732625 30545 raft_consensus.cc:493] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.732969 30545 raft_consensus.cc:3060] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.747596 30471 ts_tablet_manager.cc:1434] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:19:32.759766 30474 tablet_bootstrap.cc:492] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:32.760236 30473 tablet_bootstrap.cc:492] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:32.760330 30474 ts_tablet_manager.cc:1403] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.117s	user 0.046s	sys 0.036s
I20260709 12:19:32.760812 30473 ts_tablet_manager.cc:1403] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.133s	user 0.017s	sys 0.014s
I20260709 12:19:32.763463 30474 raft_consensus.cc:359] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.763720 30473 raft_consensus.cc:359] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.764281 30474 raft_consensus.cc:385] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.764410 30473 raft_consensus.cc:385] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.764663 30474 raft_consensus.cc:740] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.764770 30473 raft_consensus.cc:740] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.765453 30474 consensus_queue.cc:260] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.765538 30473 consensus_queue.cc:260] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.768025 30474 ts_tablet_manager.cc:1434] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:32.768447 30473 ts_tablet_manager.cc:1434] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:19:32.769300 30474 tablet_bootstrap.cc:492] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:32.769606 30473 tablet_bootstrap.cc:492] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:32.778594 30474 tablet_bootstrap.cc:654] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.782631 30471 tablet_bootstrap.cc:492] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:32.782701 30473 tablet_bootstrap.cc:654] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.788750 30472 tablet_bootstrap.cc:492] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:32.789297 30472 ts_tablet_manager.cc:1403] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.074s	user 0.026s	sys 0.014s
I20260709 12:19:32.789024 30101 catalog_manager.cc:5697] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:32.747924 30583 consensus_queue.cc:1048] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 12:19:32.816174 30545 raft_consensus.cc:515] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:32.815976 30604 raft_consensus.cc:515] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.834064 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:32.834744 30347 raft_consensus.cc:3060] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.823155 30275 raft_consensus.cc:2468] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:32.844944 30473 tablet_bootstrap.cc:492] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:32.845626 30473 ts_tablet_manager.cc:1403] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.004s
I20260709 12:19:32.846338 30604 leader_election.cc:290] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:32.846653 30317 leader_election.cc:304] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.847704 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:32.847875 30672 raft_consensus.cc:2804] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.848454 30672 raft_consensus.cc:697] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:32.849247 30672 consensus_queue.cc:237] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.838446 30472 raft_consensus.cc:359] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.854986 30472 raft_consensus.cc:385] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.854451 30471 tablet_bootstrap.cc:654] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.855433 30472 raft_consensus.cc:740] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.857077 30472 consensus_queue.cc:260] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.854480 30275 raft_consensus.cc:3060] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.859498 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:32.860105 30426 raft_consensus.cc:3060] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.864117 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:32.864704 30350 raft_consensus.cc:3060] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.856141 30473 raft_consensus.cc:359] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.870915 30473 raft_consensus.cc:385] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.871248 30473 raft_consensus.cc:740] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.872378 30473 consensus_queue.cc:260] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.875032 30275 raft_consensus.cc:2468] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:32.876259 30168 leader_election.cc:304] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:32.877099 30482 raft_consensus.cc:2804] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.877224 30672 raft_consensus.cc:493] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.877617 30482 raft_consensus.cc:697] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:32.877738 30672 raft_consensus.cc:515] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.878486 30482 consensus_queue.cc:237] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.853857 30545 leader_election.cc:290] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:32.882112 30473 ts_tablet_manager.cc:1434] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.002s
I20260709 12:19:32.884016 30472 ts_tablet_manager.cc:1434] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.002s
I20260709 12:19:32.882604 30672 leader_election.cc:290] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:32.887583 30473 tablet_bootstrap.cc:492] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:32.890944 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e383c3fc4184c4ba49ba4d78433d661" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.891005 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e383c3fc4184c4ba49ba4d78433d661" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:32.891693 30481 raft_consensus.cc:493] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.891968 30201 raft_consensus.cc:2468] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:32.892179 30481 raft_consensus.cc:515] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.887007 30583 raft_consensus.cc:493] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.893311 30583 raft_consensus.cc:515] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.894410 30481 leader_election.cc:290] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:32.895133 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44d3048f1f74e7481b0772d32316b86" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:32.895347 30583 leader_election.cc:290] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:32.895160 30318 leader_election.cc:304] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:32.899605 30347 raft_consensus.cc:2468] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:32.899739 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:32.900053 30672 raft_consensus.cc:2804] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.900409 30201 raft_consensus.cc:2468] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:32.900528 30672 raft_consensus.cc:493] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.901032 30472 tablet_bootstrap.cc:492] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:32.901000 30672 raft_consensus.cc:3060] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.901512 30167 leader_election.cc:304] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:32.901515 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:32.902388 30604 raft_consensus.cc:2804] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.902845 30604 raft_consensus.cc:697] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:32.903494 30244 leader_election.cc:304] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:32.903690 30604 consensus_queue.cc:237] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:32.905225 30241 leader_election.cc:343] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.900420 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e44d3048f1f74e7481b0772d32316b86" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.906699 30350 raft_consensus.cc:2468] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:32.909382 30579 raft_consensus.cc:2804] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:32.914506 30579 raft_consensus.cc:493] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:32.914935 30579 raft_consensus.cc:3060] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:32.910907 30317 leader_election.cc:343] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.912452 30472 tablet_bootstrap.cc:654] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.920107 30563 raft_consensus.cc:493] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.920519 30426 raft_consensus.cc:2468] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:32.920635 30563 raft_consensus.cc:515] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.925796 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902e818d7d70457b93827ef5cf71cdaf" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.926640 30277 raft_consensus.cc:2393] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:32.928109 30563 leader_election.cc:290] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:32.929315 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902e818d7d70457b93827ef5cf71cdaf" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:32.930812 30390 leader_election.cc:304] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:32.897989 30202 raft_consensus.cc:2393] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:32.932771 30563 raft_consensus.cc:3060] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.937995 30583 consensus_queue.cc:1048] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:32.942404 30473 tablet_bootstrap.cc:654] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.945981 30579 raft_consensus.cc:515] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:32.948596 30472 tablet_bootstrap.cc:492] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:32.948815 30392 leader_election.cc:304] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:32.949157 30472 ts_tablet_manager.cc:1403] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.005s
I20260709 12:19:32.950065 30481 raft_consensus.cc:3060] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.955067 30474 tablet_bootstrap.cc:492] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:32.955646 30474 ts_tablet_manager.cc:1403] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.187s	user 0.008s	sys 0.005s
I20260709 12:19:32.955667 30672 raft_consensus.cc:515] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.959777 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:32.949167 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:32.960399 30201 raft_consensus.cc:3060] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.960726 30579 leader_election.cc:290] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:32.962215 30474 raft_consensus.cc:359] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.962914 30474 raft_consensus.cc:385] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.963186 30474 raft_consensus.cc:740] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.963914 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e383c3fc4184c4ba49ba4d78433d661" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:32.964407 30200 raft_consensus.cc:3060] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.967334 30481 raft_consensus.cc:2749] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.968294 30571 raft_consensus.cc:493] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.945923 30563 raft_consensus.cc:2749] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.968776 30201 raft_consensus.cc:2468] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:32.968791 30571 raft_consensus.cc:515] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:32.974885 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e383c3fc4184c4ba49ba4d78433d661" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:32.973588 30672 leader_election.cc:290] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:32.979091 30571 leader_election.cc:290] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:32.970758 30200 raft_consensus.cc:2468] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:32.980191 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:32.981067 30472 raft_consensus.cc:359] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.981817 30472 raft_consensus.cc:385] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:32.981777 30318 leader_election.cc:304] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:32.982404 30472 raft_consensus.cc:740] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:32.982890 30571 raft_consensus.cc:2804] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.983409 30571 raft_consensus.cc:697] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:32.983776 30472 consensus_queue.cc:260] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.984254 30571 consensus_queue.cc:237] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:32.986263 30472 ts_tablet_manager.cc:1434] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.037s	user 0.003s	sys 0.002s
I20260709 12:19:32.987510 30472 tablet_bootstrap.cc:492] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:32.963888 30474 consensus_queue.cc:260] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:32.976956 30241 leader_election.cc:343] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.991151 30474 ts_tablet_manager.cc:1434] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:19:32.988878 30579 raft_consensus.cc:493] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:32.992131 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:32.992810 30579 raft_consensus.cc:515] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:32.993410 30317 leader_election.cc:343] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:32.973060 30473 tablet_bootstrap.cc:492] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:32.994597 30473 ts_tablet_manager.cc:1403] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.001s
I20260709 12:19:32.994539 30317 leader_election.cc:304] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:32.995411 30278 raft_consensus.cc:3060] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:32.996060 30504 raft_consensus.cc:2749] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:32.991411 30244 leader_election.cc:304] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:32.998358 30583 raft_consensus.cc:2804] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:32.997637 30473 raft_consensus.cc:359] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.000011 30473 raft_consensus.cc:385] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.000382 30473 raft_consensus.cc:740] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.001922 30473 consensus_queue.cc:260] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.003299 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d78f4a893e8471a8324169a33739e06" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:33.004176 30473 ts_tablet_manager.cc:1434] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:19:33.000777 30583 raft_consensus.cc:697] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:33.005208 30672 consensus_queue.cc:1048] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.005412 30583 consensus_queue.cc:237] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.001943 30474 tablet_bootstrap.cc:492] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:33.005357 30473 tablet_bootstrap.cc:492] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:33.009697 30472 tablet_bootstrap.cc:654] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:32.999457 30604 raft_consensus.cc:493] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.018216 30471 tablet_bootstrap.cc:492] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:33.018790 30471 ts_tablet_manager.cc:1403] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.238s	user 0.011s	sys 0.004s
I20260709 12:19:33.021538 30471 raft_consensus.cc:359] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.022192 30471 raft_consensus.cc:385] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.022485 30471 raft_consensus.cc:740] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.024209 30604 raft_consensus.cc:515] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.024626 30347 raft_consensus.cc:3060] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.026485 30604 leader_election.cc:290] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:33.023234 30471 consensus_queue.cc:260] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.006173 30579 leader_election.cc:290] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:33.031404 30471 ts_tablet_manager.cc:1434] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 12:19:33.027124 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:33.032871 30277 raft_consensus.cc:2468] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:33.033871 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:33.034260 30168 leader_election.cc:304] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:33.034559 30350 raft_consensus.cc:2468] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:33.035344 30604 raft_consensus.cc:2804] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:33.035718 30604 raft_consensus.cc:493] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.036043 30604 raft_consensus.cc:3060] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.042793 30672 consensus_queue.cc:1048] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:33.028439 30390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 46269.5us
I20260709 12:19:33.049530 30100 catalog_manager.cc:5697] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:33.056658 30149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:33.052054 30100 catalog_manager.cc:5697] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:33.057128 30688 consensus_queue.cc:1048] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:19:33.071312 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d78f4a893e8471a8324169a33739e06" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:33.079954 30672 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.080551 30672 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.080901 30545 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.081387 30545 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.083969 30545 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:33.084813 30471 tablet_bootstrap.cc:492] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:33.085783 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:33.086103 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:33.086829 30350 raft_consensus.cc:2468] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
W20260709 12:19:33.087225 30166 leader_election.cc:343] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.088402 30167 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:33.089979 30604 raft_consensus.cc:515] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.091562 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:33.092623 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:33.090116 30672 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:33.094897 30545 raft_consensus.cc:2804] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:33.098215 30583 raft_consensus.cc:493] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.110845 30241 leader_election.cc:304] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
W20260709 12:19:33.098022 30315 leader_election.cc:343] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.112637 30203 raft_consensus.cc:2468] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:33.114403 30583 raft_consensus.cc:515] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.116044 30604 leader_election.cc:290] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:33.119473 30579 raft_consensus.cc:2749] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.121169 30474 tablet_bootstrap.cc:654] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.123345 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:33.124181 30350 raft_consensus.cc:3060] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.118347 30545 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.106464 30621 consensus_queue.cc:1048] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:19:33.134497 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:33.135130 30274 raft_consensus.cc:3060] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.136859 30583 leader_election.cc:290] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:33.132661 30545 raft_consensus.cc:3060] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.141274 30318 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659
W20260709 12:19:33.148993 30690 log.cc:927] Time spent T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:19:33.143244 30672 raft_consensus.cc:2804] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:33.149690 30672 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.150043 30672 raft_consensus.cc:3060] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.143208 30482 raft_consensus.cc:493] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.155965 30472 tablet_bootstrap.cc:492] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:33.158644 30471 tablet_bootstrap.cc:654] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.158833 30472 ts_tablet_manager.cc:1403] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.172s	user 0.017s	sys 0.000s
I20260709 12:19:33.156315 30482 raft_consensus.cc:515] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.159686 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89955984673a4c1a984a5c1c5569ebe7" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:33.160914 30473 tablet_bootstrap.cc:654] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.161075 30203 raft_consensus.cc:2468] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:33.172953 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89955984673a4c1a984a5c1c5569ebe7" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:33.166181 30688 consensus_queue.cc:1048] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:19:33.162227 30482 leader_election.cc:290] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:33.181582 30244 leader_election.cc:304] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:33.182559 30583 raft_consensus.cc:2804] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:33.182938 30583 raft_consensus.cc:493] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.186518 30583 raft_consensus.cc:3060] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.189960 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89955984673a4c1a984a5c1c5569ebe7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:33.172364 30099 catalog_manager.cc:5697] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.203886 30472 raft_consensus.cc:359] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.205461 30472 raft_consensus.cc:385] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.206871 30472 raft_consensus.cc:740] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.207530 30472 consensus_queue.cc:260] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.197542 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89955984673a4c1a984a5c1c5569ebe7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:33.223856 30350 raft_consensus.cc:2468] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
W20260709 12:19:33.227522 30167 leader_election.cc:343] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:33.228389 30242 leader_election.cc:343] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.232409 30472 ts_tablet_manager.cc:1434] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 12:19:33.245240 30672 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.250962 30583 raft_consensus.cc:515] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.252877 30277 raft_consensus.cc:2393] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 777b1410f165436aa725262b964ff0a6 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:33.254045 30583 leader_election.cc:290] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:33.254997 30167 leader_election.cc:304] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:33.250806 30100 catalog_manager.cc:5697] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:33.257858 30696 log.cc:927] Time spent T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:19:33.260685 30482 raft_consensus.cc:2804] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:33.265966 30472 tablet_bootstrap.cc:492] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:33.270642 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89955984673a4c1a984a5c1c5569ebe7" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:33.270695 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:33.272750 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:33.273799 30168 leader_election.cc:304] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:33.275426 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89955984673a4c1a984a5c1c5569ebe7" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:33.275935 30473 tablet_bootstrap.cc:492] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:33.267586 30545 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.288713 30471 tablet_bootstrap.cc:492] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:33.301975 30473 ts_tablet_manager.cc:1403] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.297s	user 0.017s	sys 0.005s
I20260709 12:19:33.302300 30471 ts_tablet_manager.cc:1403] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.232s	user 0.021s	sys 0.004s
I20260709 12:19:33.294888 30474 tablet_bootstrap.cc:492] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:33.303341 30474 ts_tablet_manager.cc:1403] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.302s	user 0.018s	sys 0.013s
W20260709 12:19:33.308346 30167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 46055.6us
I20260709 12:19:33.278856 30672 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
W20260709 12:19:33.282522 30315 leader_election.cc:343] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.281203 30201 raft_consensus.cc:3060] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:33.292816 30242 leader_election.cc:343] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.284343 30274 raft_consensus.cc:2468] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:33.324247 30203 raft_consensus.cc:2393] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:33.321394 30482 raft_consensus.cc:697] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
W20260709 12:19:33.330403 30698 log.cc:927] Time spent T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:19:33.340560 30482 consensus_queue.cc:237] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.343276 30474 raft_consensus.cc:359] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.343989 30474 raft_consensus.cc:385] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.344343 30474 raft_consensus.cc:740] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.345033 30474 consensus_queue.cc:260] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.344977 30471 raft_consensus.cc:359] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.346822 30471 raft_consensus.cc:385] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.348351 30471 raft_consensus.cc:740] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.347548 30318 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:33.351511 30699 raft_consensus.cc:2749] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.351739 30472 tablet_bootstrap.cc:654] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.350483 30473 raft_consensus.cc:359] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.355228 30473 raft_consensus.cc:385] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.355556 30473 raft_consensus.cc:740] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.356382 30473 consensus_queue.cc:260] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.349090 30201 raft_consensus.cc:2468] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:33.358156 30604 raft_consensus.cc:2749] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.359094 30244 leader_election.cc:304] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:33.360023 30473 ts_tablet_manager.cc:1434] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.001s
I20260709 12:19:33.335024 30672 consensus_queue.cc:1048] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:19:33.361019 30583 raft_consensus.cc:2804] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:33.361727 30583 raft_consensus.cc:697] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:33.363032 30583 consensus_queue.cc:237] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.366631 30474 ts_tablet_manager.cc:1434] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 12:19:33.367622 30545 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:33.367774 30474 tablet_bootstrap.cc:492] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:33.376986 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:33.367832 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:33.380931 30604 consensus_queue.cc:1048] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.381814 30347 raft_consensus.cc:2393] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 777b1410f165436aa725262b964ff0a6 in current term 1: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:33.361150 30473 tablet_bootstrap.cc:492] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:33.386756 30471 consensus_queue.cc:260] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.395849 30100 catalog_manager.cc:5697] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:33.403218 30563 raft_consensus.cc:493] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.403723 30563 raft_consensus.cc:515] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.404336 30699 raft_consensus.cc:493] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.404794 30699 raft_consensus.cc:515] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.405745 30563 leader_election.cc:290] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:33.406905 30699 leader_election.cc:290] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
W20260709 12:19:33.398434 30166 leader_election.cc:343] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.411629 30277 raft_consensus.cc:3060] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.410475 30166 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:33.415568 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f971b17bc9742d38fdccaea1020084a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:33.414647 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f971b17bc9742d38fdccaea1020084a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:33.416648 30201 raft_consensus.cc:2468] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:33.417223 30604 raft_consensus.cc:2749] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:19:33.418397 30391 leader_election.cc:343] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.419916 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:33.421305 30392 leader_election.cc:304] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:33.423740 30563 raft_consensus.cc:2804] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:33.424130 30563 raft_consensus.cc:493] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.424484 30563 raft_consensus.cc:3060] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.425314 30604 consensus_queue.cc:1048] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:33.427129 30315 leader_election.cc:343] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.430804 30474 tablet_bootstrap.cc:654] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.431826 30471 ts_tablet_manager.cc:1434] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.129s	user 0.008s	sys 0.000s
I20260709 12:19:33.415647 30473 tablet_bootstrap.cc:654] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.441248 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:33.443465 30472 tablet_bootstrap.cc:492] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:33.444036 30472 ts_tablet_manager.cc:1403] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.183s	user 0.021s	sys 0.022s
I20260709 12:19:33.446293 30099 catalog_manager.cc:5697] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.449575 30472 raft_consensus.cc:359] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.450876 30472 raft_consensus.cc:385] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.451309 30472 raft_consensus.cc:740] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.453962 30472 consensus_queue.cc:260] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:33.452692 30317 leader_election.cc:343] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.449263 30614 raft_consensus.cc:493] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.453037 30100 catalog_manager.cc:5697] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.466432 30621 consensus_queue.cc:1048] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.467466 30563 raft_consensus.cc:515] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.471433 30471 tablet_bootstrap.cc:492] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:33.473917 30614 raft_consensus.cc:515] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.480264 30614 leader_election.cc:290] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:33.481766 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f971b17bc9742d38fdccaea1020084a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:33.481925 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:33.482481 30200 raft_consensus.cc:3060] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.483064 30201 raft_consensus.cc:2393] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:33.481782 30426 raft_consensus.cc:3060] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.475658 30317 leader_election.cc:304] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:33.488153 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:33.490631 30672 raft_consensus.cc:2749] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.493762 30200 raft_consensus.cc:2468] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:33.494462 30392 leader_election.cc:304] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:33.496523 30672 consensus_queue.cc:1048] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.499814 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f971b17bc9742d38fdccaea1020084a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
W20260709 12:19:33.511490 30391 leader_election.cc:343] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.512028 30392 leader_election.cc:304] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:33.512955 30689 raft_consensus.cc:2749] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.513033 30614 raft_consensus.cc:2804] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:33.513620 30614 raft_consensus.cc:697] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:33.514482 30614 consensus_queue.cc:237] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.500263 30563 leader_election.cc:290] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:33.508844 30699 consensus_queue.cc:1048] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.521418 30472 ts_tablet_manager.cc:1434] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.004s
I20260709 12:19:33.524832 30472 tablet_bootstrap.cc:492] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:33.530939 30699 consensus_queue.cc:1048] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.544448 30545 consensus_queue.cc:1048] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.546404 30474 tablet_bootstrap.cc:492] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:33.546906 30474 ts_tablet_manager.cc:1403] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.179s	user 0.018s	sys 0.038s
I20260709 12:19:33.551388 30471 tablet_bootstrap.cc:654] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.568801 30615 consensus_queue.cc:1048] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:33.569303 30474 raft_consensus.cc:359] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.570081 30474 raft_consensus.cc:385] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.570379 30474 raft_consensus.cc:740] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.571070 30474 consensus_queue.cc:260] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.573484 30474 ts_tablet_manager.cc:1434] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:19:33.586843 30474 tablet_bootstrap.cc:492] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:33.607882 30563 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.608541 30563 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.611127 30705 consensus_queue.cc:1048] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.612190 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:33.614014 30392 leader_election.cc:343] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.626617 30474 tablet_bootstrap.cc:654] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.617621 30563 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:33.638525 30473 tablet_bootstrap.cc:492] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:33.639065 30473 ts_tablet_manager.cc:1403] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.278s	user 0.012s	sys 0.007s
I20260709 12:19:33.641868 30473 raft_consensus.cc:359] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.643811 30473 raft_consensus.cc:385] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.644074 30473 raft_consensus.cc:740] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.644726 30473 consensus_queue.cc:260] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.647025 30473 ts_tablet_manager.cc:1434] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:19:33.647214 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:33.648066 30473 tablet_bootstrap.cc:492] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
W20260709 12:19:33.648710 30390 leader_election.cc:343] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.649490 30472 tablet_bootstrap.cc:654] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.649389 30390 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:33.650471 30563 raft_consensus.cc:2749] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.662012 30471 tablet_bootstrap.cc:492] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:33.662576 30471 ts_tablet_manager.cc:1403] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.203s	user 0.022s	sys 0.007s
I20260709 12:19:33.671952 30471 raft_consensus.cc:359] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.672655 30471 raft_consensus.cc:385] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.672840 30471 raft_consensus.cc:740] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.677043 30473 tablet_bootstrap.cc:654] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.681092 30471 consensus_queue.cc:260] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.709858 30471 ts_tablet_manager.cc:1434] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:19:33.711237 30471 tablet_bootstrap.cc:492] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
W20260709 12:19:33.689779 30241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 52711.2us
I20260709 12:19:33.717199 30615 raft_consensus.cc:493] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.717999 30615 raft_consensus.cc:515] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.720988 30100 catalog_manager.cc:5697] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.721729 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f971b17bc9742d38fdccaea1020084a" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:33.722502 30201 raft_consensus.cc:2393] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f03b88e02d9c4039964e2ab17a35bf52 in current term 1: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
I20260709 12:19:33.723428 30615 leader_election.cc:290] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:33.726197 30473 tablet_bootstrap.cc:492] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:33.726691 30473 ts_tablet_manager.cc:1403] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.079s	user 0.024s	sys 0.019s
I20260709 12:19:33.729501 30473 raft_consensus.cc:359] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.730157 30473 raft_consensus.cc:385] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.730438 30473 raft_consensus.cc:740] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.731108 30473 consensus_queue.cc:260] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.736545 30471 tablet_bootstrap.cc:654] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.737277 30473 ts_tablet_manager.cc:1434] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:33.737658 30474 tablet_bootstrap.cc:492] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:33.738193 30472 tablet_bootstrap.cc:492] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:33.745862 30474 ts_tablet_manager.cc:1403] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.004s
I20260709 12:19:33.746429 30473 tablet_bootstrap.cc:492] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:33.744730 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f971b17bc9742d38fdccaea1020084a" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:33.745952 30472 ts_tablet_manager.cc:1403] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.221s	user 0.023s	sys 0.025s
I20260709 12:19:33.748548 30474 raft_consensus.cc:359] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.749202 30474 raft_consensus.cc:385] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.749449 30474 raft_consensus.cc:740] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.750178 30474 consensus_queue.cc:260] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.751844 30472 raft_consensus.cc:359] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.755659 30472 raft_consensus.cc:385] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.755985 30472 raft_consensus.cc:740] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.756780 30472 consensus_queue.cc:260] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.759189 30472 ts_tablet_manager.cc:1434] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:19:33.763048 30474 ts_tablet_manager.cc:1434] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:19:33.764110 30474 tablet_bootstrap.cc:492] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:33.764549 30241 leader_election.cc:304] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:33.765388 30615 raft_consensus.cc:3060] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.768729 30472 tablet_bootstrap.cc:492] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:33.769989 30474 tablet_bootstrap.cc:654] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.774531 30471 tablet_bootstrap.cc:492] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:33.775022 30471 ts_tablet_manager.cc:1403] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.003s
I20260709 12:19:33.775211 30472 tablet_bootstrap.cc:654] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.777650 30471 raft_consensus.cc:359] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.778381 30471 raft_consensus.cc:385] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.778630 30471 raft_consensus.cc:740] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.779279 30471 consensus_queue.cc:260] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.785948 30471 ts_tablet_manager.cc:1434] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:33.787119 30471 tablet_bootstrap.cc:492] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:33.785876 30615 raft_consensus.cc:2749] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.792402 30563 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.792944 30563 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.794760 30689 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.795416 30689 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.797516 30689 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:33.798137 30474 tablet_bootstrap.cc:492] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:33.798220 30473 tablet_bootstrap.cc:654] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.798707 30474 ts_tablet_manager.cc:1403] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.000s
I20260709 12:19:33.801097 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:33.801913 30201 raft_consensus.cc:2393] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:33.801755 30474 raft_consensus.cc:359] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.802449 30474 raft_consensus.cc:385] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.802742 30474 raft_consensus.cc:740] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.803781 30471 tablet_bootstrap.cc:654] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.804615 30563 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:33.806164 30474 consensus_queue.cc:260] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.806699 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:33.807766 30201 raft_consensus.cc:2393] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:33.810984 30474 ts_tablet_manager.cc:1434] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:19:33.817935 30474 tablet_bootstrap.cc:492] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:33.823834 30472 tablet_bootstrap.cc:492] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:33.824417 30472 ts_tablet_manager.cc:1403] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.005s
I20260709 12:19:33.826300 30474 tablet_bootstrap.cc:654] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.826625 30471 tablet_bootstrap.cc:492] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:33.827171 30471 ts_tablet_manager.cc:1403] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.002s
I20260709 12:19:33.827201 30472 raft_consensus.cc:359] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.828181 30472 raft_consensus.cc:385] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.828451 30472 raft_consensus.cc:740] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.831223 30471 raft_consensus.cc:359] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.832518 30471 raft_consensus.cc:385] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.832912 30471 raft_consensus.cc:740] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.833719 30471 consensus_queue.cc:260] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.836089 30471 ts_tablet_manager.cc:1434] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:33.837577 30471 tablet_bootstrap.cc:492] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:33.839421 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:33.840312 30347 raft_consensus.cc:2393] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:33.829262 30472 consensus_queue.cc:260] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.842238 30472 ts_tablet_manager.cc:1434] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:19:33.842995 30474 tablet_bootstrap.cc:492] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:33.843256 30472 tablet_bootstrap.cc:492] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:33.843539 30474 ts_tablet_manager.cc:1403] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 12:19:33.844046 30471 tablet_bootstrap.cc:654] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.846941 30474 raft_consensus.cc:359] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.848278 30474 raft_consensus.cc:385] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.848574 30474 raft_consensus.cc:740] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.849789 30474 consensus_queue.cc:260] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.850172 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:33.851297 30347 raft_consensus.cc:2393] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:33.852002 30474 ts_tablet_manager.cc:1434] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:19:33.856139 30471 tablet_bootstrap.cc:492] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:33.856736 30471 ts_tablet_manager.cc:1403] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:19:33.859553 30471 raft_consensus.cc:359] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.860496 30471 raft_consensus.cc:385] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.860890 30471 raft_consensus.cc:740] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.859649 30390 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:33.861867 30471 consensus_queue.cc:260] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.863346 30563 raft_consensus.cc:3060] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.863951 30390 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:33.864827 30689 raft_consensus.cc:3060] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.865272 30472 tablet_bootstrap.cc:654] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.870831 30563 raft_consensus.cc:2749] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.874684 30504 raft_consensus.cc:493] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.872275 30730 consensus_queue.cc:1048] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:33.875221 30504 raft_consensus.cc:515] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.872251 30689 raft_consensus.cc:2749] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.877405 30504 leader_election.cc:290] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:33.879210 30474 tablet_bootstrap.cc:492] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:33.879972 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9b5ed70fdf49c0bf254214d8ca297c" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:33.880378 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9b5ed70fdf49c0bf254214d8ca297c" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:33.881484 30315 leader_election.cc:343] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:33.882540 30318 leader_election.cc:343] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.883140 30318 leader_election.cc:304] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:33.883579 30471 ts_tablet_manager.cc:1434] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 12:19:33.884697 30471 tablet_bootstrap.cc:492] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:33.890192 30474 tablet_bootstrap.cc:654] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.892516 30504 raft_consensus.cc:2749] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.898816 30471 tablet_bootstrap.cc:654] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.900084 30545 consensus_queue.cc:1048] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:33.901762 30504 raft_consensus.cc:493] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.902179 30473 tablet_bootstrap.cc:492] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:33.902669 30473 ts_tablet_manager.cc:1403] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.157s	user 0.031s	sys 0.029s
I20260709 12:19:33.902509 30504 raft_consensus.cc:515] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.905519 30473 raft_consensus.cc:359] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.906320 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89955984673a4c1a984a5c1c5569ebe7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:33.906662 30473 raft_consensus.cc:385] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.907071 30473 raft_consensus.cc:740] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.907857 30473 consensus_queue.cc:260] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.909243 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89955984673a4c1a984a5c1c5569ebe7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:33.910746 30317 leader_election.cc:304] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:33.911590 30699 raft_consensus.cc:2749] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.912585 30504 leader_election.cc:290] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:33.912842 30482 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.913326 30482 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.913865 30705 consensus_queue.cc:1048] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:33.915733 30482 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:33.916970 30347 raft_consensus.cc:3060] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.917623 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:33.918267 30426 raft_consensus.cc:2468] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:33.919930 30166 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:33.923429 30730 raft_consensus.cc:493] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.923965 30730 raft_consensus.cc:515] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.926227 30730 leader_election.cc:290] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:33.927121 30545 raft_consensus.cc:2804] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:33.927742 30545 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.928239 30545 raft_consensus.cc:3060] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.935179 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:33.935896 30348 raft_consensus.cc:2468] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:33.937536 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4333c8ec1cd04d1d8ec97b1f5a79f8a5" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:33.938215 30474 tablet_bootstrap.cc:492] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:33.938742 30474 ts_tablet_manager.cc:1403] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.060s	user 0.007s	sys 0.005s
I20260709 12:19:33.941385 30474 raft_consensus.cc:359] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.942016 30474 raft_consensus.cc:385] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.942333 30474 raft_consensus.cc:740] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.943032 30730 raft_consensus.cc:493] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.943102 30474 consensus_queue.cc:260] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:33.943742 30730 raft_consensus.cc:515] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:33.944483 30473 ts_tablet_manager.cc:1434] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:19:33.945489 30474 ts_tablet_manager.cc:1434] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:33.945803 30730 leader_election.cc:290] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:33.945910 30473 tablet_bootstrap.cc:492] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:33.946480 30474 tablet_bootstrap.cc:492] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:33.966830 30472 tablet_bootstrap.cc:492] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:33.967376 30472 ts_tablet_manager.cc:1403] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.006s
I20260709 12:19:33.969300 30472 raft_consensus.cc:359] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.969805 30474 tablet_bootstrap.cc:654] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.970204 30705 raft_consensus.cc:493] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:33.970697 30705 raft_consensus.cc:515] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:33.969813 30472 raft_consensus.cc:385] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.947738 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e1e509bcc54ae485169e45c1649db8" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:33.949218 30242 leader_election.cc:343] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.949910 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4333c8ec1cd04d1d8ec97b1f5a79f8a5" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:33.972808 30705 leader_election.cc:290] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:33.949998 30728 consensus_queue.cc:1048] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:33.951987 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e1e509bcc54ae485169e45c1649db8" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:33.973838 30424 raft_consensus.cc:2468] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:33.956775 30471 tablet_bootstrap.cc:492] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:33.974830 30471 ts_tablet_manager.cc:1403] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.090s	user 0.024s	sys 0.016s
W20260709 12:19:33.974813 30244 leader_election.cc:343] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.977602 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:33.977869 30471 raft_consensus.cc:359] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.978250 30274 raft_consensus.cc:2468] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:33.978605 30471 raft_consensus.cc:385] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:33.978940 30471 raft_consensus.cc:740] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:33.979686 30168 leader_election.cc:304] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:33.979607 30471 consensus_queue.cc:260] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.980559 30473 tablet_bootstrap.cc:654] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:33.981776 30471 ts_tablet_manager.cc:1434] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:33.972556 30472 raft_consensus.cc:740] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
W20260709 12:19:33.982759 30241 leader_election.cc:343] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:33.983229 30241 leader_election.cc:304] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:33.983429 30472 consensus_queue.cc:260] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.984441 30241 leader_election.cc:304] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:33.985378 30730 raft_consensus.cc:2749] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:33.985981 30730 raft_consensus.cc:2804] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:33.986333 30730 raft_consensus.cc:493] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.986644 30730 raft_consensus.cc:3060] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.959981 30545 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:33.988149 30707 raft_consensus.cc:2804] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:33.988551 30707 raft_consensus.cc:493] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:33.988888 30707 raft_consensus.cc:3060] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:33.991112 30545 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:33.991313 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:33.991953 30424 raft_consensus.cc:3060] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:33.992988 30472 ts_tablet_manager.cc:1434] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.002s
I20260709 12:19:33.993988 30472 tablet_bootstrap.cc:492] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:34.002563 30730 raft_consensus.cc:515] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.005189 30424 raft_consensus.cc:2468] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:34.007956 30730 leader_election.cc:290] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:34.008816 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e1e509bcc54ae485169e45c1649db8" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:34.009419 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:34.009545 30424 raft_consensus.cc:3060] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.010035 30351 raft_consensus.cc:3060] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:34.010252 30473 tablet_bootstrap.cc:492] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:34.010759 30473 ts_tablet_manager.cc:1403] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.065s	user 0.006s	sys 0.008s
I20260709 12:19:34.008740 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.016367 30689 raft_consensus.cc:493] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:34.021698 30167 leader_election.cc:343] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.017627 30689 raft_consensus.cc:515] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.022688 30504 raft_consensus.cc:493] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.021342 30474 tablet_bootstrap.cc:492] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:34.023608 30504 raft_consensus.cc:515] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.024222 30474 ts_tablet_manager.cc:1403] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.078s	user 0.011s	sys 0.011s
I20260709 12:19:34.025243 30689 leader_election.cc:290] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:34.025966 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9b5ed70fdf49c0bf254214d8ca297c" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:34.027613 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9b5ed70fdf49c0bf254214d8ca297c" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.028237 30350 raft_consensus.cc:2468] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:34.028357 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:34.029033 30166 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:34.029240 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e1e509bcc54ae485169e45c1649db8" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:34.029194 30473 raft_consensus.cc:359] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.030341 30473 raft_consensus.cc:385] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.030625 30473 raft_consensus.cc:740] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.034878 30482 raft_consensus.cc:2804] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:34.035571 30482 raft_consensus.cc:697] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
W20260709 12:19:34.035845 30315 leader_election.cc:343] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.037684 30471 tablet_bootstrap.cc:492] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:34.041265 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:34.043812 30473 consensus_queue.cc:260] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.044782 30200 raft_consensus.cc:3060] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.035521 30504 leader_election.cc:290] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:34.044135 30390 leader_election.cc:304] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
W20260709 12:19:34.051286 30318 leader_election.cc:343] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.051788 30318 leader_election.cc:304] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:34.036854 30482 consensus_queue.cc:237] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:34.053164 30392 leader_election.cc:343] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.059541 30672 raft_consensus.cc:2749] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:34.064769 30689 raft_consensus.cc:2804] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.065279 30689 raft_consensus.cc:493] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.065637 30689 raft_consensus.cc:3060] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.050401 30351 raft_consensus.cc:2468] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:34.074936 30563 consensus_queue.cc:1048] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:34.078223 30424 raft_consensus.cc:2468] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:34.080482 30241 leader_election.cc:304] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:34.081992 30728 raft_consensus.cc:2804] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.082496 30728 raft_consensus.cc:697] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:34.083323 30728 consensus_queue.cc:237] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.086740 30472 tablet_bootstrap.cc:654] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.090489 30707 raft_consensus.cc:515] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.091719 30200 raft_consensus.cc:2468] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
W20260709 12:19:34.096318 30166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 67374.7us
I20260709 12:19:34.096369 30474 raft_consensus.cc:359] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.103637 30474 raft_consensus.cc:385] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.103962 30474 raft_consensus.cc:740] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.108182 30473 ts_tablet_manager.cc:1434] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.001s
I20260709 12:19:34.109201 30473 tablet_bootstrap.cc:492] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:34.114785 30705 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.114975 30474 consensus_queue.cc:260] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.115329 30705 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.117347 30705 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.117444 30474 ts_tablet_manager.cc:1434] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.093s	user 0.007s	sys 0.000s
I20260709 12:19:34.122380 30563 consensus_queue.cc:1048] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:34.124929 30707 leader_election.cc:290] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:34.127425 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.128329 30351 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:34.128845 30474 tablet_bootstrap.cc:492] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:34.139067 30474 tablet_bootstrap.cc:654] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.141171 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:34.141969 30274 raft_consensus.cc:3060] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.147157 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:34.151212 30749 log.cc:927] Time spent T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:19:34.152076 30149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:34.152108 30473 tablet_bootstrap.cc:654] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.148041 30426 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:34.152408 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:34.152681 30167 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:34.170948 30471 tablet_bootstrap.cc:654] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.188808 30750 raft_consensus.cc:2804] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.189405 30750 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.189831 30750 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.178445 30689 raft_consensus.cc:515] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.196143 30689 leader_election.cc:290] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:34.197548 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9b5ed70fdf49c0bf254214d8ca297c" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
W20260709 12:19:34.199524 30392 leader_election.cc:343] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.201143 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9b5ed70fdf49c0bf254214d8ca297c" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:34.201936 30351 raft_consensus.cc:3060] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.203276 30274 raft_consensus.cc:2468] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:34.204871 30168 leader_election.cc:304] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:34.206475 30705 raft_consensus.cc:2804] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.207144 30705 raft_consensus.cc:697] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:34.208266 30705 consensus_queue.cc:237] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.253623 30471 tablet_bootstrap.cc:492] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:34.254362 30471 ts_tablet_manager.cc:1403] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.251s	user 0.015s	sys 0.010s
W20260709 12:19:34.254912 30167 leader_election.cc:343] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.256829 30482 raft_consensus.cc:493] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:34.266499 30391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 54668.2us
I20260709 12:19:34.271138 30474 tablet_bootstrap.cc:492] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:34.271849 30474 ts_tablet_manager.cc:1403] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.149s	user 0.027s	sys 0.033s
I20260709 12:19:34.273000 30351 raft_consensus.cc:2468] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:34.261547 30482 raft_consensus.cc:515] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.287791 30474 raft_consensus.cc:359] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.288398 30474 raft_consensus.cc:385] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.288620 30474 raft_consensus.cc:740] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.289760 30472 tablet_bootstrap.cc:492] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:34.290202 30472 ts_tablet_manager.cc:1403] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.296s	user 0.018s	sys 0.003s
I20260709 12:19:34.294683 30474 consensus_queue.cc:260] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.286175 30390 leader_election.cc:304] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:34.297845 30689 raft_consensus.cc:2804] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.298372 30689 raft_consensus.cc:697] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:34.298884 30482 leader_election.cc:290] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:34.298894 30730 raft_consensus.cc:493] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.299177 30689 consensus_queue.cc:237] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.299675 30730 raft_consensus.cc:515] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.299746 30100 catalog_manager.cc:5697] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.304044 30472 raft_consensus.cc:359] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.304852 30472 raft_consensus.cc:385] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.305078 30472 raft_consensus.cc:740] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.305678 30472 consensus_queue.cc:260] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.308123 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:34.308560 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:34.309180 30201 raft_consensus.cc:2468] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:34.309334 30097 catalog_manager.cc:5697] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:34.310500 30244 leader_election.cc:304] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:34.311604 30728 raft_consensus.cc:2804] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.312037 30728 raft_consensus.cc:493] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.312368 30728 raft_consensus.cc:3060] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.310921 30471 raft_consensus.cc:359] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.312956 30471 raft_consensus.cc:385] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.313244 30471 raft_consensus.cc:740] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.313491 30473 tablet_bootstrap.cc:492] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
W20260709 12:19:34.312477 30166 leader_election.cc:343] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.313985 30473 ts_tablet_manager.cc:1403] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.205s	user 0.019s	sys 0.033s
I20260709 12:19:34.314103 30471 consensus_queue.cc:260] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.306679 30730 leader_election.cc:290] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:34.321918 30473 raft_consensus.cc:359] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.322628 30473 raft_consensus.cc:385] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.322906 30473 raft_consensus.cc:740] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.325768 30474 ts_tablet_manager.cc:1434] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 12:19:34.331097 30473 consensus_queue.cc:260] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.339450 30472 ts_tablet_manager.cc:1434] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 12:19:34.350390 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:34.331544 30730 raft_consensus.cc:493] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.351366 30730 raft_consensus.cc:515] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.353431 30730 leader_election.cc:290] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.338320 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:34.357275 30241 leader_election.cc:343] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.360419 30672 raft_consensus.cc:493] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.360517 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.361279 30352 raft_consensus.cc:2468] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:34.361045 30672 raft_consensus.cc:515] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.365417 30242 leader_election.cc:304] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:34.360773 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:34.366429 30730 raft_consensus.cc:2804] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.366978 30730 raft_consensus.cc:493] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.367316 30730 raft_consensus.cc:3060] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.370400 30672 leader_election.cc:290] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.367000 30426 raft_consensus.cc:2468] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:34.373755 30474 tablet_bootstrap.cc:492] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:34.375306 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4333c8ec1cd04d1d8ec97b1f5a79f8a5" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:34.376464 30274 raft_consensus.cc:2468] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:34.373380 30750 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.385591 30471 ts_tablet_manager.cc:1434] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.131s	user 0.023s	sys 0.018s
I20260709 12:19:34.384768 30473 ts_tablet_manager.cc:1434] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 12:19:34.380481 30563 raft_consensus.cc:493] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.391525 30472 tablet_bootstrap.cc:492] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:34.392339 30471 tablet_bootstrap.cc:492] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:34.385416 30317 leader_election.cc:304] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:34.393929 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4333c8ec1cd04d1d8ec97b1f5a79f8a5" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:34.394358 30672 raft_consensus.cc:2804] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.394768 30672 raft_consensus.cc:493] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.395121 30672 raft_consensus.cc:3060] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:34.395449 30315 leader_election.cc:343] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.397318 30099 catalog_manager.cc:5697] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:34.405910 30615 raft_consensus.cc:493] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.406483 30615 raft_consensus.cc:515] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.408672 30615 leader_election.cc:290] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:34.409768 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:34.411378 30244 leader_election.cc:343] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.411448 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:34.406983 30672 raft_consensus.cc:515] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.399525 30471 tablet_bootstrap.cc:654] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.397298 30473 tablet_bootstrap.cc:492] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:34.417689 30750 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.418496 30705 raft_consensus.cc:493] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.418392 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
W20260709 12:19:34.419286 30241 leader_election.cc:343] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.419560 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:34.423658 30426 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.424609 30730 raft_consensus.cc:515] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.420172 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4333c8ec1cd04d1d8ec97b1f5a79f8a5" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
W20260709 12:19:34.415020 30755 log.cc:927] Time spent T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:19:34.426595 30730 leader_election.cc:290] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.389777 30563 raft_consensus.cc:515] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
W20260709 12:19:34.427412 30315 leader_election.cc:343] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.428915 30563 leader_election.cc:290] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:34.430459 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:34.430557 30728 raft_consensus.cc:515] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.421105 30351 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.431195 30352 raft_consensus.cc:3060] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.422777 30705 raft_consensus.cc:515] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.420495 30672 leader_election.cc:290] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.431046 30474 tablet_bootstrap.cc:654] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.439764 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.438695 30241 leader_election.cc:304] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:34.445093 30426 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:34.447147 30473 tablet_bootstrap.cc:654] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.447993 30166 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:34.449883 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:34.449863 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4333c8ec1cd04d1d8ec97b1f5a79f8a5" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:34.450560 30615 raft_consensus.cc:2749] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:34.457567 30278 raft_consensus.cc:2393] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 777b1410f165436aa725262b964ff0a6 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:34.458648 30352 raft_consensus.cc:2468] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:34.460676 30168 leader_election.cc:304] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:34.462131 30707 raft_consensus.cc:3060] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.458014 30275 raft_consensus.cc:3060] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.445093 30351 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:34.469414 30242 leader_election.cc:304] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:34.474987 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:34.479350 30472 tablet_bootstrap.cc:654] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.479558 30426 raft_consensus.cc:3060] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.454959 30274 raft_consensus.cc:2393] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:34.477972 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.482813 30351 raft_consensus.cc:2468] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:34.482956 30615 raft_consensus.cc:2804] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.483783 30615 raft_consensus.cc:697] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:34.484691 30167 leader_election.cc:304] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:34.485772 30482 raft_consensus.cc:2804] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.485334 30615 consensus_queue.cc:237] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.486162 30482 raft_consensus.cc:493] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.486758 30482 raft_consensus.cc:3060] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.451267 30750 raft_consensus.cc:2804] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.495211 30391 leader_election.cc:304] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:34.496206 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:34.499008 30166 leader_election.cc:343] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.504282 30705 leader_election.cc:290] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.503641 30750 raft_consensus.cc:697] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:34.507488 30750 consensus_queue.cc:237] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.522997 30471 tablet_bootstrap.cc:492] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:34.523710 30471 ts_tablet_manager.cc:1403] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.132s	user 0.009s	sys 0.015s
I20260709 12:19:34.520107 30482 raft_consensus.cc:515] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.532156 30471 raft_consensus.cc:359] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.532838 30471 raft_consensus.cc:385] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.533097 30471 raft_consensus.cc:740] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.533830 30482 leader_election.cc:290] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.534483 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
W20260709 12:19:34.535820 30166 leader_election.cc:343] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.535501 30471 consensus_queue.cc:260] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.537569 30471 ts_tablet_manager.cc:1434] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:19:34.538408 30471 tablet_bootstrap.cc:492] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:34.540179 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:34.540764 30351 raft_consensus.cc:3060] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.542457 30728 leader_election.cc:290] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:34.544932 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:34.545069 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:34.545738 30424 raft_consensus.cc:3060] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.548767 30426 raft_consensus.cc:2468] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:34.551726 30763 raft_consensus.cc:2749] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:34.551846 30707 raft_consensus.cc:2749] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:34.553740 30275 raft_consensus.cc:2468] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:34.560346 30317 leader_election.cc:304] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:34.560997 30473 tablet_bootstrap.cc:492] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:34.561527 30473 ts_tablet_manager.cc:1403] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.165s	user 0.019s	sys 0.015s
I20260709 12:19:34.561568 30504 raft_consensus.cc:2804] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.562237 30504 raft_consensus.cc:697] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:34.563359 30504 consensus_queue.cc:237] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.579272 30351 raft_consensus.cc:2468] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:34.580466 30474 tablet_bootstrap.cc:492] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:34.581118 30474 ts_tablet_manager.cc:1403] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.244s	user 0.027s	sys 0.049s
I20260709 12:19:34.584184 30167 leader_election.cc:304] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:34.585530 30424 raft_consensus.cc:2468] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:34.586701 30241 leader_election.cc:304] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:34.587494 30728 raft_consensus.cc:2804] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.587394 30474 raft_consensus.cc:359] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.588346 30728 raft_consensus.cc:697] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:34.589098 30471 tablet_bootstrap.cc:654] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.589401 30728 consensus_queue.cc:237] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.588179 30474 raft_consensus.cc:385] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.590919 30474 raft_consensus.cc:740] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.591593 30474 consensus_queue.cc:260] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.590268 30473 raft_consensus.cc:359] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.592458 30473 raft_consensus.cc:385] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.592716 30473 raft_consensus.cc:740] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.593587 30474 ts_tablet_manager.cc:1434] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:19:34.593355 30473 consensus_queue.cc:260] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.594655 30474 tablet_bootstrap.cc:492] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:34.586090 30705 raft_consensus.cc:2804] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.596149 30705 raft_consensus.cc:697] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:34.596549 30473 ts_tablet_manager.cc:1434] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:19:34.596815 30351 raft_consensus.cc:1275] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:34.597057 30705 consensus_queue.cc:237] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.597645 30473 tablet_bootstrap.cc:492] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:34.598436 30750 consensus_queue.cc:1048] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:34.605935 30472 tablet_bootstrap.cc:492] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:34.606900 30472 ts_tablet_manager.cc:1403] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.223s	user 0.023s	sys 0.000s
I20260709 12:19:34.607762 30473 tablet_bootstrap.cc:654] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.608459 30474 tablet_bootstrap.cc:654] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.612211 30200 raft_consensus.cc:2468] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:34.613550 30471 tablet_bootstrap.cc:492] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:34.614190 30471 ts_tablet_manager.cc:1403] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.076s	user 0.010s	sys 0.005s
I20260709 12:19:34.618417 30471 raft_consensus.cc:359] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.619218 30471 raft_consensus.cc:385] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.619519 30471 raft_consensus.cc:740] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.620337 30471 consensus_queue.cc:260] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.624279 30473 tablet_bootstrap.cc:492] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:34.624620 30471 ts_tablet_manager.cc:1434] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:19:34.624785 30473 ts_tablet_manager.cc:1403] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 12:19:34.625666 30471 tablet_bootstrap.cc:492] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
W20260709 12:19:34.629169 30167 consensus_peers.cc:597] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.630705 30474 tablet_bootstrap.cc:492] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:34.631248 30474 ts_tablet_manager.cc:1403] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.001s
I20260709 12:19:34.631202 30473 raft_consensus.cc:359] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.633940 30473 raft_consensus.cc:385] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.634253 30473 raft_consensus.cc:740] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.634434 30474 raft_consensus.cc:359] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.635222 30474 raft_consensus.cc:385] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.635610 30474 raft_consensus.cc:740] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.636341 30474 consensus_queue.cc:260] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.636433 30473 consensus_queue.cc:260] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.639624 30473 ts_tablet_manager.cc:1434] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 12:19:34.640532 30473 tablet_bootstrap.cc:492] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:34.642407 30423 raft_consensus.cc:1275] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:34.644995 30471 tablet_bootstrap.cc:654] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.645419 30707 consensus_queue.cc:1048] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:34.656239 30728 consensus_queue.cc:1048] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:34.656491 30730 raft_consensus.cc:493] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.656993 30730 raft_consensus.cc:515] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.659461 30730 leader_election.cc:290] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:34.652593 30474 ts_tablet_manager.cc:1434] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:19:34.661437 30474 tablet_bootstrap.cc:492] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:34.670094 30474 tablet_bootstrap.cc:654] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.673276 30473 tablet_bootstrap.cc:654] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.682126 30471 tablet_bootstrap.cc:492] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:34.682719 30471 ts_tablet_manager.cc:1403] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.014s
I20260709 12:19:34.686648 30471 raft_consensus.cc:359] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.689425 30473 tablet_bootstrap.cc:492] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:34.689965 30473 ts_tablet_manager.cc:1403] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.001s
I20260709 12:19:34.690546 30471 raft_consensus.cc:385] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.690943 30471 raft_consensus.cc:740] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.693003 30473 raft_consensus.cc:359] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.693722 30473 raft_consensus.cc:385] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.698516 30474 tablet_bootstrap.cc:492] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:34.699150 30474 ts_tablet_manager.cc:1403] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.004s
I20260709 12:19:34.701349 30729 consensus_queue.cc:1048] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:34.702781 30474 raft_consensus.cc:359] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.703720 30474 raft_consensus.cc:385] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.704047 30474 raft_consensus.cc:740] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.705044 30474 consensus_queue.cc:260] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.694005 30473 raft_consensus.cc:740] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.704234 30545 raft_consensus.cc:493] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.706965 30473 consensus_queue.cc:260] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.707646 30545 raft_consensus.cc:515] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.710192 30474 ts_tablet_manager.cc:1434] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:19:34.710369 30545 leader_election.cc:290] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:34.711608 30474 tablet_bootstrap.cc:492] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:34.712610 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b3f7db61ad4d6e9464016245ab8079" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.713744 30763 raft_consensus.cc:493] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.714329 30763 raft_consensus.cc:515] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.717025 30473 ts_tablet_manager.cc:1434] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:19:34.719893 30473 tablet_bootstrap.cc:492] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:34.725642 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b3f7db61ad4d6e9464016245ab8079" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:34.726593 30201 raft_consensus.cc:2468] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:34.732394 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:34.722090 30242 leader_election.cc:343] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.727846 30763 leader_election.cc:290] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:34.734527 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91938ea259f9468fa8dd1b771846e52a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:34.735220 30275 raft_consensus.cc:2468] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
W20260709 12:19:34.737627 30166 leader_election.cc:343] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.738386 30473 tablet_bootstrap.cc:654] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.741425 30763 consensus_queue.cc:1048] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:34.743094 30391 leader_election.cc:304] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:34.743705 30474 tablet_bootstrap.cc:654] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.744381 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91938ea259f9468fa8dd1b771846e52a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:34.745673 30390 leader_election.cc:343] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.747910 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:34.748798 30274 raft_consensus.cc:2468] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:34.751230 30563 raft_consensus.cc:2804] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.751386 30244 leader_election.cc:304] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:34.751885 30563 raft_consensus.cc:493] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.752437 30563 raft_consensus.cc:3060] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.755703 30730 raft_consensus.cc:2804] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.756141 30730 raft_consensus.cc:493] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.756459 30730 raft_consensus.cc:3060] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:34.759665 30392 consensus_peers.cc:597] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.767033 30168 leader_election.cc:304] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:34.778828 30707 consensus_queue.cc:1048] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:34.779376 30750 raft_consensus.cc:2804] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.780932 30750 raft_consensus.cc:493] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.781497 30750 raft_consensus.cc:3060] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.775980 30563 raft_consensus.cc:515] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.789166 30474 tablet_bootstrap.cc:492] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:34.789788 30474 ts_tablet_manager.cc:1403] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.078s	user 0.014s	sys 0.001s
I20260709 12:19:34.793541 30730 raft_consensus.cc:515] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.795142 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91938ea259f9468fa8dd1b771846e52a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:34.820658 30563 leader_election.cc:290] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:34.814682 30472 raft_consensus.cc:359] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.820935 30278 raft_consensus.cc:3060] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.817847 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91938ea259f9468fa8dd1b771846e52a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:34.824079 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b3f7db61ad4d6e9464016245ab8079" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:34.831125 30201 raft_consensus.cc:3060] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.826298 30730 leader_election.cc:290] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:34.827431 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b3f7db61ad4d6e9464016245ab8079" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
W20260709 12:19:34.833241 30242 leader_election.cc:343] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:34.834779 30390 leader_election.cc:343] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.834750 30471 consensus_queue.cc:260] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.836418 30761 raft_consensus.cc:493] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.836865 30761 raft_consensus.cc:515] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.838619 30278 raft_consensus.cc:2468] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:34.839290 30201 raft_consensus.cc:2468] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:34.839462 30471 ts_tablet_manager.cc:1434] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.156s	user 0.007s	sys 0.001s
I20260709 12:19:34.839120 30472 raft_consensus.cc:385] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.839907 30474 raft_consensus.cc:359] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.842459 30474 raft_consensus.cc:385] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.842780 30474 raft_consensus.cc:740] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.841722 30472 raft_consensus.cc:740] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.845726 30474 consensus_queue.cc:260] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.845316 30391 leader_election.cc:304] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:34.846823 30244 leader_election.cc:304] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:34.848064 30729 raft_consensus.cc:2804] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.848371 30474 ts_tablet_manager.cc:1434] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 12:19:34.848562 30729 raft_consensus.cc:697] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:34.849543 30474 tablet_bootstrap.cc:492] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:34.850559 30471 tablet_bootstrap.cc:492] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:34.849293 30761 leader_election.cc:290] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:34.851362 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4333c8ec1cd04d1d8ec97b1f5a79f8a5" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.850339 30729 consensus_queue.cc:237] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:34.853368 30563 raft_consensus.cc:2804] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:34.854358 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4333c8ec1cd04d1d8ec97b1f5a79f8a5" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:34.856606 30278 raft_consensus.cc:2393] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:34.850062 30472 consensus_queue.cc:260] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.858834 30750 raft_consensus.cc:515] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:34.855829 30563 raft_consensus.cc:697] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:34.867965 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
W20260709 12:19:34.869799 30166 leader_election.cc:343] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.870112 30563 consensus_queue.cc:237] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:34.874320 30473 tablet_bootstrap.cc:492] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:34.874815 30473 ts_tablet_manager.cc:1403] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.155s	user 0.018s	sys 0.004s
I20260709 12:19:34.879384 30472 ts_tablet_manager.cc:1434] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.272s	user 0.009s	sys 0.000s
I20260709 12:19:34.880677 30472 tablet_bootstrap.cc:492] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:34.882756 30473 raft_consensus.cc:359] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.885457 30473 raft_consensus.cc:385] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:34.885841 30473 raft_consensus.cc:740] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:34.886593 30473 consensus_queue.cc:260] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.888635 30471 tablet_bootstrap.cc:654] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.898705 30391 leader_election.cc:304] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:34.897257 30707 raft_consensus.cc:493] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.902040 30707 raft_consensus.cc:515] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.907557 30707 leader_election.cc:290] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.908584 30707 raft_consensus.cc:493] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.900938 30761 raft_consensus.cc:3060] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.909243 30707 raft_consensus.cc:515] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.912072 30707 leader_election.cc:290] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.913216 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:34.913852 30275 raft_consensus.cc:3060] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.916396 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.917101 30352 raft_consensus.cc:2468] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:34.919193 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9b5ed70fdf49c0bf254214d8ca297c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.919416 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:34.920650 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a9b5ed70fdf49c0bf254214d8ca297c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:34.920712 30167 leader_election.cc:304] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:34.922339 30482 raft_consensus.cc:2804] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:34.922789 30482 raft_consensus.cc:493] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:34.923182 30482 raft_consensus.cc:3060] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:34.898056 30750 leader_election.cc:290] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:34.931634 30166 leader_election.cc:343] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:34.938244 30759 raft_consensus.cc:493] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.939042 30759 raft_consensus.cc:515] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.951048 30482 raft_consensus.cc:515] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:34.928956 30796 raft_consensus.cc:493] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:34.959021 30472 tablet_bootstrap.cc:654] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:34.958001 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:34.950788 30167 leader_election.cc:304] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:34.949694 30759 leader_election.cc:290] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:34.949128 30761 raft_consensus.cc:2749] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:34.951758 30275 raft_consensus.cc:2468] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:34.975401 30473 ts_tablet_manager.cc:1434] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.100s	user 0.014s	sys 0.012s
I20260709 12:19:34.974825 30482 leader_election.cc:290] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:34.983035 30100 catalog_manager.cc:5697] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:34.983057 30348 raft_consensus.cc:2393] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:34.994522 30168 leader_election.cc:304] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:35.003942 30473 tablet_bootstrap.cc:492] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:34.966593 30796 raft_consensus.cc:515] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.012013 30799 raft_consensus.cc:2804] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:19:35.020164 30166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 86551.4us
W20260709 12:19:35.036549 30167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 105806us
I20260709 12:19:35.037611 30615 consensus_queue.cc:1048] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:35.040103 30471 tablet_bootstrap.cc:492] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:35.040757 30471 ts_tablet_manager.cc:1403] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.191s	user 0.024s	sys 0.018s
I20260709 12:19:35.032864 30799 raft_consensus.cc:697] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:35.037644 30707 raft_consensus.cc:2749] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.043974 30471 raft_consensus.cc:359] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.044673 30471 raft_consensus.cc:385] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.044942 30471 raft_consensus.cc:740] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.045599 30471 consensus_queue.cc:260] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.042014 30799 consensus_queue.cc:237] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.052278 30097 catalog_manager.cc:5697] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.055760 30806 consensus_queue.cc:1048] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:35.059294 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:35.060778 30471 ts_tablet_manager.cc:1434] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:19:35.063356 30482 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.064179 30482 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.065734 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:35.066462 30348 raft_consensus.cc:3060] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.071611 30471 tablet_bootstrap.cc:492] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:35.067760 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:35.078848 30423 raft_consensus.cc:3060] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.079123 30796 leader_election.cc:290] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:35.081646 30348 raft_consensus.cc:2468] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:35.082479 30804 consensus_queue.cc:1048] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 12:19:35.087121 30474 tablet_bootstrap.cc:654] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.088697 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623336ab8b78487db7b5b817879e958e" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:35.061892 30097 catalog_manager.cc:5697] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:35.102288 30241 leader_election.cc:343] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.102321 30097 catalog_manager.cc:5697] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.107530 30802 consensus_queue.cc:1048] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:19:35.111129 30392 leader_election.cc:304] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:35.101138 30473 tablet_bootstrap.cc:654] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.116896 30482 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:35.139158 30423 raft_consensus.cc:2468] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:35.141695 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:35.131469 30563 raft_consensus.cc:3060] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.142426 30347 raft_consensus.cc:2468] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:35.148511 30471 tablet_bootstrap.cc:654] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.162153 30472 tablet_bootstrap.cc:492] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:35.162766 30472 ts_tablet_manager.cc:1403] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.282s	user 0.024s	sys 0.001s
I20260709 12:19:35.164191 30707 consensus_queue.cc:1048] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.164326 30167 leader_election.cc:304] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:35.165587 30707 consensus_queue.cc:1048] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.167001 30545 raft_consensus.cc:2804] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.167551 30545 raft_consensus.cc:697] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:35.168406 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623336ab8b78487db7b5b817879e958e" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:35.168503 30545 consensus_queue.cc:237] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.165822 30472 raft_consensus.cc:359] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:35.170909 30804 raft_consensus.cc:493] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.171569 30804 raft_consensus.cc:515] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.173828 30804 leader_election.cc:290] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:35.175472 30472 raft_consensus.cc:385] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.175974 30472 raft_consensus.cc:740] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.176748 30472 consensus_queue.cc:260] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
W20260709 12:19:35.178774 30244 leader_election.cc:343] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.180215 30244 leader_election.cc:304] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:35.181244 30804 raft_consensus.cc:2749] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.184209 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:35.194442 30244 leader_election.cc:343] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.195845 30807 consensus_queue.cc:1048] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:35.206519 30728 consensus_queue.cc:1048] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.209415 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:35.210741 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:35.211485 30424 raft_consensus.cc:2468] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
W20260709 12:19:35.213264 30242 leader_election.cc:343] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.213979 30472 ts_tablet_manager.cc:1434] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:19:35.213781 30242 leader_election.cc:304] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:35.165726 30167 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:35.222036 30473 tablet_bootstrap.cc:492] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:35.222609 30473 ts_tablet_manager.cc:1403] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.234s	user 0.005s	sys 0.014s
I20260709 12:19:35.222774 30472 tablet_bootstrap.cc:492] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:35.225534 30728 raft_consensus.cc:2749] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:35.227165 30167 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 61524.6us
I20260709 12:19:35.230482 30705 raft_consensus.cc:2804] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:35.230888 30705 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.231277 30705 raft_consensus.cc:3060] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:35.240715 30203 raft_consensus.cc:3060] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.252280 30473 raft_consensus.cc:359] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.252859 30473 raft_consensus.cc:385] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.253099 30473 raft_consensus.cc:740] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
W20260709 12:19:35.264089 30166 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 46671.9us
I20260709 12:19:35.264807 30730 consensus_queue.cc:1048] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.274964 30473 consensus_queue.cc:260] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.279018 30474 tablet_bootstrap.cc:492] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:35.283809 30474 ts_tablet_manager.cc:1403] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.434s	user 0.019s	sys 0.012s
I20260709 12:19:35.302994 30482 consensus_queue.cc:1048] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:19:35.303570 30816 log.cc:927] Time spent T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:19:35.305416 30101 catalog_manager.cc:5697] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.306429 30563 raft_consensus.cc:2749] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.307819 30101 catalog_manager.cc:5697] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.309365 30101 catalog_manager.cc:5697] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.321519 30482 consensus_queue.cc:1048] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.322623 30705 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.325436 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:35.325671 30705 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:35.326030 30351 raft_consensus.cc:3060] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:35.329205 30422 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:35.329811 30422 raft_consensus.cc:3060] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:35.331785 30473 ts_tablet_manager.cc:1434] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.109s	user 0.005s	sys 0.002s
I20260709 12:19:35.333207 30473 tablet_bootstrap.cc:492] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:35.335233 30759 consensus_queue.cc:1048] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.341465 30099 catalog_manager.cc:5697] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.369258 30422 raft_consensus.cc:2468] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:35.372723 30166 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:35.373699 30799 raft_consensus.cc:2804] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:35.374354 30799 raft_consensus.cc:697] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:35.375182 30799 consensus_queue.cc:237] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:35.383299 30242 consensus_peers.cc:597] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:35.389760 30471 tablet_bootstrap.cc:492] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:35.429390 30471 ts_tablet_manager.cc:1403] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.358s	user 0.025s	sys 0.008s
I20260709 12:19:35.397054 30472 tablet_bootstrap.cc:654] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.400307 30474 raft_consensus.cc:359] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.432598 30474 raft_consensus.cc:385] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.432950 30474 raft_consensus.cc:740] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.433678 30474 consensus_queue.cc:260] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.436436 30474 ts_tablet_manager.cc:1434] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.152s	user 0.004s	sys 0.000s
I20260709 12:19:35.409924 30473 tablet_bootstrap.cc:654] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.415585 30346 raft_consensus.cc:3060] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.377214 30351 raft_consensus.cc:2468] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
W20260709 12:19:35.424044 30149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:35.438156 30474 tablet_bootstrap.cc:492] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:35.461329 30563 consensus_queue.cc:1048] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.465376 30474 tablet_bootstrap.cc:654] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.467806 30099 catalog_manager.cc:5697] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.470506 30099 catalog_manager.cc:5697] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.472083 30471 raft_consensus.cc:359] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.472724 30471 raft_consensus.cc:385] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.472980 30471 raft_consensus.cc:740] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.473610 30471 consensus_queue.cc:260] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.487465 30473 tablet_bootstrap.cc:492] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:35.488004 30473 ts_tablet_manager.cc:1403] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.155s	user 0.020s	sys 0.013s
I20260709 12:19:35.490917 30473 raft_consensus.cc:359] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.491722 30473 raft_consensus.cc:385] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.491968 30473 raft_consensus.cc:740] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.492713 30473 consensus_queue.cc:260] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.493258 30471 ts_tablet_manager.cc:1434] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 12:19:35.504480 30471 tablet_bootstrap.cc:492] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:35.500738 30472 tablet_bootstrap.cc:492] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:35.506198 30472 ts_tablet_manager.cc:1403] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.284s	user 0.014s	sys 0.011s
I20260709 12:19:35.509169 30472 raft_consensus.cc:359] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.509891 30472 raft_consensus.cc:385] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.510152 30472 raft_consensus.cc:740] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.511022 30472 consensus_queue.cc:260] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.495364 30473 ts_tablet_manager.cc:1434] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:35.512933 30473 tablet_bootstrap.cc:492] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:35.517745 30471 tablet_bootstrap.cc:654] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.528180 30472 ts_tablet_manager.cc:1434] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 12:19:35.529366 30472 tablet_bootstrap.cc:492] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:35.535959 30471 tablet_bootstrap.cc:492] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:35.536518 30471 ts_tablet_manager.cc:1403] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.000s
I20260709 12:19:35.537416 30100 catalog_manager.cc:5697] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:35.538990 30474 tablet_bootstrap.cc:492] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:35.541759 30474 ts_tablet_manager.cc:1403] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.104s	user 0.009s	sys 0.004s
I20260709 12:19:35.541953 30472 tablet_bootstrap.cc:654] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.539654 30473 tablet_bootstrap.cc:654] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.548408 30474 raft_consensus.cc:359] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.549396 30474 raft_consensus.cc:385] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.549733 30474 raft_consensus.cc:740] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.550779 30474 consensus_queue.cc:260] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.551605 30471 raft_consensus.cc:359] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:35.552323 30471 raft_consensus.cc:385] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.552592 30471 raft_consensus.cc:740] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.553382 30472 tablet_bootstrap.cc:492] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:35.553853 30472 ts_tablet_manager.cc:1403] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 12:19:35.553303 30471 consensus_queue.cc:260] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:35.556584 30472 raft_consensus.cc:359] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.557215 30472 raft_consensus.cc:385] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.557467 30472 raft_consensus.cc:740] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.559226 30474 ts_tablet_manager.cc:1434] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 12:19:35.561105 30474 tablet_bootstrap.cc:492] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:35.558311 30472 consensus_queue.cc:260] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.568203 30672 raft_consensus.cc:493] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.568701 30672 raft_consensus.cc:515] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.571592 30351 raft_consensus.cc:3060] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.572633 30672 leader_election.cc:290] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:35.574481 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b3f7db61ad4d6e9464016245ab8079" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:35.575220 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33b3f7db61ad4d6e9464016245ab8079" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:35.576740 30317 leader_election.cc:304] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:35.578229 30672 raft_consensus.cc:2749] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.579063 30471 ts_tablet_manager.cc:1434] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.003s
I20260709 12:19:35.580215 30471 tablet_bootstrap.cc:492] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:35.587054 30472 ts_tablet_manager.cc:1434] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:19:35.588336 30472 tablet_bootstrap.cc:492] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:35.594720 30472 tablet_bootstrap.cc:654] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.595280 30545 raft_consensus.cc:493] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.595165 30705 consensus_queue.cc:1048] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.595784 30545 raft_consensus.cc:515] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.597926 30545 leader_election.cc:290] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:35.600195 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:35.601624 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:35.601986 30166 leader_election.cc:343] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:35.603294 30167 leader_election.cc:343] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.603752 30167 leader_election.cc:304] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:35.605013 30705 raft_consensus.cc:2749] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.600705 30471 tablet_bootstrap.cc:654] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.620031 30799 consensus_queue.cc:1048] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:35.624752 30471 tablet_bootstrap.cc:492] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:35.625303 30471 ts_tablet_manager.cc:1403] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.004s
I20260709 12:19:35.639523 30426 raft_consensus.cc:3060] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.634073 30471 raft_consensus.cc:359] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.643105 30471 raft_consensus.cc:385] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.644212 30471 raft_consensus.cc:740] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.645331 30473 tablet_bootstrap.cc:492] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:35.645849 30473 ts_tablet_manager.cc:1403] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.133s	user 0.024s	sys 0.009s
I20260709 12:19:35.645828 30471 consensus_queue.cc:260] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.649432 30471 ts_tablet_manager.cc:1434] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:19:35.651005 30473 raft_consensus.cc:359] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.651819 30473 raft_consensus.cc:385] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.652081 30473 raft_consensus.cc:740] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.656939 30563 raft_consensus.cc:493] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.657620 30471 tablet_bootstrap.cc:492] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:35.657493 30563 raft_consensus.cc:515] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:35.652719 30473 consensus_queue.cc:260] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.663148 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce9c549b6414f61af3e10fccd6b5001" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:35.663975 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce9c549b6414f61af3e10fccd6b5001" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:35.665587 30473 ts_tablet_manager.cc:1434] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:19:35.667773 30799 consensus_queue.cc:1048] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.660039 30563 leader_election.cc:290] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:35.674324 30473 tablet_bootstrap.cc:492] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:35.693825 30802 raft_consensus.cc:493] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.694545 30802 raft_consensus.cc:515] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.713671 30471 tablet_bootstrap.cc:654] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:35.714841 30390 leader_election.cc:343] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.717710 30802 leader_election.cc:290] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:35.717646 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:35.720026 30391 leader_election.cc:343] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.721705 30391 leader_election.cc:304] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:35.723140 30563 raft_consensus.cc:2749] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:35.735781 30241 leader_election.cc:343] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.743999 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:35.745407 30474 tablet_bootstrap.cc:654] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:35.746815 30244 leader_election.cc:343] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.747370 30244 leader_election.cc:304] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:35.748556 30803 raft_consensus.cc:2749] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.750224 30473 tablet_bootstrap.cc:654] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.755185 30472 tablet_bootstrap.cc:492] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:35.755646 30472 ts_tablet_manager.cc:1403] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.168s	user 0.019s	sys 0.017s
I20260709 12:19:35.758235 30472 raft_consensus.cc:359] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.759238 30472 raft_consensus.cc:385] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.759837 30472 raft_consensus.cc:740] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.770426 30705 raft_consensus.cc:493] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.771075 30705 raft_consensus.cc:515] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.773173 30705 leader_election.cc:290] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:35.773762 30705 consensus_queue.cc:1048] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.777266 30471 tablet_bootstrap.cc:492] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:35.777796 30471 ts_tablet_manager.cc:1403] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.121s	user 0.006s	sys 0.007s
I20260709 12:19:35.780026 30474 tablet_bootstrap.cc:492] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:35.781443 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:35.782624 30274 raft_consensus.cc:2468] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:35.782912 30471 raft_consensus.cc:359] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:35.783607 30471 raft_consensus.cc:385] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.783912 30471 raft_consensus.cc:740] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.784485 30168 leader_election.cc:304] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:35.785560 30705 raft_consensus.cc:2804] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.786019 30705 raft_consensus.cc:493] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.787213 30563 raft_consensus.cc:493] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.786440 30705 raft_consensus.cc:3060] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.787757 30563 raft_consensus.cc:515] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.788285 30471 consensus_queue.cc:260] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:35.790555 30563 leader_election.cc:290] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:35.791623 30471 ts_tablet_manager.cc:1434] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:19:35.760474 30472 consensus_queue.cc:260] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:35.784147 30474 ts_tablet_manager.cc:1403] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.223s	user 0.008s	sys 0.003s
I20260709 12:19:35.792747 30471 tablet_bootstrap.cc:492] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:35.795086 30474 raft_consensus.cc:359] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.806535 30474 raft_consensus.cc:385] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.807351 30474 raft_consensus.cc:740] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.808472 30474 consensus_queue.cc:260] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.811945 30474 ts_tablet_manager.cc:1434] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:19:35.814958 30471 tablet_bootstrap.cc:654] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.815454 30705 raft_consensus.cc:515] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.821753 30705 leader_election.cc:290] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:35.829198 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:35.829496 30349 raft_consensus.cc:3060] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:35.832134 30841 log.cc:927] Time spent T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:19:35.837013 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:35.838330 30274 raft_consensus.cc:3060] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.800845 30472 ts_tablet_manager.cc:1434] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:19:35.842265 30474 tablet_bootstrap.cc:492] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:35.843854 30472 tablet_bootstrap.cc:492] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
W20260709 12:19:35.858788 30167 leader_election.cc:343] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.865195 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623336ab8b78487db7b5b817879e958e" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:35.865839 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:35.866153 30274 raft_consensus.cc:2468] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:35.867892 30168 leader_election.cc:304] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:35.868249 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623336ab8b78487db7b5b817879e958e" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:35.868618 30545 raft_consensus.cc:2804] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.868891 30275 raft_consensus.cc:2468] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:35.869189 30545 raft_consensus.cc:697] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:35.870064 30545 consensus_queue.cc:237] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.877151 30391 leader_election.cc:304] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
W20260709 12:19:35.880311 30392 leader_election.cc:343] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.880782 30563 raft_consensus.cc:2804] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.881224 30563 raft_consensus.cc:493] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.881565 30563 raft_consensus.cc:3060] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:35.884994 30167 leader_election.cc:343] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.894611 30474 tablet_bootstrap.cc:654] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.897320 30473 tablet_bootstrap.cc:492] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:35.897842 30473 ts_tablet_manager.cc:1403] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.224s	user 0.023s	sys 0.015s
I20260709 12:19:35.900707 30473 raft_consensus.cc:359] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.901628 30473 raft_consensus.cc:385] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.901980 30473 raft_consensus.cc:740] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.907631 30473 consensus_queue.cc:260] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.910316 30471 tablet_bootstrap.cc:492] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:35.913820 30471 ts_tablet_manager.cc:1403] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.008s
I20260709 12:19:35.915023 30563 raft_consensus.cc:515] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.911543 30472 tablet_bootstrap.cc:654] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.939848 30563 leader_election.cc:290] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:35.939967 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623336ab8b78487db7b5b817879e958e" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:35.940567 30203 raft_consensus.cc:3060] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.917563 30471 raft_consensus.cc:359] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:35.920015 30473 ts_tablet_manager.cc:1434] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:19:35.942637 30473 tablet_bootstrap.cc:492] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:35.921801 30474 tablet_bootstrap.cc:492] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:35.943595 30474 ts_tablet_manager.cc:1403] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.102s	user 0.018s	sys 0.000s
I20260709 12:19:35.925243 30545 raft_consensus.cc:493] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.929445 30803 raft_consensus.cc:493] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.930176 30423 raft_consensus.cc:1275] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:19:35.946954 30803 raft_consensus.cc:515] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.933354 30097 catalog_manager.cc:5697] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.948971 30474 raft_consensus.cc:359] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:35.949705 30474 raft_consensus.cc:385] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:35.949986 30474 raft_consensus.cc:740] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:35.950728 30203 raft_consensus.cc:2468] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:35.950579 30545 raft_consensus.cc:515] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:35.952683 30545 leader_election.cc:290] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:35.953765 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:35.954576 30392 leader_election.cc:304] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
W20260709 12:19:35.955226 30167 leader_election.cc:343] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.949021 30803 leader_election.cc:290] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:35.955883 30474 consensus_queue.cc:260] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:35.957298 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "623336ab8b78487db7b5b817879e958e" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:35.957448 30759 raft_consensus.cc:2804] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:35.957965 30274 raft_consensus.cc:3060] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.965035 30750 consensus_queue.cc:1048] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.966500 30473 tablet_bootstrap.cc:654] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.959132 30474 ts_tablet_manager.cc:1434] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:19:35.967978 30474 tablet_bootstrap.cc:492] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:35.973124 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:35.973413 30348 raft_consensus.cc:1275] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:19:35.978260 30242 leader_election.cc:343] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.979825 30705 consensus_queue.cc:1048] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:35.961916 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:35.987047 30278 raft_consensus.cc:2468] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:35.960983 30850 raft_consensus.cc:493] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:35.988795 30850 raft_consensus.cc:515] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:35.989604 30168 leader_election.cc:304] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:35.991556 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:35.993566 30391 leader_election.cc:343] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.995110 30705 raft_consensus.cc:2804] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:35.995258 30850 leader_election.cc:290] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:35.995564 30705 raft_consensus.cc:493] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:35.995999 30705 raft_consensus.cc:3060] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:35.997372 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:35.998366 30759 raft_consensus.cc:697] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
W20260709 12:19:35.998661 30390 leader_election.cc:343] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:35.999118 30390 leader_election.cc:304] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:35.999372 30759 consensus_queue.cc:237] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.001351 30474 tablet_bootstrap.cc:654] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:35.974568 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:35.999984 30472 tablet_bootstrap.cc:492] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:36.012636 30472 ts_tablet_manager.cc:1403] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.169s	user 0.014s	sys 0.001s
I20260709 12:19:36.007860 30851 raft_consensus.cc:2749] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:35.944382 30471 raft_consensus.cc:385] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.018218 30471 raft_consensus.cc:740] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.038970 30471 consensus_queue.cc:260] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.043922 30471 ts_tablet_manager.cc:1434] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.130s	user 0.006s	sys 0.000s
I20260709 12:19:36.050624 30471 tablet_bootstrap.cc:492] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:36.019827 30274 raft_consensus.cc:2468] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:36.018937 30472 raft_consensus.cc:359] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.055194 30472 raft_consensus.cc:385] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.043195 30099 catalog_manager.cc:5697] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.051482 30705 raft_consensus.cc:515] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.055557 30472 raft_consensus.cc:740] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.027022 30473 tablet_bootstrap.cc:492] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:36.061599 30472 consensus_queue.cc:260] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.068368 30472 ts_tablet_manager.cc:1434] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.000s
I20260709 12:19:36.060997 30474 tablet_bootstrap.cc:492] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:36.069092 30474 ts_tablet_manager.cc:1403] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.005s
I20260709 12:19:36.061604 30203 raft_consensus.cc:2393] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f03b88e02d9c4039964e2ab17a35bf52 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:36.070487 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:36.071108 30274 raft_consensus.cc:3060] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.071643 30472 tablet_bootstrap.cc:492] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:36.071964 30474 raft_consensus.cc:359] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.072616 30474 raft_consensus.cc:385] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.072878 30474 raft_consensus.cc:740] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.073518 30474 consensus_queue.cc:260] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.075722 30474 ts_tablet_manager.cc:1434] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:36.061919 30473 ts_tablet_manager.cc:1403] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.120s	user 0.006s	sys 0.006s
I20260709 12:19:36.079903 30244 leader_election.cc:304] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:36.080348 30474 tablet_bootstrap.cc:492] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:36.087836 30473 raft_consensus.cc:359] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.089954 30473 raft_consensus.cc:385] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.090344 30473 raft_consensus.cc:740] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.077981 30472 tablet_bootstrap.cc:654] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.091564 30474 tablet_bootstrap.cc:654] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.094944 30473 consensus_queue.cc:260] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.098827 30473 ts_tablet_manager.cc:1434] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:19:36.062937 30471 tablet_bootstrap.cc:654] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.102738 30474 tablet_bootstrap.cc:492] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:36.103279 30474 ts_tablet_manager.cc:1403] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.009s
I20260709 12:19:36.065937 30705 leader_election.cc:290] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:36.064046 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
W20260709 12:19:36.105453 30167 leader_election.cc:343] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.106030 30474 raft_consensus.cc:359] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.106874 30474 raft_consensus.cc:385] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.107197 30474 raft_consensus.cc:740] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.107988 30474 consensus_queue.cc:260] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.114545 30474 ts_tablet_manager.cc:1434] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:36.115670 30474 tablet_bootstrap.cc:492] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:36.117945 30471 tablet_bootstrap.cc:492] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:36.118500 30471 ts_tablet_manager.cc:1403] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.068s	user 0.007s	sys 0.010s
I20260709 12:19:36.121179 30471 raft_consensus.cc:359] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.121874 30471 raft_consensus.cc:385] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.121939 30474 tablet_bootstrap.cc:654] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.122212 30471 raft_consensus.cc:740] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.126729 30473 tablet_bootstrap.cc:492] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:36.129024 30672 raft_consensus.cc:493] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.129523 30672 raft_consensus.cc:515] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.130710 30274 raft_consensus.cc:2468] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:36.131444 30472 tablet_bootstrap.cc:492] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:36.131639 30672 leader_election.cc:290] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:36.131899 30472 ts_tablet_manager.cc:1403] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.003s
I20260709 12:19:36.123153 30471 consensus_queue.cc:260] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.135080 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:36.138083 30315 leader_election.cc:343] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.138679 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:36.139319 30203 raft_consensus.cc:2468] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:36.140914 30318 leader_election.cc:304] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:36.142499 30807 raft_consensus.cc:2804] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:36.142863 30807 raft_consensus.cc:493] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.143227 30807 raft_consensus.cc:3060] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.135255 30472 raft_consensus.cc:359] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.144910 30472 raft_consensus.cc:385] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.145311 30472 raft_consensus.cc:740] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.151779 30471 ts_tablet_manager.cc:1434] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 12:19:36.152897 30471 tablet_bootstrap.cc:492] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:36.156263 30473 tablet_bootstrap.cc:654] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.161158 30168 leader_election.cc:304] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:36.162388 30705 raft_consensus.cc:2804] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:36.162849 30705 raft_consensus.cc:697] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:36.163679 30705 consensus_queue.cc:237] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.169049 30471 tablet_bootstrap.cc:654] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.147428 30472 consensus_queue.cc:260] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.171468 30799 raft_consensus.cc:493] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.173828 30799 raft_consensus.cc:515] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.146515 30803 raft_consensus.cc:2749] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:36.190788 30472 ts_tablet_manager.cc:1434] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:19:36.187292 30799 leader_election.cc:290] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:36.205338 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:36.198985 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:36.206357 30275 raft_consensus.cc:2468] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:36.207820 30168 leader_election.cc:304] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:36.206573 30423 raft_consensus.cc:2468] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:36.214107 30750 raft_consensus.cc:2804] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:36.215610 30750 raft_consensus.cc:493] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.215955 30750 raft_consensus.cc:3060] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.218830 30472 tablet_bootstrap.cc:492] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:36.228338 30473 tablet_bootstrap.cc:492] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:36.228899 30473 ts_tablet_manager.cc:1403] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.006s
I20260709 12:19:36.231804 30473 raft_consensus.cc:359] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.232460 30473 raft_consensus.cc:385] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.232748 30473 raft_consensus.cc:740] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.233471 30473 consensus_queue.cc:260] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.235526 30473 ts_tablet_manager.cc:1434] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:19:36.236532 30473 tablet_bootstrap.cc:492] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:36.237299 30474 tablet_bootstrap.cc:492] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:36.237812 30474 ts_tablet_manager.cc:1403] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.122s	user 0.023s	sys 0.037s
I20260709 12:19:36.240595 30474 raft_consensus.cc:359] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.241266 30474 raft_consensus.cc:385] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.241529 30474 raft_consensus.cc:740] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.242161 30474 consensus_queue.cc:260] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.244305 30807 raft_consensus.cc:515] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.249873 30473 tablet_bootstrap.cc:654] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.250118 30750 raft_consensus.cc:515] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.255302 30474 ts_tablet_manager.cc:1434] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:19:36.257426 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:36.258020 30423 raft_consensus.cc:3060] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.261540 30807 leader_election.cc:290] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:36.262743 30750 leader_election.cc:290] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:36.263110 30474 tablet_bootstrap.cc:492] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:36.263728 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:36.252576 30472 tablet_bootstrap.cc:654] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.264469 30203 raft_consensus.cc:3060] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.264986 30099 catalog_manager.cc:5697] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.267258 30421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:36.269264 30802 raft_consensus.cc:493] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.271572 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:36.272274 30278 raft_consensus.cc:3060] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:36.274504 30315 leader_election.cc:343] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.274982 30728 raft_consensus.cc:493] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.275585 30728 raft_consensus.cc:515] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.276764 30474 tablet_bootstrap.cc:654] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.269918 30802 raft_consensus.cc:515] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.277887 30728 leader_election.cc:290] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:36.280622 30421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:36.305588 30421 raft_consensus.cc:2468] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:36.305944 30707 raft_consensus.cc:493] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.306505 30707 raft_consensus.cc:515] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.281852 30802 leader_election.cc:290] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:36.282913 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:36.279116 30473 tablet_bootstrap.cc:492] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:36.307969 30473 ts_tablet_manager.cc:1403] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.072s	user 0.009s	sys 0.002s
I20260709 12:19:36.282491 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:36.283963 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:36.310019 30241 leader_election.cc:304] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:36.310803 30802 raft_consensus.cc:2804] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:36.311147 30802 raft_consensus.cc:493] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.311249 30707 leader_election.cc:290] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:36.311571 30802 raft_consensus.cc:3060] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.312105 30421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e1306c0565463d9f7dd00b385e55c7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:36.312680 30244 leader_election.cc:343] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:36.313618 30166 leader_election.cc:343] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:36.313866 30242 leader_election.cc:343] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:36.314921 30242 leader_election.cc:343] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.315339 30242 leader_election.cc:304] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:36.316097 30728 raft_consensus.cc:2749] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:36.317186 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e1306c0565463d9f7dd00b385e55c7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:36.299214 30423 raft_consensus.cc:2468] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:36.318783 30471 tablet_bootstrap.cc:492] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:36.318887 30864 raft_consensus.cc:493] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.320727 30471 ts_tablet_manager.cc:1403] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.168s	user 0.024s	sys 0.000s
I20260709 12:19:36.320636 30864 raft_consensus.cc:515] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.321045 30166 leader_election.cc:304] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:36.324508 30707 raft_consensus.cc:2804] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:36.324983 30707 raft_consensus.cc:697] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:36.325296 30864 leader_election.cc:290] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:36.327297 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce9c549b6414f61af3e10fccd6b5001" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:36.322219 30167 leader_election.cc:343] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.328359 30167 leader_election.cc:304] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:36.327513 30278 raft_consensus.cc:2468] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:36.325804 30707 consensus_queue.cc:237] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.328094 30275 raft_consensus.cc:2468] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:36.330565 30317 leader_election.cc:304] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:36.330693 30728 raft_consensus.cc:493] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.331254 30728 raft_consensus.cc:515] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.331620 30864 raft_consensus.cc:2804] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:36.332036 30864 raft_consensus.cc:493] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.332381 30864 raft_consensus.cc:3060] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.334414 30728 leader_election.cc:290] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:36.335570 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:36.336999 30241 leader_election.cc:343] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.339577 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce9c549b6414f61af3e10fccd6b5001" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:36.340583 30423 raft_consensus.cc:2468] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:36.327984 30473 raft_consensus.cc:359] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.342588 30473 raft_consensus.cc:385] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.342883 30473 raft_consensus.cc:740] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.343532 30473 consensus_queue.cc:260] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.345666 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:36.319507 30203 raft_consensus.cc:2468] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
W20260709 12:19:36.347142 30242 leader_election.cc:343] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.347226 30318 leader_election.cc:304] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:36.347632 30242 leader_election.cc:304] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:36.329433 30799 raft_consensus.cc:2749] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:36.348518 30807 raft_consensus.cc:2804] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:36.322926 30802 raft_consensus.cc:515] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.349016 30807 raft_consensus.cc:697] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:36.349867 30807 consensus_queue.cc:237] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.350399 30803 raft_consensus.cc:2749] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:36.350046 30471 raft_consensus.cc:359] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.353886 30471 raft_consensus.cc:385] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.354189 30471 raft_consensus.cc:740] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.354498 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
W20260709 12:19:36.355863 30242 leader_election.cc:343] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.359723 30802 leader_election.cc:290] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:36.361191 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:36.362073 30472 tablet_bootstrap.cc:492] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:36.362522 30472 ts_tablet_manager.cc:1403] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.010s
I20260709 12:19:36.361788 30423 raft_consensus.cc:3060] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.363903 30471 consensus_queue.cc:260] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.367141 30474 tablet_bootstrap.cc:492] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:36.369148 30473 ts_tablet_manager.cc:1434] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 12:19:36.369235 30474 ts_tablet_manager.cc:1403] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.106s	user 0.012s	sys 0.011s
I20260709 12:19:36.370528 30473 tablet_bootstrap.cc:492] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:36.357465 30864 raft_consensus.cc:515] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.374322 30471 ts_tablet_manager.cc:1434] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:19:36.375382 30471 tablet_bootstrap.cc:492] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:36.379534 30097 catalog_manager.cc:5697] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.382377 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce9c549b6414f61af3e10fccd6b5001" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:36.388119 30423 raft_consensus.cc:2468] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:36.388572 30278 raft_consensus.cc:3060] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.389096 30802 raft_consensus.cc:493] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.389545 30802 raft_consensus.cc:515] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.383550 30472 raft_consensus.cc:359] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.391088 30472 raft_consensus.cc:385] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.391373 30472 raft_consensus.cc:740] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.392179 30472 consensus_queue.cc:260] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.392741 30241 leader_election.cc:304] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:36.391306 30474 raft_consensus.cc:359] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.393947 30474 raft_consensus.cc:385] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.382916 30471 tablet_bootstrap.cc:654] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.394027 30728 raft_consensus.cc:2804] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:36.394313 30474 raft_consensus.cc:740] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.387079 30099 catalog_manager.cc:5697] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.395479 30802 leader_election.cc:290] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:36.394340 30472 ts_tablet_manager.cc:1434] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:19:36.384701 30864 leader_election.cc:290] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:36.385146 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ce9c549b6414f61af3e10fccd6b5001" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:36.397310 30426 raft_consensus.cc:3060] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.399096 30278 raft_consensus.cc:2468] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:36.401108 30317 leader_election.cc:304] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:36.395596 30474 consensus_queue.cc:260] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.402591 30807 raft_consensus.cc:2804] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:36.396018 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4290068162194444a3f4d05ad418ca30" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:36.403112 30474 ts_tablet_manager.cc:1434] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:19:36.403573 30423 raft_consensus.cc:2468] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 0.
I20260709 12:19:36.396385 30728 raft_consensus.cc:697] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:36.396440 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4290068162194444a3f4d05ad418ca30" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:36.404543 30241 leader_election.cc:304] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:36.389925 30473 tablet_bootstrap.cc:654] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.405781 30728 consensus_queue.cc:237] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
W20260709 12:19:36.407213 30244 leader_election.cc:343] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.404191 30474 tablet_bootstrap.cc:492] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:36.405787 30803 raft_consensus.cc:2804] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:36.409135 30803 raft_consensus.cc:493] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.409490 30803 raft_consensus.cc:3060] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.412570 30707 consensus_queue.cc:1048] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.414951 30474 tablet_bootstrap.cc:654] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.403069 30807 raft_consensus.cc:697] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:36.422362 30807 consensus_queue.cc:237] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.431677 30474 tablet_bootstrap.cc:492] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:36.432189 30474 ts_tablet_manager.cc:1403] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 12:19:36.408535 30426 raft_consensus.cc:2468] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:36.438695 30803 raft_consensus.cc:515] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.442342 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4290068162194444a3f4d05ad418ca30" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:36.442891 30423 raft_consensus.cc:3060] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.447160 30474 raft_consensus.cc:359] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.447865 30474 raft_consensus.cc:385] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.448269 30474 raft_consensus.cc:740] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.447805 30097 catalog_manager.cc:5697] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.454192 30101 catalog_manager.cc:5697] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.458639 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4290068162194444a3f4d05ad418ca30" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:36.459888 30474 consensus_queue.cc:260] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:36.461050 30244 leader_election.cc:343] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.464144 30472 tablet_bootstrap.cc:492] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:36.464990 30474 ts_tablet_manager.cc:1434] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 12:19:36.471405 30474 tablet_bootstrap.cc:492] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52: Bootstrap starting.
I20260709 12:19:36.458444 30803 leader_election.cc:290] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:36.473789 30349 raft_consensus.cc:3060] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.492780 30472 tablet_bootstrap.cc:654] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.493227 30707 consensus_queue.cc:1048] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.495568 30474 tablet_bootstrap.cc:654] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.512228 30423 raft_consensus.cc:2468] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:36.514879 30241 leader_election.cc:304] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:36.522300 30864 raft_consensus.cc:493] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.528653 30864 raft_consensus.cc:515] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.517254 30803 raft_consensus.cc:2804] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:36.533317 30803 raft_consensus.cc:697] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:36.534519 30803 consensus_queue.cc:237] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.536674 30802 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.537343 30802 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.546883 30802 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:36.549894 30421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:36.552412 30203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:36.552601 30759 raft_consensus.cc:493] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.554780 30864 leader_election.cc:290] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:36.555478 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e1306c0565463d9f7dd00b385e55c7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:36.559547 30471 tablet_bootstrap.cc:492] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:36.564678 30851 consensus_queue.cc:1048] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:36.582921 30471 ts_tablet_manager.cc:1403] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.208s	user 0.029s	sys 0.000s
I20260709 12:19:36.580574 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e1306c0565463d9f7dd00b385e55c7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:36.593231 30473 tablet_bootstrap.cc:492] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:36.593721 30473 ts_tablet_manager.cc:1403] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.223s	user 0.015s	sys 0.034s
I20260709 12:19:36.600751 30471 raft_consensus.cc:359] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.601432 30471 raft_consensus.cc:385] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.601692 30471 raft_consensus.cc:740] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
W20260709 12:19:36.590410 30244 leader_election.cc:343] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:36.602218 30241 leader_election.cc:343] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.602327 30471 consensus_queue.cc:260] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.587620 30201 raft_consensus.cc:2468] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:36.604250 30241 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:36.605382 30318 leader_election.cc:304] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:36.606801 30728 raft_consensus.cc:2749] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:36.608217 30807 raft_consensus.cc:2804] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:36.608743 30807 raft_consensus.cc:493] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.609189 30807 raft_consensus.cc:3060] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:36.624948 30167 consensus_peers.cc:597] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:36.628798 30315 leader_election.cc:343] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.586201 30759 raft_consensus.cc:515] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.667447 30474 tablet_bootstrap.cc:492] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52: No bootstrap required, opened a new log
I20260709 12:19:36.667992 30474 ts_tablet_manager.cc:1403] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52: Time spent bootstrapping tablet: real 0.197s	user 0.044s	sys 0.027s
I20260709 12:19:36.676448 30471 ts_tablet_manager.cc:1434] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.092s	user 0.015s	sys 0.010s
I20260709 12:19:36.658304 30802 raft_consensus.cc:493] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.682448 30474 raft_consensus.cc:359] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.683322 30474 raft_consensus.cc:385] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.683696 30474 raft_consensus.cc:740] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.684689 30474 consensus_queue.cc:260] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
W20260709 12:19:36.693274 30168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 72266.5us
I20260709 12:19:36.704603 30471 tablet_bootstrap.cc:492] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:36.716315 30474 ts_tablet_manager.cc:1434] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:19:36.693480 30802 raft_consensus.cc:515] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.720265 30802 leader_election.cc:290] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:36.693452 30851 consensus_queue.cc:1048] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:19:36.724134 30472 tablet_bootstrap.cc:492] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:36.724613 30472 ts_tablet_manager.cc:1403] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.261s	user 0.026s	sys 0.055s
I20260709 12:19:36.721966 30473 raft_consensus.cc:359] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.730775 30473 raft_consensus.cc:385] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.731106 30473 raft_consensus.cc:740] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.736886 30473 consensus_queue.cc:260] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.715626 30799 raft_consensus.cc:493] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.713083 30707 consensus_queue.cc:1048] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 12:19:36.750635 30759 leader_election.cc:290] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:36.753463 30807 raft_consensus.cc:515] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.753835 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:36.749670 30472 raft_consensus.cc:359] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.754770 30472 raft_consensus.cc:385] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.755060 30472 raft_consensus.cc:740] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:36.757292 30473 ts_tablet_manager.cc:1434] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.163s	user 0.003s	sys 0.004s
W20260709 12:19:36.732734 30242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 93956us
I20260709 12:19:36.765633 30201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:36.766007 30471 tablet_bootstrap.cc:654] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.746691 30799 raft_consensus.cc:515] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.769100 30728 raft_consensus.cc:493] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.769673 30807 leader_election.cc:290] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:36.769582 30728 raft_consensus.cc:515] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.770406 30799 leader_election.cc:290] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:36.771756 30728 leader_election.cc:290] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
W20260709 12:19:36.773913 30244 leader_election.cc:343] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.774258 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:36.774912 30472 consensus_queue.cc:260] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.740662 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:36.776556 30390 leader_election.cc:343] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.783818 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0bb2451c3442cab4eee04748a2baa0" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:36.789348 30473 tablet_bootstrap.cc:492] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
W20260709 12:19:36.792807 30241 leader_election.cc:343] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.794358 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e1306c0565463d9f7dd00b385e55c7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:36.794929 30200 raft_consensus.cc:3060] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.790616 30275 raft_consensus.cc:2468] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:36.798247 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:36.800625 30274 raft_consensus.cc:2468] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
W20260709 12:19:36.798606 30167 leader_election.cc:343] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.804977 30884 raft_consensus.cc:493] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.805435 30884 raft_consensus.cc:515] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:36.807452 30884 leader_election.cc:290] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:36.811951 30472 ts_tablet_manager.cc:1434] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:19:36.816527 30168 leader_election.cc:304] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:36.831480 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:36.823734 30707 raft_consensus.cc:2804] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:36.832414 30707 raft_consensus.cc:493] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.832852 30707 raft_consensus.cc:3060] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.837118 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4290068162194444a3f4d05ad418ca30" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:36.837984 30418 raft_consensus.cc:2393] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 777b1410f165436aa725262b964ff0a6 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:36.837852 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4290068162194444a3f4d05ad418ca30" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:36.845162 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22e1306c0565463d9f7dd00b385e55c7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:36.845775 30423 raft_consensus.cc:3060] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.848433 30472 tablet_bootstrap.cc:492] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:36.815773 30200 raft_consensus.cc:2468] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:36.856003 30168 leader_election.cc:304] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:36.856850 30891 consensus_queue.cc:1048] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:36.860949 30242 leader_election.cc:343] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.861243 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0bb2451c3442cab4eee04748a2baa0" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:36.863612 30318 leader_election.cc:304] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:36.864450 30890 raft_consensus.cc:2804] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:36.861408 30750 raft_consensus.cc:3060] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:36.865157 30890 raft_consensus.cc:697] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:36.866031 30890 consensus_queue.cc:237] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.876801 30884 consensus_queue.cc:1048] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.867754 30707 raft_consensus.cc:515] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:36.876925 30423 raft_consensus.cc:2468] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:36.880985 30097 catalog_manager.cc:5697] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 0 to 1, leader changed from <none> to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:36.861443 30242 leader_election.cc:304] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
W20260709 12:19:36.914039 30149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:36.889207 30728 raft_consensus.cc:2749] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:36.890125 30391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 64292us
I20260709 12:19:36.931746 30707 leader_election.cc:290] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
W20260709 12:19:36.927150 30242 leader_election.cc:343] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.939688 30471 tablet_bootstrap.cc:492] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:36.942777 30471 ts_tablet_manager.cc:1403] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.239s	user 0.020s	sys 0.001s
I20260709 12:19:36.944639 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:36.948288 30750 raft_consensus.cc:2749] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:36.949441 30473 tablet_bootstrap.cc:654] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:36.951615 30167 leader_election.cc:343] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.951424 30099 catalog_manager.cc:5697] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:36.952272 30472 tablet_bootstrap.cc:654] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:36.952471 30242 leader_election.cc:304] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:36.954550 30728 raft_consensus.cc:2749] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:36.964748 30864 consensus_queue.cc:1048] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:36.936837 30391 leader_election.cc:304] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:36.967469 30897 raft_consensus.cc:2804] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:36.967860 30897 raft_consensus.cc:493] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:36.968197 30897 raft_consensus.cc:3060] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:36.974853 30315 consensus_peers.cc:597] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977): Couldn't send request to peer cf45045de3bd40b9a60aaaabe4322659. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:36.983021 30897 raft_consensus.cc:515] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.988363 30807 raft_consensus.cc:493] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:36.988857 30807 raft_consensus.cc:515] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:36.990957 30471 raft_consensus.cc:359] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:36.991394 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:37.005923 30473 tablet_bootstrap.cc:492] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:37.007196 30890 consensus_queue.cc:1048] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:37.008105 30390 leader_election.cc:343] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:36.991689 30471 raft_consensus.cc:385] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:36.998991 30807 leader_election.cc:290] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:37.008646 30471 raft_consensus.cc:740] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.000780 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:37.009617 30273 raft_consensus.cc:3060] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.009649 30471 consensus_queue.cc:260] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.002385 30472 tablet_bootstrap.cc:492] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:37.010906 30472 ts_tablet_manager.cc:1403] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.181s	user 0.011s	sys 0.003s
I20260709 12:19:36.999518 30276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:37.001927 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:37.034086 30426 raft_consensus.cc:2393] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 1: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:37.011360 30888 consensus_queue.cc:1048] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:37.013981 30471 ts_tablet_manager.cc:1434] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.071s	user 0.004s	sys 0.003s
I20260709 12:19:37.036377 30471 tablet_bootstrap.cc:492] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:37.006525 30473 ts_tablet_manager.cc:1403] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.217s	user 0.009s	sys 0.006s
I20260709 12:19:37.030685 30273 raft_consensus.cc:2468] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:37.002633 30897 leader_election.cc:290] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:37.039599 30391 leader_election.cc:304] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:37.031545 30890 consensus_queue.cc:1048] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:37.042439 30897 raft_consensus.cc:2804] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:37.037243 30472 raft_consensus.cc:359] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.043524 30348 raft_consensus.cc:3060] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.043679 30472 raft_consensus.cc:385] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.044255 30472 raft_consensus.cc:740] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.028203 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:37.047112 30278 raft_consensus.cc:3060] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.048089 30473 raft_consensus.cc:359] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.051129 30473 raft_consensus.cc:385] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.049208 30315 leader_election.cc:304] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:37.045894 30897 raft_consensus.cc:697] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:37.052194 30890 raft_consensus.cc:2749] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:37.052162 30897 consensus_queue.cc:237] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.052529 30728 consensus_queue.cc:1048] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:37.053483 30473 raft_consensus.cc:740] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.100075 30473 consensus_queue.cc:260] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.046672 30471 tablet_bootstrap.cc:654] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.066262 30472 consensus_queue.cc:260] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.081014 30278 raft_consensus.cc:2468] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:37.095970 30888 consensus_queue.cc:1048] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:37.107151 30472 ts_tablet_manager.cc:1434] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:19:37.107316 30168 leader_election.cc:304] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:37.108186 30472 tablet_bootstrap.cc:492] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:37.113466 30886 raft_consensus.cc:2804] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:37.114513 30886 raft_consensus.cc:697] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:37.117812 30886 consensus_queue.cc:237] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.118127 30101 catalog_manager.cc:5697] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:37.124918 30471 tablet_bootstrap.cc:492] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:37.125459 30471 ts_tablet_manager.cc:1403] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.009s
I20260709 12:19:37.102576 30473 ts_tablet_manager.cc:1434] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.065s	user 0.003s	sys 0.004s
I20260709 12:19:37.128515 30471 raft_consensus.cc:359] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.129199 30471 raft_consensus.cc:385] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.129518 30471 raft_consensus.cc:740] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.130002 30473 tablet_bootstrap.cc:492] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:37.130550 30472 tablet_bootstrap.cc:654] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.130398 30471 consensus_queue.cc:260] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.132807 30471 ts_tablet_manager.cc:1434] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:37.132761 30889 raft_consensus.cc:493] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.133391 30889 raft_consensus.cc:515] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.135731 30889 leader_election.cc:290] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:37.137038 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0bb2451c3442cab4eee04748a2baa0" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:37.137689 30471 tablet_bootstrap.cc:492] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:37.137989 30278 raft_consensus.cc:2468] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:37.137087 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0bb2451c3442cab4eee04748a2baa0" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:37.139241 30391 leader_election.cc:304] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:37.140192 30897 raft_consensus.cc:2804] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:37.140594 30897 raft_consensus.cc:493] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:37.140887 30390 leader_election.cc:343] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:37.140941 30897 raft_consensus.cc:3060] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.181061 30888 consensus_queue.cc:1048] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:37.200773 30099 catalog_manager.cc:5697] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.206548 30473 tablet_bootstrap.cc:654] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.216162 30897 raft_consensus.cc:515] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.217640 30472 tablet_bootstrap.cc:492] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:37.218128 30472 ts_tablet_manager.cc:1403] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.047s
I20260709 12:19:37.216223 30471 tablet_bootstrap.cc:654] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.220839 30472 raft_consensus.cc:359] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.222442 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0bb2451c3442cab4eee04748a2baa0" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:37.223016 30472 raft_consensus.cc:385] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.223444 30472 raft_consensus.cc:740] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.224418 30472 consensus_queue.cc:260] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
W20260709 12:19:37.225697 30390 leader_election.cc:343] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:37.221462 30897 leader_election.cc:290] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:37.228545 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0bb2451c3442cab4eee04748a2baa0" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:37.235518 30278 raft_consensus.cc:3060] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.231211 30472 ts_tablet_manager.cc:1434] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:19:37.231861 30471 tablet_bootstrap.cc:492] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:37.236812 30471 ts_tablet_manager.cc:1403] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.001s
I20260709 12:19:37.239882 30471 raft_consensus.cc:359] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:37.240510 30471 raft_consensus.cc:385] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.240772 30471 raft_consensus.cc:740] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.241403 30471 consensus_queue.cc:260] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:37.243551 30471 ts_tablet_manager.cc:1434] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:37.242609 30278 raft_consensus.cc:2468] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:37.244562 30471 tablet_bootstrap.cc:492] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:37.245005 30473 tablet_bootstrap.cc:492] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:37.245442 30473 ts_tablet_manager.cc:1403] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.116s	user 0.008s	sys 0.007s
I20260709 12:19:37.247076 30391 leader_election.cc:304] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:37.248356 30473 raft_consensus.cc:359] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.248692 30851 raft_consensus.cc:2804] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:37.249065 30473 raft_consensus.cc:385] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.249375 30473 raft_consensus.cc:740] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.249485 30851 raft_consensus.cc:697] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:37.250102 30473 consensus_queue.cc:260] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.250609 30851 consensus_queue.cc:237] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.252518 30473 ts_tablet_manager.cc:1434] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:37.253485 30472 tablet_bootstrap.cc:492] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:37.261778 30473 tablet_bootstrap.cc:492] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:37.269721 30101 catalog_manager.cc:5697] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:37.270910 30473 tablet_bootstrap.cc:654] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.271499 30471 tablet_bootstrap.cc:654] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.274327 30472 tablet_bootstrap.cc:654] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.283648 30471 tablet_bootstrap.cc:492] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:37.284126 30471 ts_tablet_manager.cc:1403] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 12:19:37.284271 30473 tablet_bootstrap.cc:492] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:37.284974 30473 ts_tablet_manager.cc:1403] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 12:19:37.286808 30471 raft_consensus.cc:359] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.287384 30471 raft_consensus.cc:385] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.287609 30471 raft_consensus.cc:740] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.287712 30473 raft_consensus.cc:359] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.288431 30473 raft_consensus.cc:385] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.288223 30471 consensus_queue.cc:260] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.288739 30473 raft_consensus.cc:740] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.289566 30473 consensus_queue.cc:260] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.290190 30471 ts_tablet_manager.cc:1434] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:37.291326 30472 tablet_bootstrap.cc:492] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:37.293617 30472 ts_tablet_manager.cc:1403] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.000s
I20260709 12:19:37.292282 30471 tablet_bootstrap.cc:492] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659: Bootstrap starting.
I20260709 12:19:37.296069 30473 ts_tablet_manager.cc:1434] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:19:37.296241 30472 raft_consensus.cc:359] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.296972 30472 raft_consensus.cc:385] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.297076 30473 tablet_bootstrap.cc:492] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:37.297247 30472 raft_consensus.cc:740] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.297945 30472 consensus_queue.cc:260] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.300285 30672 raft_consensus.cc:493] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.300720 30672 raft_consensus.cc:515] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.306447 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:37.307837 30473 tablet_bootstrap.cc:654] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.309599 30426 raft_consensus.cc:3060] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.314144 30672 leader_election.cc:290] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:37.315799 30472 ts_tablet_manager.cc:1434] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.002s
I20260709 12:19:37.315865 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:37.318449 30317 leader_election.cc:304] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:37.319540 30672 raft_consensus.cc:2749] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:37.320283 30472 tablet_bootstrap.cc:492] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:37.326460 30472 tablet_bootstrap.cc:654] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.330857 30471 tablet_bootstrap.cc:654] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.340142 30473 tablet_bootstrap.cc:492] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: No bootstrap required, opened a new log
I20260709 12:19:37.340675 30473 ts_tablet_manager.cc:1403] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.044s	user 0.007s	sys 0.005s
I20260709 12:19:37.343832 30472 tablet_bootstrap.cc:492] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:37.344456 30472 ts_tablet_manager.cc:1403] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.007s
I20260709 12:19:37.347759 30471 tablet_bootstrap.cc:492] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659: No bootstrap required, opened a new log
I20260709 12:19:37.348238 30471 ts_tablet_manager.cc:1403] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.003s
I20260709 12:19:37.348274 30473 raft_consensus.cc:359] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:37.349047 30473 raft_consensus.cc:385] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.349074 30472 raft_consensus.cc:359] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.349848 30472 raft_consensus.cc:385] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.349463 30473 raft_consensus.cc:740] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.350113 30472 raft_consensus.cc:740] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.350762 30471 raft_consensus.cc:359] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.351498 30471 raft_consensus.cc:385] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.351768 30471 raft_consensus.cc:740] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.352471 30471 consensus_queue.cc:260] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.354490 30471 ts_tablet_manager.cc:1434] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:19:37.355304 30472 consensus_queue.cc:260] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.350868 30473 consensus_queue.cc:260] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:37.360263 30472 ts_tablet_manager.cc:1434] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:19:37.363817 30472 tablet_bootstrap.cc:492] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:37.364114 30897 raft_consensus.cc:493] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.364611 30897 raft_consensus.cc:515] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.367442 30897 leader_election.cc:290] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:37.368713 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cef54b2bf92402f9064be5769a44bd9" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:37.369414 30202 raft_consensus.cc:2468] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 0.
I20260709 12:19:37.370573 30392 leader_election.cc:304] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:37.371361 30472 tablet_bootstrap.cc:654] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.368713 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cef54b2bf92402f9064be5769a44bd9" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:37.374118 30851 raft_consensus.cc:2804] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:19:37.374315 30390 leader_election.cc:343] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:37.374580 30851 raft_consensus.cc:493] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.374980 30851 raft_consensus.cc:3060] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.384680 30472 tablet_bootstrap.cc:492] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:37.385299 30472 ts_tablet_manager.cc:1403] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.001s
I20260709 12:19:37.385730 30473 ts_tablet_manager.cc:1434] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.002s
I20260709 12:19:37.384686 30851 raft_consensus.cc:515] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.387866 30472 raft_consensus.cc:359] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.392253 30472 raft_consensus.cc:385] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.392607 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cef54b2bf92402f9064be5769a44bd9" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:37.392592 30472 raft_consensus.cc:740] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.393298 30202 raft_consensus.cc:3060] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.393702 30472 consensus_queue.cc:260] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.395823 30472 ts_tablet_manager.cc:1434] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:19:37.397022 30472 tablet_bootstrap.cc:492] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:37.403028 30472 tablet_bootstrap.cc:654] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.405186 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cef54b2bf92402f9064be5769a44bd9" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
W20260709 12:19:37.407738 30390 leader_election.cc:343] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:37.409420 30864 consensus_queue.cc:1048] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:37.413283 30202 raft_consensus.cc:2468] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:37.392809 30851 leader_election.cc:290] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:37.415091 30392 leader_election.cc:304] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:37.415810 30851 raft_consensus.cc:2804] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:37.416504 30851 raft_consensus.cc:697] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:37.418215 30851 consensus_queue.cc:237] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.422912 30472 tablet_bootstrap.cc:492] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:37.423439 30472 ts_tablet_manager.cc:1403] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.011s
I20260709 12:19:37.425943 30472 raft_consensus.cc:359] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.426776 30472 raft_consensus.cc:385] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.427116 30472 raft_consensus.cc:740] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.427995 30472 consensus_queue.cc:260] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.430449 30472 ts_tablet_manager.cc:1434] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:37.431484 30472 tablet_bootstrap.cc:492] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268: Bootstrap starting.
I20260709 12:19:37.440630 30472 tablet_bootstrap.cc:654] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:37.441557 30097 catalog_manager.cc:5697] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 1 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.455783 30890 raft_consensus.cc:493] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.456256 30890 raft_consensus.cc:515] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.456823 30472 tablet_bootstrap.cc:492] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268: No bootstrap required, opened a new log
I20260709 12:19:37.457753 30472 ts_tablet_manager.cc:1403] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.008s
I20260709 12:19:37.459790 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:37.460134 30346 raft_consensus.cc:3060] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.460479 30202 raft_consensus.cc:2468] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:37.460317 30472 raft_consensus.cc:359] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.461050 30472 raft_consensus.cc:385] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:37.461314 30472 raft_consensus.cc:740] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Initialized, Role: FOLLOWER
I20260709 12:19:37.461920 30472 consensus_queue.cc:260] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.462988 30807 consensus_queue.cc:1048] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:37.463850 30472 ts_tablet_manager.cc:1434] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 12:19:37.466867 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:37.467478 30426 raft_consensus.cc:2468] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 0.
I20260709 12:19:37.468564 30315 leader_election.cc:304] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:37.469559 30807 raft_consensus.cc:2804] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:37.470085 30807 raft_consensus.cc:493] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.466975 30890 leader_election.cc:290] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:37.474843 30672 raft_consensus.cc:493] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.475710 30672 raft_consensus.cc:515] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.470515 30807 raft_consensus.cc:3060] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.483035 30672 leader_election.cc:290] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:37.489488 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:37.496861 30202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:37.498342 30349 raft_consensus.cc:3060] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.509298 30275 raft_consensus.cc:2393] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 1: Already voted for candidate 777b1410f165436aa725262b964ff0a6 in this term.
I20260709 12:19:37.510699 30317 leader_election.cc:304] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:37.511773 30672 raft_consensus.cc:3060] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.506448 30897 consensus_queue.cc:1048] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:19:37.519786 30672 raft_consensus.cc:2749] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:37.529628 30897 consensus_queue.cc:1048] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:37.531383 30807 raft_consensus.cc:515] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.533888 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:37.534510 30426 raft_consensus.cc:3060] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.544035 30426 raft_consensus.cc:2468] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:37.545290 30315 leader_election.cc:304] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:37.545599 30750 consensus_queue.cc:1048] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:37.546132 30672 raft_consensus.cc:2804] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:37.546679 30672 raft_consensus.cc:697] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:37.547497 30672 consensus_queue.cc:237] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.563324 30807 leader_election.cc:290] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:37.564611 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:37.565382 30200 raft_consensus.cc:3060] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.587018 30200 raft_consensus.cc:2468] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:37.601166 30707 consensus_queue.cc:1048] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:37.611012 30707 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.612162 30707 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:37.619184 30707 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:37.618592 30097 catalog_manager.cc:5697] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.619999 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:37.620676 30418 raft_consensus.cc:2468] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:37.621111 30672 raft_consensus.cc:493] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.621616 30672 raft_consensus.cc:515] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:37.622658 30166 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:37.623752 30545 raft_consensus.cc:2804] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:37.624083 30545 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.624372 30545 raft_consensus.cc:3060] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.624495 30672 leader_election.cc:290] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:37.626895 30200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cef54b2bf92402f9064be5769a44bd9" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:37.627239 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:37.627733 30200 raft_consensus.cc:2393] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 1: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
I20260709 12:19:37.627920 30275 raft_consensus.cc:2468] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:37.629794 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cef54b2bf92402f9064be5769a44bd9" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:37.631906 30315 leader_election.cc:304] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:37.634517 30672 raft_consensus.cc:3060] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.636858 30545 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:37.640077 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:37.641364 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:37.641847 30418 raft_consensus.cc:3060] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.641975 30273 raft_consensus.cc:3060] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.642252 30672 raft_consensus.cc:2749] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:37.640806 30545 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:37.649061 30418 raft_consensus.cc:2468] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:37.650319 30166 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:37.651165 30545 raft_consensus.cc:2804] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:37.653116 30545 raft_consensus.cc:697] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:37.653839 30545 consensus_queue.cc:237] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:37.658999 30273 raft_consensus.cc:2468] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:37.665889 30101 catalog_manager.cc:5697] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.711866 30807 raft_consensus.cc:493] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.712302 30807 raft_consensus.cc:515] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:37.714362 30807 leader_election.cc:290] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:37.714982 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0bb2451c3442cab4eee04748a2baa0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:37.715278 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e0bb2451c3442cab4eee04748a2baa0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:37.715971 30273 raft_consensus.cc:2393] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 1: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
I20260709 12:19:37.717020 30317 leader_election.cc:304] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:37.717684 30807 raft_consensus.cc:3060] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.722765 30807 raft_consensus.cc:2749] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:37.740820 30545 raft_consensus.cc:493] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:37.741418 30545 raft_consensus.cc:515] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.743201 30545 leader_election.cc:290] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:37.744148 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:37.744670 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:37.744912 30346 raft_consensus.cc:2468] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:37.745429 30278 raft_consensus.cc:2468] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 0.
I20260709 12:19:37.746245 30167 leader_election.cc:304] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:37.747632 30545 raft_consensus.cc:2804] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:37.747957 30545 raft_consensus.cc:493] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:37.748279 30545 raft_consensus.cc:3060] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.748250 30897 consensus_queue.cc:1048] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:37.761401 30545 raft_consensus.cc:515] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.764191 30545 leader_election.cc:290] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:37.766445 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:37.766624 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:37.766552 30851 consensus_queue.cc:1048] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:19:37.767239 30273 raft_consensus.cc:3060] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.767349 30346 raft_consensus.cc:3060] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:37.775324 30346 raft_consensus.cc:2468] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:37.776721 30167 leader_election.cc:304] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:37.778687 30273 raft_consensus.cc:2468] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 1.
I20260709 12:19:37.779719 30545 raft_consensus.cc:2804] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:37.780303 30545 raft_consensus.cc:697] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:37.781155 30545 consensus_queue.cc:237] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:37.798338 30097 catalog_manager.cc:5697] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.814570 30889 consensus_queue.cc:1048] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:37.815331 30851 consensus_queue.cc:1048] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:38.050642 30807 consensus_queue.cc:1048] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:38.060827 30807 consensus_queue.cc:1048] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:38.113845 30545 consensus_queue.cc:1048] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:38.132077 30545 consensus_queue.cc:1048] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:38.301074 30750 consensus_queue.cc:1048] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:38.315541 30886 consensus_queue.cc:1048] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:38.773665 22720 tablet_server.cc:179] TabletServer@127.22.48.1:0 shutting down...
W20260709 12:19:38.798072 30392 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 310 similar messages]
I20260709 12:19:38.836161 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:19:38.837781 30318 consensus_peers.cc:597] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:38.842598 30392 consensus_peers.cc:597] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:38.842794 30244 consensus_peers.cc:597] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:38.838740 22720 tablet_replica.cc:333] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.845955 22720 raft_consensus.cc:2243] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.847007 22720 raft_consensus.cc:2272] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.850432 22720 tablet_replica.cc:333] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.851333 22720 raft_consensus.cc:2243] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.851854 22720 raft_consensus.cc:2272] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.853786 22720 tablet_replica.cc:333] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.854492 22720 raft_consensus.cc:2243] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:38.854545 30392 consensus_peers.cc:597] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:38.855031 22720 raft_consensus.cc:2272] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.857506 22720 tablet_replica.cc:333] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.858100 22720 raft_consensus.cc:2243] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.858527 22720 raft_consensus.cc:2272] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.860296 22720 tablet_replica.cc:333] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.860900 22720 raft_consensus.cc:2243] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.861590 22720 raft_consensus.cc:2272] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:38.863049 30392 consensus_peers.cc:597] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:38.863781 22720 tablet_replica.cc:333] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.864624 22720 raft_consensus.cc:2243] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.865126 22720 raft_consensus.cc:2272] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.867388 22720 tablet_replica.cc:333] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.868012 22720 raft_consensus.cc:2243] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.868429 22720 raft_consensus.cc:2272] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.870137 22720 tablet_replica.cc:333] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.870714 22720 raft_consensus.cc:2243] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.871100 22720 raft_consensus.cc:2272] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.872678 22720 tablet_replica.cc:333] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.873245 22720 raft_consensus.cc:2243] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.874143 22720 raft_consensus.cc:2272] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.876163 22720 tablet_replica.cc:333] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.876729 22720 raft_consensus.cc:2243] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.877187 22720 raft_consensus.cc:2272] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.878937 22720 tablet_replica.cc:333] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.879525 22720 raft_consensus.cc:2243] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.879942 22720 raft_consensus.cc:2272] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.881901 22720 tablet_replica.cc:333] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.882692 22720 raft_consensus.cc:2243] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.883092 22720 raft_consensus.cc:2272] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.887166 22720 tablet_replica.cc:333] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.887784 22720 raft_consensus.cc:2243] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.888587 22720 raft_consensus.cc:2272] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.890760 22720 tablet_replica.cc:333] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.891494 22720 raft_consensus.cc:2243] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.891896 22720 raft_consensus.cc:2272] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.893468 22720 tablet_replica.cc:333] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.894003 22720 raft_consensus.cc:2243] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.894441 22720 raft_consensus.cc:2272] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.896126 22720 tablet_replica.cc:333] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.896667 22720 raft_consensus.cc:2243] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.897348 22720 raft_consensus.cc:2272] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.899014 22720 tablet_replica.cc:333] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.899482 22720 raft_consensus.cc:2243] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.900187 22720 raft_consensus.cc:2272] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.901738 22720 tablet_replica.cc:333] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.902215 22720 raft_consensus.cc:2243] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.902613 22720 raft_consensus.cc:2272] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.904318 22720 tablet_replica.cc:333] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.904788 22720 raft_consensus.cc:2243] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.905297 22720 raft_consensus.cc:2272] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.907614 22720 tablet_replica.cc:333] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.908396 22720 raft_consensus.cc:2243] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.909314 22720 raft_consensus.cc:2272] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.911168 22720 tablet_replica.cc:333] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.911724 22720 raft_consensus.cc:2243] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.912413 22720 raft_consensus.cc:2272] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.914131 22720 tablet_replica.cc:333] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.914914 22720 raft_consensus.cc:2243] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.915808 22720 raft_consensus.cc:2272] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.918082 22720 tablet_replica.cc:333] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
W20260709 12:19:38.918476 30392 consensus_peers.cc:597] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:38.918637 22720 raft_consensus.cc:2243] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.919507 22720 raft_consensus.cc:2272] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.921629 22720 tablet_replica.cc:333] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.922425 22720 raft_consensus.cc:2243] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.923311 22720 raft_consensus.cc:2272] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.925802 22720 tablet_replica.cc:333] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
W20260709 12:19:38.926316 30244 consensus_peers.cc:597] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:38.926637 22720 raft_consensus.cc:2243] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.927418 22720 raft_consensus.cc:2272] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.929505 22720 tablet_replica.cc:333] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.930009 22720 raft_consensus.cc:2243] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.930732 22720 raft_consensus.cc:2272] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.932796 22720 tablet_replica.cc:333] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.933341 22720 raft_consensus.cc:2243] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.934080 22720 raft_consensus.cc:2272] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:38.934755 30392 consensus_peers.cc:597] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:38.935910 22720 tablet_replica.cc:333] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.936509 22720 raft_consensus.cc:2243] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.937198 22720 raft_consensus.cc:2272] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.939219 22720 tablet_replica.cc:333] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.939877 22720 raft_consensus.cc:2243] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.940704 22720 raft_consensus.cc:2272] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.942690 22720 tablet_replica.cc:333] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.943279 22720 raft_consensus.cc:2243] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.943979 22720 raft_consensus.cc:2272] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.945528 22720 tablet_replica.cc:333] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.946043 22720 raft_consensus.cc:2243] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.946486 22720 raft_consensus.cc:2272] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.948342 22720 tablet_replica.cc:333] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.949013 22720 raft_consensus.cc:2243] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.949473 22720 raft_consensus.cc:2272] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.951483 22720 tablet_replica.cc:333] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.951970 22720 raft_consensus.cc:2243] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.952741 22720 raft_consensus.cc:2272] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.954604 22720 tablet_replica.cc:333] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.955174 22720 raft_consensus.cc:2243] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.956192 22720 raft_consensus.cc:2272] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.958072 22720 tablet_replica.cc:333] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.958644 22720 raft_consensus.cc:2243] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.959537 22720 raft_consensus.cc:2272] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.961688 22720 tablet_replica.cc:333] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.962146 22720 raft_consensus.cc:2243] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.962559 22720 raft_consensus.cc:2272] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.964259 22720 tablet_replica.cc:333] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.964802 22720 raft_consensus.cc:2243] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.965459 22720 raft_consensus.cc:2272] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.967072 22720 tablet_replica.cc:333] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.967521 22720 raft_consensus.cc:2243] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.967885 22720 raft_consensus.cc:2272] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.969591 22720 tablet_replica.cc:333] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.970113 22720 raft_consensus.cc:2243] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.970979 22720 raft_consensus.cc:2272] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.973199 22720 tablet_replica.cc:333] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.973950 22720 raft_consensus.cc:2243] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:19:38.974308 30244 consensus_peers.cc:597] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:38.974800 22720 raft_consensus.cc:2272] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.976536 22720 tablet_replica.cc:333] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.977061 22720 raft_consensus.cc:2243] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.977798 22720 raft_consensus.cc:2272] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.979825 22720 tablet_replica.cc:333] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.980378 22720 raft_consensus.cc:2243] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.980763 22720 raft_consensus.cc:2272] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.982717 22720 tablet_replica.cc:333] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.983199 22720 raft_consensus.cc:2243] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.983618 22720 raft_consensus.cc:2272] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.985600 22720 tablet_replica.cc:333] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.986070 22720 raft_consensus.cc:2243] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.986477 22720 raft_consensus.cc:2272] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.988063 22720 tablet_replica.cc:333] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: stopping tablet replica
I20260709 12:19:38.988538 22720 raft_consensus.cc:2243] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:38.989252 22720 raft_consensus.cc:2272] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:39.004678 30318 consensus_peers.cc:597] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:39.014883 30244 consensus_peers.cc:597] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:39.029907 30244 consensus_peers.cc:597] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:39.036443 30318 consensus_peers.cc:597] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:39.037838 30244 consensus_peers.cc:597] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:39.051542 22720 tablet_server.cc:196] TabletServer@127.22.48.1:0 shutdown complete.
W20260709 12:19:39.078734 30244 consensus_peers.cc:597] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:39.114988 30244 consensus_peers.cc:597] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:39.120409 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:39.127506 30956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:39.129036 30957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:39.131783 22720 server_base.cc:1061] running on GCE node
W20260709 12:19:39.132272 30959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:39.137830 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:39.139482 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:39.139660 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599579139647 us; error 0 us; skew 500 ppm
I20260709 12:19:39.140225 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:39.142997 22720 webserver.cc:533] Webserver started at http://127.22.48.1:42345/ using document root <none> and password file <none>
I20260709 12:19:39.143450 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:39.143604 22720 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:19:39.147420 22720 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:19:39.156469 30965 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:39.157411 22720 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:19:39.157776 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "777b1410f165436aa725262b964ff0a6"
format_stamp: "Formatted at 2026-07-09 12:19:27 on dist-test-slave-044g"
W20260709 12:19:39.157982 30392 consensus_peers.cc:597] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:39.158294 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:39.169749 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:39.171082 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:39.172530 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:39.176965 30972 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:19:39.250790 30244 consensus_peers.cc:597] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:39.289302 30392 consensus_peers.cc:597] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:39.347986 30318 consensus_peers.cc:597] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:39.425788 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:19:39.426226 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.250s	user 0.008s	sys 0.000s
I20260709 12:19:39.426626 22720 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:19:39.433849 30972 tablet_bootstrap.cc:492] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.446399 30972 tablet_bootstrap.cc:492] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.447325 30972 tablet_bootstrap.cc:492] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.447955 30972 ts_tablet_manager.cc:1403] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:19:39.450489 30972 raft_consensus.cc:359] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.451180 30972 raft_consensus.cc:740] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.451889 30972 consensus_queue.cc:260] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.460366 30972 ts_tablet_manager.cc:1434] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.006s
I20260709 12:19:39.461187 30972 tablet_bootstrap.cc:492] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.483295 30972 tablet_bootstrap.cc:492] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.484180 30972 tablet_bootstrap.cc:492] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.484814 30972 ts_tablet_manager.cc:1403] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.001s
I20260709 12:19:39.487337 30972 raft_consensus.cc:359] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.487993 30972 raft_consensus.cc:740] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.488615 30972 consensus_queue.cc:260] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.490381 30972 ts_tablet_manager.cc:1434] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:19:39.491107 30972 tablet_bootstrap.cc:492] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.504323 30972 tablet_bootstrap.cc:492] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.505045 30972 tablet_bootstrap.cc:492] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.505620 30972 ts_tablet_manager.cc:1403] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:19:39.507355 30972 raft_consensus.cc:359] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.507838 30972 raft_consensus.cc:740] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.508427 30972 consensus_queue.cc:260] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.509747 30972 ts_tablet_manager.cc:1434] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:39.510377 30972 tablet_bootstrap.cc:492] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.520632 30972 tablet_bootstrap.cc:492] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.521415 30972 tablet_bootstrap.cc:492] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.522006 30972 ts_tablet_manager.cc:1403] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:19:39.524115 30972 raft_consensus.cc:359] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.524747 30972 raft_consensus.cc:740] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.525355 30972 consensus_queue.cc:260] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.527323 30972 ts_tablet_manager.cc:1434] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:19:39.528097 30972 tablet_bootstrap.cc:492] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.549322 30972 tablet_bootstrap.cc:492] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.550241 30972 tablet_bootstrap.cc:492] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.550824 30972 ts_tablet_manager.cc:1403] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.000s
I20260709 12:19:39.552480 30972 raft_consensus.cc:359] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:39.552986 30972 raft_consensus.cc:740] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.553467 30972 consensus_queue.cc:260] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:39.554788 30972 ts_tablet_manager.cc:1434] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:39.555573 30972 tablet_bootstrap.cc:492] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.567492 30972 tablet_bootstrap.cc:492] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.568395 30972 tablet_bootstrap.cc:492] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.569010 30972 ts_tablet_manager.cc:1403] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:19:39.571183 30972 raft_consensus.cc:359] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:39.571816 30972 raft_consensus.cc:740] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.572413 30972 consensus_queue.cc:260] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:39.574663 30972 ts_tablet_manager.cc:1434] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:19:39.575393 30972 tablet_bootstrap.cc:492] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.588670 30972 tablet_bootstrap.cc:492] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.589526 30972 tablet_bootstrap.cc:492] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.590091 30972 ts_tablet_manager.cc:1403] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 12:19:39.592345 30972 raft_consensus.cc:359] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.593032 30972 raft_consensus.cc:740] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.593672 30972 consensus_queue.cc:260] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.595556 30972 ts_tablet_manager.cc:1434] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:39.596292 30972 tablet_bootstrap.cc:492] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.611748 30972 tablet_bootstrap.cc:492] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.612612 30972 tablet_bootstrap.cc:492] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.613198 30972 ts_tablet_manager.cc:1403] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:19:39.615386 30972 raft_consensus.cc:359] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.616034 30972 raft_consensus.cc:740] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.616667 30972 consensus_queue.cc:260] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.618463 30972 ts_tablet_manager.cc:1434] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:19:39.619163 30972 tablet_bootstrap.cc:492] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.632339 30972 tablet_bootstrap.cc:492] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.633648 30972 tablet_bootstrap.cc:492] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.634334 30972 ts_tablet_manager.cc:1403] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:19:39.636546 30972 raft_consensus.cc:359] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.637250 30972 raft_consensus.cc:740] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.637944 30972 consensus_queue.cc:260] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.639909 30972 ts_tablet_manager.cc:1434] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:39.640694 30972 tablet_bootstrap.cc:492] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.659631 30972 tablet_bootstrap.cc:492] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.660490 30972 tablet_bootstrap.cc:492] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.661099 30972 ts_tablet_manager.cc:1403] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 12:19:39.663473 30972 raft_consensus.cc:359] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.664330 30972 raft_consensus.cc:740] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.664958 30972 consensus_queue.cc:260] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.666486 30972 ts_tablet_manager.cc:1434] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:19:39.666752 22720 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:19:39.667064 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.240s	user 0.228s	sys 0.000s
I20260709 12:19:39.667127 30972 tablet_bootstrap.cc:492] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.691283 30972 tablet_bootstrap.cc:492] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.692365 30972 tablet_bootstrap.cc:492] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.693131 30972 ts_tablet_manager.cc:1403] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.026s	user 0.023s	sys 0.000s
I20260709 12:19:39.696103 30972 raft_consensus.cc:359] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.696868 30972 raft_consensus.cc:740] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.697698 30972 consensus_queue.cc:260] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.700177 30972 ts_tablet_manager.cc:1434] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:39.701095 30972 tablet_bootstrap.cc:492] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.718941 30972 tablet_bootstrap.cc:492] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.719942 30972 tablet_bootstrap.cc:492] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.720541 30972 ts_tablet_manager.cc:1403] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 12:19:39.722448 30972 raft_consensus.cc:359] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.722980 30972 raft_consensus.cc:740] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.723660 30972 consensus_queue.cc:260] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.725417 30972 ts_tablet_manager.cc:1434] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:19:39.726130 30972 tablet_bootstrap.cc:492] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.766332 30972 tablet_bootstrap.cc:492] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.767083 30972 tablet_bootstrap.cc:492] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.767669 30972 ts_tablet_manager.cc:1403] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.042s	user 0.016s	sys 0.020s
I20260709 12:19:39.769459 30972 raft_consensus.cc:359] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.769979 30972 raft_consensus.cc:740] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.770668 30972 consensus_queue.cc:260] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.772459 30972 ts_tablet_manager.cc:1434] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:39.773120 30972 tablet_bootstrap.cc:492] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.776811 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:33137
I20260709 12:19:39.776907 31045 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:33137 every 8 connection(s)
I20260709 12:19:39.790216 30972 tablet_bootstrap.cc:492] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.791757 30972 tablet_bootstrap.cc:492] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.792647 30972 ts_tablet_manager.cc:1403] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 12:19:39.861960 30972 raft_consensus.cc:359] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.863025 30972 raft_consensus.cc:740] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.863976 30972 consensus_queue.cc:260] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.866156 30972 ts_tablet_manager.cc:1434] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.073s	user 0.018s	sys 0.008s
I20260709 12:19:39.867313 30972 tablet_bootstrap.cc:492] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:39.870814 30973 raft_consensus.cc:493] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:39.871390 30973 raft_consensus.cc:515] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.873533 30973 leader_election.cc:290] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:39.881328 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:39.888352 30973 raft_consensus.cc:493] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:39.889124 30973 raft_consensus.cc:515] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:39.891703 30973 leader_election.cc:290] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:39.921288 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:39.949916 30973 raft_consensus.cc:493] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:39.950465 30973 raft_consensus.cc:515] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:39.952559 30973 leader_election.cc:290] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:39.954378 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:39.960491 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:39.961512 31018 raft_consensus.cc:2468] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:39.962215 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:39.963310 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:39.968341 30244 leader_election.cc:304] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:39.969132 30973 raft_consensus.cc:2804] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:19:39.969627 30244 leader_election.cc:343] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:39.969718 30973 raft_consensus.cc:493] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:39.970196 30244 leader_election.cc:304] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:39.970548 30973 raft_consensus.cc:3060] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:39.971282 30244 leader_election.cc:343] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:39.971724 30244 leader_election.cc:304] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:39.972386 30874 raft_consensus.cc:2749] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:39.972785 30888 raft_consensus.cc:2749] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:39.975826 31056 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:39.976329 31056 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.979033 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:39.979266 31056 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:39.985697 31046 heartbeater.cc:344] Connected to a master server at 127.22.48.62:40753
I20260709 12:19:39.986243 31046 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:39.987203 31046 heartbeater.cc:507] Master 127.22.48.62:40753 requested a full tablet report, sending...
I20260709 12:19:39.987732 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:39.988336 31014 raft_consensus.cc:2468] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:39.989996 30972 tablet_bootstrap.cc:492] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:39.990581 30392 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:39.990952 30972 tablet_bootstrap.cc:492] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:39.991394 31051 raft_consensus.cc:2804] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:39.991612 30972 ts_tablet_manager.cc:1403] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.125s	user 0.027s	sys 0.012s
I20260709 12:19:39.991782 31051 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:39.992229 31051 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:39.993793 30973 raft_consensus.cc:515] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:39.994427 30972 raft_consensus.cc:359] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:39.995199 30972 raft_consensus.cc:740] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:39.995955 30807 raft_consensus.cc:493] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:39.995963 30972 consensus_queue.cc:260] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:39.996987 30807 raft_consensus.cc:515] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:39.997761 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:39.998396 31020 raft_consensus.cc:3060] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:39.998893 30972 ts_tablet_manager.cc:1434] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:39.999934 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.000006 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:40.002606 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.002776 31056 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.003252 31056 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.003695 30807 leader_election.cc:290] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
W20260709 12:19:40.004113 30318 leader_election.cc:343] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.004588 30318 leader_election.cc:304] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.005271 30972 tablet_bootstrap.cc:492] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:40.005596 31056 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.007162 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.007776 31020 raft_consensus.cc:2468] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.008216 30807 raft_consensus.cc:2749] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.008472 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.008837 30244 leader_election.cc:304] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.009099 31014 raft_consensus.cc:2468] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:40.009547 30973 leader_election.cc:290] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.009547 31054 raft_consensus.cc:2804] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.010254 31054 raft_consensus.cc:697] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:40.010377 30392 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:40.011284 31056 raft_consensus.cc:2804] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:40.011106 31054 consensus_queue.cc:237] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.011725 31056 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.012223 31056 raft_consensus.cc:3060] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.002091 31051 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.017304 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.020028 30101 ts_manager.cc:194] Re-registered known tserver with Master: 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.022833 31051 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.023460 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.024662 31014 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.023752 31052 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.022836 31056 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.029821 31052 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.030860 31014 raft_consensus.cc:2468] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:40.031884 31052 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.031988 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.031998 30392 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:40.034138 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.034776 31020 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:40.034967 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.036000 30392 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:40.036623 30972 tablet_bootstrap.cc:492] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:40.036748 31052 raft_consensus.cc:2804] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.037300 31052 raft_consensus.cc:697] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:40.037554 30972 tablet_bootstrap.cc:492] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:40.037002 30097 catalog_manager.cc:5697] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:40.038450 30951 raft_consensus.cc:2804] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.038856 31056 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.039395 30972 ts_tablet_manager.cc:1403] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 12:19:40.039780 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.040299 31020 raft_consensus.cc:3060] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.038926 30951 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.041538 30951 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.041854 30972 raft_consensus.cc:359] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.042536 30972 raft_consensus.cc:740] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.038156 31052 consensus_queue.cc:237] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.043212 30972 consensus_queue.cc:260] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.043771 30888 raft_consensus.cc:493] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.044342 30888 raft_consensus.cc:515] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.045729 30972 ts_tablet_manager.cc:1434] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:19:40.047169 30972 tablet_bootstrap.cc:492] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:40.048460 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:40.050980 30244 leader_election.cc:343] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.052487 30888 leader_election.cc:290] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.056118 30807 raft_consensus.cc:493] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.056644 30807 raft_consensus.cc:515] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.053881 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.059557 30242 leader_election.cc:304] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.061106 31054 raft_consensus.cc:2749] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.054067 31020 raft_consensus.cc:2468] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 3.
I20260709 12:19:40.062659 30392 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:40.063091 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.063863 31052 raft_consensus.cc:2804] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:40.065014 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:40.066414 30318 leader_election.cc:343] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.067207 31052 raft_consensus.cc:697] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 3 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:40.066983 30099 catalog_manager.cc:5697] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.068112 31054 raft_consensus.cc:493] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.068053 31052 consensus_queue.cc:237] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.068825 31054 raft_consensus.cc:515] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.070291 30317 leader_election.cc:304] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:40.071175 30955 raft_consensus.cc:2749] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.071786 31054 leader_election.cc:290] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.067014 30975 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.073997 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.074332 30975 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:40.075565 30244 leader_election.cc:343] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.076524 30975 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.077554 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.078073 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.079478 30807 leader_election.cc:290] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.080482 30242 leader_election.cc:304] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.081723 30888 raft_consensus.cc:2749] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.075754 30951 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.082392 31054 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.084928 31054 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.086557 30807 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.086714 30975 raft_consensus.cc:493] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.087064 30807 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.087185 30975 raft_consensus.cc:515] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.088601 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.088866 30807 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.088953 30975 leader_election.cc:290] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.078377 31014 raft_consensus.cc:2468] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:40.077433 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.091542 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.090847 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.092659 31020 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:40.094256 30318 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
W20260709 12:19:40.095175 30318 leader_election.cc:343] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.095855 30318 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:40.096696 30807 raft_consensus.cc:2804] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:40.097044 30807 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.097354 30807 raft_consensus.cc:3060] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.098634 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.099676 30426 raft_consensus.cc:2393] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
I20260709 12:19:40.102516 30975 raft_consensus.cc:2804] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.102991 30975 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.103461 30975 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.103747 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.105777 30315 leader_election.cc:304] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.107196 30955 raft_consensus.cc:2749] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.110667 30807 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.112713 31054 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.113662 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.115818 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.116480 30951 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
W20260709 12:19:40.116703 30244 leader_election.cc:343] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.117254 30244 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.118103 30888 raft_consensus.cc:493] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.118245 31054 raft_consensus.cc:2749] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.118629 30888 raft_consensus.cc:515] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.118124 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.120453 31020 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.122013 30888 leader_election.cc:290] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.123904 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.125154 30807 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
W20260709 12:19:40.125523 30244 leader_election.cc:343] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.126588 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.127177 30348 raft_consensus.cc:2468] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.128063 30888 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.128978 30972 tablet_bootstrap.cc:492] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:40.129254 30242 leader_election.cc:304] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.129881 30972 tablet_bootstrap.cc:492] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:40.130326 31054 raft_consensus.cc:2804] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.130604 30972 ts_tablet_manager.cc:1403] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.084s	user 0.024s	sys 0.054s
I20260709 12:19:40.130718 31054 raft_consensus.cc:493] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.131172 31054 raft_consensus.cc:3060] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.133246 30972 raft_consensus.cc:359] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.133946 30972 raft_consensus.cc:740] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.134760 30972 consensus_queue.cc:260] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.136945 30972 ts_tablet_manager.cc:1434] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:40.127959 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.137681 30972 tablet_bootstrap.cc:492] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:40.137732 31018 raft_consensus.cc:3060] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.139026 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:40.139168 30955 raft_consensus.cc:493] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.139880 30955 raft_consensus.cc:515] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.144018 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.145288 30955 leader_election.cc:290] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.146010 30955 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.146598 30955 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.149000 30955 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.149991 30973 raft_consensus.cc:493] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.128726 30888 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.150650 30973 raft_consensus.cc:515] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.152875 30973 leader_election.cc:290] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.154210 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.154866 31014 raft_consensus.cc:2468] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.155015 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.156157 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.156735 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.157305 30888 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.157586 31019 raft_consensus.cc:2393] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
W20260709 12:19:40.158828 30318 leader_election.cc:343] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.158838 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.160030 30972 tablet_bootstrap.cc:492] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:40.160034 30244 leader_election.cc:304] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:40.161130 30972 tablet_bootstrap.cc:492] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:40.159795 30318 leader_election.cc:304] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:40.161897 30972 ts_tablet_manager.cc:1403] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 12:19:40.161741 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.162462 31019 raft_consensus.cc:2468] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.163347 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.163612 30244 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.164179 31018 raft_consensus.cc:2468] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 3.
I20260709 12:19:40.164446 30874 raft_consensus.cc:2804] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.164867 30874 raft_consensus.cc:493] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.165238 30874 raft_consensus.cc:3060] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.165325 30318 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:40.166079 30973 raft_consensus.cc:2804] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.166640 30973 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.167141 30973 raft_consensus.cc:3060] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.168681 30972 raft_consensus.cc:359] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.169376 30972 raft_consensus.cc:740] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.170183 30972 consensus_queue.cc:260] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.172353 30972 ts_tablet_manager.cc:1434] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:40.172763 30874 raft_consensus.cc:515] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.175837 31054 raft_consensus.cc:515] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.177026 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.177621 31019 raft_consensus.cc:3060] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.178628 31054 leader_election.cc:290] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.173163 30972 tablet_bootstrap.cc:492] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:40.185526 31019 raft_consensus.cc:2468] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.186609 30244 leader_election.cc:304] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.187382 30315 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.187592 31054 raft_consensus.cc:2804] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.188288 31054 raft_consensus.cc:697] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:40.189589 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.189365 31054 consensus_queue.cc:237] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:40.190759 30244 leader_election.cc:343] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.192183 30975 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.193392 30346 raft_consensus.cc:2393] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 2: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:40.195832 30955 raft_consensus.cc:2749] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.196540 30951 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.197031 31052 raft_consensus.cc:493] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.197605 31052 raft_consensus.cc:515] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.199343 30955 raft_consensus.cc:2804] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:40.199434 30874 leader_election.cc:290] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.199946 31052 leader_election.cc:290] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.201996 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.197081 30951 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:40.203626 30392 leader_election.cc:343] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.206730 30807 raft_consensus.cc:493] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.207185 30807 raft_consensus.cc:515] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.209535 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:40.210865 30318 leader_election.cc:343] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.211340 31051 raft_consensus.cc:493] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.211740 31056 raft_consensus.cc:493] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.211851 31051 raft_consensus.cc:515] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.212270 31056 raft_consensus.cc:515] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.212841 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.213443 31019 raft_consensus.cc:2468] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:40.213920 30889 raft_consensus.cc:493] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.214524 30889 raft_consensus.cc:515] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.215024 30392 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:40.216004 30851 raft_consensus.cc:2804] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.216464 30851 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.216919 30851 raft_consensus.cc:3060] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.220842 31056 leader_election.cc:290] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.221597 30951 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.223071 31051 leader_election.cc:290] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.224300 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.224766 30889 leader_election.cc:290] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:40.225921 30392 leader_election.cc:343] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.226029 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.227120 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:40.227329 30392 leader_election.cc:343] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.227816 30851 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:40.228608 30392 leader_election.cc:343] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.230821 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.199952 30955 raft_consensus.cc:697] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:40.231536 31014 raft_consensus.cc:3060] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.234551 31070 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.241230 31014 raft_consensus.cc:2468] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
W20260709 12:19:40.242444 30241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 69191.4us
I20260709 12:19:40.245683 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.246706 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.260169 30346 raft_consensus.cc:2468] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:40.247362 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "786293768cab4265a62418294d3f895b" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.260825 30347 raft_consensus.cc:3060] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.249805 30807 leader_election.cc:290] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.265343 30807 raft_consensus.cc:493] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.265749 30807 raft_consensus.cc:515] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.266763 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.267562 30807 leader_election.cc:290] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.267951 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.268229 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.137804 31020 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:40.252686 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.269824 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:40.270438 30347 raft_consensus.cc:2468] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.271030 30392 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:40.271613 31051 raft_consensus.cc:493] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.271951 30391 leader_election.cc:304] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:40.272305 31051 raft_consensus.cc:515] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.272966 30889 raft_consensus.cc:2804] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.273576 30889 raft_consensus.cc:697] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:40.273875 30391 leader_election.cc:304] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:40.274544 30951 raft_consensus.cc:2749] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.275194 31051 leader_election.cc:290] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.255748 30851 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.277256 30972 tablet_bootstrap.cc:492] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:40.278210 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.279995 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
W20260709 12:19:40.258174 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 70912.4us
I20260709 12:19:40.282434 30889 consensus_queue.cc:237] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.283711 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:40.246866 30955 consensus_queue.cc:237] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.273007 31052 raft_consensus.cc:2749] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.280331 30392 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:40.287074 30851 raft_consensus.cc:493] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.257644 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.287618 30851 raft_consensus.cc:515] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.288661 31051 raft_consensus.cc:2804] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.278223 30972 tablet_bootstrap.cc:492] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:40.289170 31051 raft_consensus.cc:697] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:40.289587 30851 leader_election.cc:290] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.289780 30972 ts_tablet_manager.cc:1403] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.117s	user 0.020s	sys 0.005s
I20260709 12:19:40.290022 31051 consensus_queue.cc:237] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.279717 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.291461 30273 raft_consensus.cc:2468] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:40.253127 30975 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
W20260709 12:19:40.293923 30392 leader_election.cc:343] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.295965 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:40.297480 30392 leader_election.cc:343] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.299276 30972 raft_consensus.cc:359] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.300089 30972 raft_consensus.cc:740] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.255648 30973 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.302783 30278 raft_consensus.cc:2393] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 2: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:40.304339 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:40.304839 30973 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.305938 30972 consensus_queue.cc:260] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.306669 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.307078 30390 leader_election.cc:304] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.307577 31020 raft_consensus.cc:2393] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f03b88e02d9c4039964e2ab17a35bf52 in current term 2: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
I20260709 12:19:40.308252 31051 raft_consensus.cc:2749] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.308465 30972 ts_tablet_manager.cc:1434] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:19:40.309321 30972 tablet_bootstrap.cc:492] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:40.309609 30390 leader_election.cc:304] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.310119 30244 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.310981 31073 raft_consensus.cc:2749] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.311309 30242 leader_election.cc:304] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.312270 31073 raft_consensus.cc:2804] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.312307 30851 raft_consensus.cc:2804] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.312906 31073 raft_consensus.cc:697] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:40.312501 31051 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.313761 31073 consensus_queue.cc:237] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.313944 31051 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.315371 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.315939 30349 raft_consensus.cc:2468] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:40.316972 30951 raft_consensus.cc:493] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.317471 30951 raft_consensus.cc:515] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.318604 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.312906 30851 raft_consensus.cc:493] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.319437 31018 raft_consensus.cc:2393] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 3: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:40.319975 31072 raft_consensus.cc:493] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.320248 30951 leader_election.cc:290] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.320439 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.320497 31072 raft_consensus.cc:515] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.321532 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35d4a018024842a99a90f4bcc2a6887c" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.319365 30851 raft_consensus.cc:3060] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.322310 31018 raft_consensus.cc:2393] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 2: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:40.324360 30392 leader_election.cc:304] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:40.325099 31056 raft_consensus.cc:3060] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.326397 31051 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.330933 31052 raft_consensus.cc:493] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.331466 31052 raft_consensus.cc:515] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.332300 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.333212 30418 raft_consensus.cc:2468] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.333356 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.333570 31052 leader_election.cc:290] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
W20260709 12:19:40.334553 30318 leader_election.cc:343] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.335103 30241 leader_election.cc:304] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.335752 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.337353 31072 leader_election.cc:290] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.337814 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.338128 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.338765 31018 raft_consensus.cc:2468] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
W20260709 12:19:40.339233 30244 leader_election.cc:343] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.336884 30973 raft_consensus.cc:2804] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.340206 30973 raft_consensus.cc:493] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.341256 31072 raft_consensus.cc:493] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.341807 31072 raft_consensus.cc:515] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.343751 30392 leader_election.cc:304] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:40.344465 31054 raft_consensus.cc:493] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.345041 31072 leader_election.cc:290] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.340957 30973 raft_consensus.cc:3060] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.355626 30317 leader_election.cc:304] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:40.357933 30955 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.357796 30317 leader_election.cc:304] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.358480 30955 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.359092 30390 leader_election.cc:304] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.359755 31068 raft_consensus.cc:2749] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.345213 31054 raft_consensus.cc:515] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.355988 30807 raft_consensus.cc:493] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.360409 31051 raft_consensus.cc:2804] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.361353 31051 raft_consensus.cc:493] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.361176 30807 raft_consensus.cc:515] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.361851 31051 raft_consensus.cc:3060] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.362403 31054 leader_election.cc:290] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.363458 30807 leader_election.cc:290] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.364673 30807 raft_consensus.cc:2804] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.364838 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.360699 30955 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.354494 31082 raft_consensus.cc:493] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.366503 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:40.367956 30244 leader_election.cc:343] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.366467 31082 raft_consensus.cc:515] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.368618 31020 raft_consensus.cc:2393] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:40.345528 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.346419 31052 raft_consensus.cc:2804] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.370201 31052 raft_consensus.cc:493] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.346336 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.370648 31052 raft_consensus.cc:3060] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.347908 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.349119 30951 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.371848 30951 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.373446 31082 leader_election.cc:290] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.349354 30888 raft_consensus.cc:493] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.374541 30888 raft_consensus.cc:515] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.374864 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.375680 30951 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.375806 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.376633 30888 leader_election.cc:290] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.342048 31056 raft_consensus.cc:2749] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:40.377837 30392 leader_election.cc:343] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.379284 31015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.380111 31015 raft_consensus.cc:2468] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.350085 31072 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.353776 31075 raft_consensus.cc:493] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.382678 31075 raft_consensus.cc:515] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.384008 31056 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.384522 31056 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.384977 31075 leader_election.cc:290] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.381894 30244 leader_election.cc:304] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.385391 30315 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.385998 30347 raft_consensus.cc:2468] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:40.386554 30888 raft_consensus.cc:2804] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.386997 30888 raft_consensus.cc:493] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.387380 30888 raft_consensus.cc:3060] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.387835 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.388338 31015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.388542 31073 raft_consensus.cc:493] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.387832 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.389154 31073 raft_consensus.cc:515] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.389606 30421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.376492 31018 raft_consensus.cc:2468] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
W20260709 12:19:40.389755 30392 leader_election.cc:343] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.391160 30975 raft_consensus.cc:2749] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.391808 31070 raft_consensus.cc:2749] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.392287 30975 raft_consensus.cc:493] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.388458 30273 raft_consensus.cc:2468] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
I20260709 12:19:40.393147 31073 leader_election.cc:290] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.393554 31072 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.393792 30391 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.394668 30278 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:40.394735 30889 raft_consensus.cc:2804] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.395016 30244 leader_election.cc:304] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.395267 30889 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.395733 30889 raft_consensus.cc:3060] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.396188 31054 raft_consensus.cc:2804] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.397104 31015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.386577 31056 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.397276 31072 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.398577 31054 raft_consensus.cc:493] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.392828 30975 raft_consensus.cc:515] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:40.398800 30244 leader_election.cc:343] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.400230 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.400918 31018 raft_consensus.cc:2468] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:40.401692 31015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.402112 30318 leader_election.cc:304] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:40.402554 30391 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.360452 31068 raft_consensus.cc:493] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.403324 31056 raft_consensus.cc:2804] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:40.403505 30975 leader_election.cc:290] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.403822 31056 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.403661 31068 raft_consensus.cc:515] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.402980 31075 raft_consensus.cc:2804] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.405062 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:40.405270 30244 leader_election.cc:343] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.371331 30807 raft_consensus.cc:493] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.405725 30426 raft_consensus.cc:2468] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:40.406174 30807 raft_consensus.cc:3060] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.407449 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.408164 31056 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.404940 31075 raft_consensus.cc:493] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.409119 31075 raft_consensus.cc:3060] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.409713 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.404898 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.410437 31020 raft_consensus.cc:2468] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
W20260709 12:19:40.411285 30318 leader_election.cc:343] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.412446 30318 leader_election.cc:304] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:40.413419 31085 raft_consensus.cc:2804] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.414225 31085 raft_consensus.cc:493] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.414786 31073 raft_consensus.cc:493] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.415705 31085 raft_consensus.cc:3060] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.415278 31073 raft_consensus.cc:515] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.399044 31054 raft_consensus.cc:3060] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.419338 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.420001 30418 raft_consensus.cc:2468] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.421325 30241 leader_election.cc:304] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.422079 30874 raft_consensus.cc:2804] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.422498 31073 leader_election.cc:290] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.422576 30874 raft_consensus.cc:493] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.422768 31052 raft_consensus.cc:515] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.423395 30874 raft_consensus.cc:3060] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.424183 30421 raft_consensus.cc:2393] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
I20260709 12:19:40.424671 30889 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.427139 31052 leader_election.cc:290] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.455641 31056 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.459220 30426 raft_consensus.cc:2393] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f03b88e02d9c4039964e2ab17a35bf52 in current term 3: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
I20260709 12:19:40.428709 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.462801 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
W20260709 12:19:40.463793 30244 leader_election.cc:343] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:40.463943 30392 leader_election.cc:343] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.464887 31056 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.462086 30100 catalog_manager.cc:5697] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 2 to 3, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 3 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.351135 30851 raft_consensus.cc:515] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.429046 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.431371 31017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.469619 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:40.470209 30273 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.470319 30851 leader_election.cc:290] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
W20260709 12:19:40.473034 30392 leader_election.cc:343] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.433506 30888 raft_consensus.cc:515] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.457273 31085 raft_consensus.cc:515] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.478155 30888 leader_election.cc:290] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.479739 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.480451 31019 raft_consensus.cc:3060] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.481125 30807 raft_consensus.cc:515] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.484684 30273 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 3.
I20260709 12:19:40.434572 31054 raft_consensus.cc:515] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:40.434916 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 75858.5us
I20260709 12:19:40.370606 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.435798 30315 leader_election.cc:304] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.437481 31068 leader_election.cc:290] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.488719 30807 leader_election.cc:290] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.437562 30874 raft_consensus.cc:515] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.438493 30390 leader_election.cc:304] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.439533 30889 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.439728 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:40.498468 30278 raft_consensus.cc:3060] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.440876 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.441972 30350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.442181 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.442905 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:40.503309 30350 raft_consensus.cc:2468] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.503613 30348 raft_consensus.cc:2468] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.444010 31071 raft_consensus.cc:493] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.504498 31071 raft_consensus.cc:515] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.506253 31017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.506568 31071 leader_election.cc:290] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.506915 31017 raft_consensus.cc:3060] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.444171 31083 raft_consensus.cc:493] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.508247 31083 raft_consensus.cc:515] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.444360 31070 raft_consensus.cc:493] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.510612 31070 raft_consensus.cc:515] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.511073 30276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.511969 30276 raft_consensus.cc:2468] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:40.512503 31070 leader_election.cc:290] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.445416 30955 raft_consensus.cc:493] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.513726 30271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:40.514518 30271 raft_consensus.cc:3060] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.514321 30955 raft_consensus.cc:515] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.516320 30955 leader_election.cc:290] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.446890 31075 raft_consensus.cc:515] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.518024 30270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.447417 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.450012 30973 raft_consensus.cc:515] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.428331 31015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.519639 30349 raft_consensus.cc:2468] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.519794 31015 raft_consensus.cc:3060] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.520696 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.520992 30973 leader_election.cc:290] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.521198 31014 raft_consensus.cc:2393] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 3: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
W20260709 12:19:40.521642 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 85955.9us
W20260709 12:19:40.496708 30390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 58289.6us
I20260709 12:19:40.523495 31054 leader_election.cc:290] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.487465 30391 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.524930 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:40.497800 31056 raft_consensus.cc:2749] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.525660 30418 raft_consensus.cc:2393] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
I20260709 12:19:40.525761 30421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:40.526000 31056 raft_consensus.cc:2804] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:40.526433 30347 raft_consensus.cc:2468] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 1.
I20260709 12:19:40.527480 30874 leader_election.cc:290] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.528496 30272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:40.529114 30272 raft_consensus.cc:3060] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.491024 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.448243 30972 tablet_bootstrap.cc:492] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:40.519200 30351 raft_consensus.cc:2393] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate cf45045de3bd40b9a60aaaabe4322659 in current term 2: Already voted for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in this term.
I20260709 12:19:40.530579 30346 raft_consensus.cc:3060] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.531206 30972 tablet_bootstrap.cc:492] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:40.531884 30972 ts_tablet_manager.cc:1403] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.029s
I20260709 12:19:40.519178 31075 leader_election.cc:290] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.526548 31056 raft_consensus.cc:697] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 3 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:40.508473 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.520804 31083 leader_election.cc:290] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.534451 30242 leader_election.cc:304] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.542557 30242 leader_election.cc:304] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.534665 30241 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.536789 30390 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.540894 30349 raft_consensus.cc:1275] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.487088 31085 leader_election.cc:290] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.547868 30278 raft_consensus.cc:2468] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:40.548666 30421 raft_consensus.cc:2468] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:40.550192 31015 raft_consensus.cc:2468] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:40.550693 30972 raft_consensus.cc:359] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.559090 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.541608 30270 raft_consensus.cc:2468] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:40.555950 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.559837 30315 leader_election.cc:304] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:40.560278 31018 raft_consensus.cc:3060] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.560779 31085 raft_consensus.cc:2804] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.561172 31085 raft_consensus.cc:493] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.561538 31085 raft_consensus.cc:3060] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.562018 30888 raft_consensus.cc:2804] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.556334 30317 leader_election.cc:304] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.562443 30888 raft_consensus.cc:493] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.562852 30888 raft_consensus.cc:3060] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.563496 31073 raft_consensus.cc:2804] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.563673 31083 raft_consensus.cc:2804] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.563920 31073 raft_consensus.cc:493] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.564066 31083 raft_consensus.cc:493] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.564337 31073 raft_consensus.cc:3060] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.564455 31083 raft_consensus.cc:3060] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:40.566435 30318 leader_election.cc:343] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.567440 30318 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.568425 31071 raft_consensus.cc:3060] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.563512 30317 leader_election.cc:304] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:40.569314 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ff5b4e1a9b549f69fa44610140ab684" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.569680 31075 raft_consensus.cc:3060] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.557111 30347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9b4e218f7bb4c3aa64bae842061937a" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.554078 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.574239 30347 raft_consensus.cc:3060] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.574666 30351 raft_consensus.cc:3060] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.557245 31056 consensus_queue.cc:237] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.558359 31013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.567492 31072 raft_consensus.cc:2749] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:40.496785 31082 raft_consensus.cc:2804] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.578205 31082 raft_consensus.cc:493] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
W20260709 12:19:40.578490 30241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 43903.4us
I20260709 12:19:40.578594 31082 raft_consensus.cc:3060] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.559092 30972 raft_consensus.cc:740] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.579753 30972 consensus_queue.cc:260] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.581820 31013 raft_consensus.cc:3060] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.587723 31071 raft_consensus.cc:2749] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:40.587805 30270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.588327 30392 leader_election.cc:304] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:40.514024 31019 raft_consensus.cc:2468] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.589305 30278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:40.581948 30972 ts_tablet_manager.cc:1434] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.001s
I20260709 12:19:40.611927 30278 raft_consensus.cc:2393] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:40.612262 30972 tablet_bootstrap.cc:492] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:40.600765 30270 raft_consensus.cc:2393] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:40.600471 31051 raft_consensus.cc:515] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:40.616812 30244 leader_election.cc:343] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.602725 30347 raft_consensus.cc:2468] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:40.604681 31013 raft_consensus.cc:2468] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.615518 30351 raft_consensus.cc:2468] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.618417 30244 leader_election.cc:304] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.610836 31073 raft_consensus.cc:515] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.601492 30317 leader_election.cc:304] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.620388 30242 leader_election.cc:304] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.586007 31082 raft_consensus.cc:515] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.581948 31085 raft_consensus.cc:515] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.617251 30889 raft_consensus.cc:3060] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:40.619176 30851 raft_consensus.cc:2804] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.628193 31054 raft_consensus.cc:2804] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:19:40.617909 30318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 50563.3us
I20260709 12:19:40.648635 31054 raft_consensus.cc:697] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:40.649533 31054 consensus_queue.cc:237] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.651844 31051 leader_election.cc:290] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.638797 31071 raft_consensus.cc:2804] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:40.652675 31071 raft_consensus.cc:493] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:40.653052 31071 raft_consensus.cc:3060] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.656601 31082 leader_election.cc:290] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.647053 30346 raft_consensus.cc:2468] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.623421 30874 raft_consensus.cc:2804] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.637861 30099 catalog_manager.cc:5697] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:40.659677 30390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 122944us
I20260709 12:19:40.661902 30099 catalog_manager.cc:5697] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:40.626730 31015 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac00a693be1041d8b90ef03408a91eab" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.678468 30888 raft_consensus.cc:515] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.680034 31018 raft_consensus.cc:2468] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.681592 31017 raft_consensus.cc:2468] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:40.682885 31019 raft_consensus.cc:1275] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:40.683236 30272 raft_consensus.cc:2468] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:40.663633 30851 raft_consensus.cc:697] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:40.685914 30851 consensus_queue.cc:237] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.686672 31071 raft_consensus.cc:515] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.687336 31073 leader_election.cc:290] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.690979 30888 leader_election.cc:290] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:40.691797 30317 leader_election.cc:304] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.693313 30955 raft_consensus.cc:2804] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.693778 30955 raft_consensus.cc:697] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:40.694706 30392 leader_election.cc:304] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:40.694594 30955 consensus_queue.cc:237] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.694980 30244 leader_election.cc:304] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:40.696696 30951 raft_consensus.cc:2804] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.699894 30351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.713032 30351 raft_consensus.cc:3060] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.697165 30951 raft_consensus.cc:697] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
W20260709 12:19:40.716331 30390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 52374.9us
I20260709 12:19:40.704980 30889 raft_consensus.cc:2749] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:40.675659 30421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:40.709178 31093 raft_consensus.cc:2804] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.706804 31087 consensus_queue.cc:1048] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:19:40.688622 31071 leader_election.cc:290] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.721422 31020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.721524 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.719381 30421 raft_consensus.cc:3060] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.722754 31010 raft_consensus.cc:2393] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:40.723798 31010 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9ee34a652a74ed3bac1dc145136bf62" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.724087 31012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff03218495d14467b6f1a3ddc083aed9" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.724591 31010 raft_consensus.cc:2393] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate cf45045de3bd40b9a60aaaabe4322659 in this term.
I20260709 12:19:40.724743 30350 raft_consensus.cc:1275] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.676151 31015 raft_consensus.cc:3060] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.728240 31011 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "752fdec2f7b64590b55660b4d839c0ea" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.729036 31011 raft_consensus.cc:2393] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0cd3caf5ad334c0cb6e695ee74a83268 in current term 2: Already voted for candidate f03b88e02d9c4039964e2ab17a35bf52 in this term.
I20260709 12:19:40.728869 31083 raft_consensus.cc:515] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.731068 31017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.731647 30271 raft_consensus.cc:2468] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:40.731112 31093 raft_consensus.cc:697] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
W20260709 12:19:40.689015 30318 leader_election.cc:343] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:40.732997 30318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 57936.9us
I20260709 12:19:40.733193 31093 consensus_queue.cc:237] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:40.735033 31065 log.cc:927] Time spent T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:19:40.735740 30888 consensus_queue.cc:1048] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:40.742865 30392 leader_election.cc:343] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.706672 31075 raft_consensus.cc:2749] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.750711 30347 raft_consensus.cc:1275] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.752029 30951 consensus_queue.cc:237] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.708305 30346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e15a1e1f78e426d9a8ca0a51c2b1644" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.673709 31056 consensus_queue.cc:1048] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:19:40.753360 30972 tablet_bootstrap.cc:492] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:40.791680 30972 tablet_bootstrap.cc:492] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:40.791801 30318 leader_election.cc:304] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:40.792400 30972 ts_tablet_manager.cc:1403] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.180s	user 0.014s	sys 0.012s
W20260709 12:19:40.793577 30244 leader_election.cc:343] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.796283 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "135faf5d4c1c461f818d5c4131fcf51d" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:40.796886 30348 raft_consensus.cc:3060] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.798365 31082 raft_consensus.cc:2749] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.804903 30348 raft_consensus.cc:2468] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:40.806205 30346 raft_consensus.cc:3060] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.757279 30272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:40.804642 30972 raft_consensus.cc:359] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.807853 30272 raft_consensus.cc:3060] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.809764 31015 raft_consensus.cc:2468] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:40.748876 30874 raft_consensus.cc:697] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:40.810901 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
I20260709 12:19:40.811308 30874 consensus_queue.cc:237] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:40.760756 31083 leader_election.cc:290] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:40.753263 30317 leader_election.cc:304] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.813627 30421 raft_consensus.cc:2468] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:40.807852 30972 raft_consensus.cc:740] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:40.815325 31085 leader_election.cc:290] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:40.816157 31085 raft_consensus.cc:2804] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.817031 30972 consensus_queue.cc:260] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.818078 31085 raft_consensus.cc:697] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:40.819090 31085 consensus_queue.cc:237] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.819723 30348 raft_consensus.cc:1275] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:40.823235 31014 raft_consensus.cc:1275] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.753942 31013 raft_consensus.cc:1275] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.823648 31017 raft_consensus.cc:1275] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.829447 30351 raft_consensus.cc:2468] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
W20260709 12:19:40.817109 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 63947.4us
I20260709 12:19:40.825073 30423 raft_consensus.cc:1275] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:40.829066 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a54afd7ab154ec88c23d17fc3926282" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:40.831657 30426 raft_consensus.cc:3060] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.747991 30391 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.757067 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6" is_pre_election: true
W20260709 12:19:40.835494 30391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 87577.6us
I20260709 12:19:40.836153 30423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "373645f6f2614fa5a09fd23279ce7973" candidate_uuid: "f03b88e02d9c4039964e2ab17a35bf52" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:40.848083 30423 raft_consensus.cc:3060] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.837358 30242 leader_election.cc:304] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.867206 30426 raft_consensus.cc:2468] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.870105 30972 ts_tablet_manager.cc:1434] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.077s	user 0.006s	sys 0.001s
I20260709 12:19:40.871637 30972 tablet_bootstrap.cc:492] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:40.871345 30421 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:40.882745 30421 raft_consensus.cc:3060] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:40.882879 30425 raft_consensus.cc:1275] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.891278 30423 raft_consensus.cc:2468] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.893802 30278 raft_consensus.cc:1275] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.820393 30272 raft_consensus.cc:2468] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
W20260709 12:19:40.897053 30244 consensus_peers.cc:597] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:40.869760 31051 raft_consensus.cc:2804] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.903576 30241 leader_election.cc:304] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
W20260709 12:19:40.905797 30244 leader_election.cc:343] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:40.877121 31072 raft_consensus.cc:2804] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.869537 31056 consensus_queue.cc:1048] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:19:40.887641 30318 leader_election.cc:304] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:40.918594 30889 consensus_queue.cc:1048] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:19:40.910456 30973 raft_consensus.cc:2804] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.911653 31051 raft_consensus.cc:697] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:40.931433 30390 leader_election.cc:304] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:40.919332 31072 raft_consensus.cc:697] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:40.911010 30315 leader_election.cc:304] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:40.946785 31075 raft_consensus.cc:2804] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.947304 31075 raft_consensus.cc:697] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:40.948103 31075 consensus_queue.cc:237] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:40.950336 31013 raft_consensus.cc:1275] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:40.938557 31083 raft_consensus.cc:2749] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:19:40.970116 31011 raft_consensus.cc:1275] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:19:40.956491 30318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 108422us
I20260709 12:19:40.970836 31017 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.970914 31072 consensus_queue.cc:237] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:40.937916 30973 raft_consensus.cc:697] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:40.971993 31056 raft_consensus.cc:2804] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.972476 31091 consensus_queue.cc:1048] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:40.952003 30346 raft_consensus.cc:2468] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f03b88e02d9c4039964e2ab17a35bf52 in term 2.
I20260709 12:19:40.973181 31019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a243cb1e81a84b1681899e957182bf40" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
W20260709 12:19:40.976671 30392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 77387.6us
I20260709 12:19:40.950429 31068 consensus_queue.cc:1048] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:19:40.951617 31014 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "513668c5dbf240ab8c90da19361cac60" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
W20260709 12:19:40.978996 30241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 73609.1us
W20260709 12:19:40.977478 30391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 88452.7us
I20260709 12:19:40.979892 31018 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dee40afb40fa45f8969bce6b71285204" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "777b1410f165436aa725262b964ff0a6"
I20260709 12:19:40.982368 31056 raft_consensus.cc:697] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:40.997346 30242 leader_election.cc:304] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:41.000305 30317 leader_election.cc:304] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:41.000660 31089 raft_consensus.cc:2804] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.980760 31054 consensus_queue.cc:1048] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:19:40.976171 31094 consensus_queue.cc:1048] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:19:41.001243 31082 raft_consensus.cc:2804] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:40.989363 31051 consensus_queue.cc:237] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:41.060320 30318 leader_election.cc:304] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
W20260709 12:19:41.066308 30390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 129045us
W20260709 12:19:41.067631 31102 log.cc:927] Time spent T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:19:41.066721 31082 raft_consensus.cc:697] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:41.067205 30807 raft_consensus.cc:2749] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:41.072219 31105 consensus_queue.cc:1048] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:19:41.075847 31056 consensus_queue.cc:237] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:41.064613 30421 raft_consensus.cc:2468] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:41.062546 30874 consensus_queue.cc:1048] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 12:19:41.081710 30318 leader_election.cc:343] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:41.119897 30390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 44859.4us
I20260709 12:19:41.068778 30973 consensus_queue.cc:237] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:41.111227 31082 consensus_queue.cc:237] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:41.168548 30100 catalog_manager.cc:5697] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.170750 30100 catalog_manager.cc:5697] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:41.144647 30318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 72816.5us
I20260709 12:19:41.184602 30350 raft_consensus.cc:1275] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.166896 30097 catalog_manager.cc:5697] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 2 to 3, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 3 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:41.211731 30242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 209564us
I20260709 12:19:41.215678 30097 catalog_manager.cc:5697] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.218663 30100 catalog_manager.cc:5697] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:41.225847 30275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82b7f80a887443338c7b69d68b9e4886" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:41.226518 30275 raft_consensus.cc:3060] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:41.217896 30097 catalog_manager.cc:5697] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.235549 30275 raft_consensus.cc:2468] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:41.189847 31089 raft_consensus.cc:697] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Leader. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
W20260709 12:19:41.193050 30318 leader_election.cc:343] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.273685 30099 catalog_manager.cc:5697] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:41.274675 30391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 277153us
W20260709 12:19:41.288079 30390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 164017us
I20260709 12:19:41.292601 30348 raft_consensus.cc:1275] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.298915 30099 catalog_manager.cc:5697] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:41.297886 30318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 105930us
I20260709 12:19:41.286521 30851 consensus_queue.cc:1048] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:19:41.329238 31011 raft_consensus.cc:1275] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.349483 30972 tablet_bootstrap.cc:492] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:19:41.354007 30241 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 63633.2us
I20260709 12:19:41.366102 30275 raft_consensus.cc:1275] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:19:41.368778 30972 tablet_bootstrap.cc:492] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:41.369730 30972 ts_tablet_manager.cc:1403] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.499s	user 0.033s	sys 0.015s
W20260709 12:19:41.350862 30318 leader_election.cc:343] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.372112 30278 raft_consensus.cc:1275] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.329429 31089 consensus_queue.cc:237] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:41.411226 30242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 104334us
W20260709 12:19:41.421537 30318 leader_election.cc:343] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:41.422327 30318 leader_election.cc:343] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:41.417249 30888 consensus_queue.cc:1048] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:19:41.427620 30349 raft_consensus.cc:1275] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:19:41.432792 30390 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 87552.8us
I20260709 12:19:41.422966 31071 consensus_queue.cc:1048] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
W20260709 12:19:41.427817 30318 leader_election.cc:343] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:41.465157 31080 log.cc:927] Time spent T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.191s	user 0.003s	sys 0.002s
I20260709 12:19:41.440716 31052 consensus_queue.cc:1048] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:19:41.484135 31114 log.cc:927] Time spent T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:19:41.483085 30315 leader_election.cc:304] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:41.468559 30889 consensus_queue.cc:1048] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
W20260709 12:19:41.481515 30318 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 58281.6us
I20260709 12:19:41.440366 30317 leader_election.cc:304] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:41.542332 30345 raft_consensus.cc:1275] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.543130 30972 raft_consensus.cc:359] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:41.544562 31111 raft_consensus.cc:2804] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:19:41.544796 30317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 117304us
I20260709 12:19:41.545107 31111 raft_consensus.cc:697] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:41.546752 30352 raft_consensus.cc:1275] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.546478 31111 consensus_queue.cc:237] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:41.521308 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 44572.4us
I20260709 12:19:41.543902 30972 raft_consensus.cc:740] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:41.550592 30972 consensus_queue.cc:260] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:41.552006 30972 ts_tablet_manager.cc:1434] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.182s	user 0.006s	sys 0.000s
I20260709 12:19:41.552784 30972 tablet_bootstrap.cc:492] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
W20260709 12:19:41.558105 30242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 44363.3us
W20260709 12:19:41.560016 31127 log.cc:927] Time spent T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:19:41.559809 31052 consensus_queue.cc:1048] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:41.560545 31107 consensus_queue.cc:1048] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:19:41.561164 31128 log.cc:927] Time spent T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:19:41.561703 31134 log.cc:927] Time spent T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:19:41.539343 31085 raft_consensus.cc:2804] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:19:41.572891 31120 log.cc:927] Time spent T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:19:41.579406 31020 raft_consensus.cc:1275] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.580441 31141 consensus_queue.cc:1048] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:19:41.609928 31085 raft_consensus.cc:697] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:41.629683 30425 raft_consensus.cc:1275] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.597507 31082 consensus_queue.cc:1048] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:19:41.620783 31014 raft_consensus.cc:1275] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:19:41.646764 31123 log.cc:927] Time spent T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 12:19:41.658842 31089 consensus_queue.cc:1048] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:19:41.706063 31014 raft_consensus.cc:1275] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.705521 31020 raft_consensus.cc:1275] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.696681 31085 consensus_queue.cc:237] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:41.777508 30419 raft_consensus.cc:1275] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.790602 30270 raft_consensus.cc:1275] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.791729 30352 raft_consensus.cc:1275] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.842433 31113 consensus_queue.cc:1048] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.858428 30271 raft_consensus.cc:1275] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:41.858824 30851 consensus_queue.cc:1048] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.878180 31082 consensus_queue.cc:1048] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.903903 30275 raft_consensus.cc:1275] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:19:41.923457 30315 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.4:34977, user_credentials={real_user=slave}} blocked reactor thread for 239929us
I20260709 12:19:41.931838 30977 raft_consensus.cc:493] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0cd3caf5ad334c0cb6e695ee74a83268)
I20260709 12:19:41.932978 30977 raft_consensus.cc:515] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:41.961843 31139 consensus_queue.cc:1048] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.970597 31138 consensus_queue.cc:1048] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.971840 30973 consensus_queue.cc:1048] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.977437 31075 consensus_queue.cc:1048] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:41.983484 30972 tablet_bootstrap.cc:492] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:41.992007 30972 tablet_bootstrap.cc:492] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:42.005527 30972 ts_tablet_manager.cc:1403] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.453s	user 0.015s	sys 0.017s
I20260709 12:19:42.007457 31119 consensus_queue.cc:1048] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:42.024909 30972 raft_consensus.cc:359] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:42.026136 30972 raft_consensus.cc:740] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.036052 30977 leader_election.cc:290] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:42.076020 30425 raft_consensus.cc:1275] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:19:42.083896 31164 log.cc:927] Time spent T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:19:42.068774 30972 consensus_queue.cc:260] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:42.119588 30424 raft_consensus.cc:1275] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:42.119822 30888 consensus_queue.cc:1048] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.104s
I20260709 12:19:42.122169 30972 ts_tablet_manager.cc:1434] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.116s	user 0.005s	sys 0.004s
I20260709 12:19:42.066787 30977 raft_consensus.cc:493] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.128159 31071 consensus_queue.cc:1048] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:19:42.140664 30972 tablet_bootstrap.cc:492] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:42.166589 31071 consensus_queue.cc:1048] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 12:19:42.152504 30244 consensus_peers.cc:597] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:42.179458 30244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 139570us
I20260709 12:19:42.187690 30977 raft_consensus.cc:515] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:42.202513 30348 raft_consensus.cc:1275] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:42.203208 30977 leader_election.cc:290] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:42.203435 31015 raft_consensus.cc:1275] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:19:42.204190 30244 consensus_peers.cc:597] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:42.245102 31176 log.cc:927] Time spent T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
I20260709 12:19:42.245844 30270 raft_consensus.cc:1275] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:19:42.250998 30244 consensus_peers.cc:597] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:42.251870 30244 consensus_peers.cc:597] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:42.277501 31165 log.cc:927] Time spent T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.375s	user 0.002s	sys 0.000s
W20260709 12:19:42.283558 31169 log.cc:927] Time spent T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.274s	user 0.002s	sys 0.000s
W20260709 12:19:42.296236 30318 consensus_peers.cc:597] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:42.297402 30318 consensus_peers.cc:597] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:42.298524 30318 consensus_peers.cc:597] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:42.299239 31177 consensus_queue.cc:1048] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
W20260709 12:19:42.300046 30244 consensus_peers.cc:597] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:42.305474 31171 log.cc:927] Time spent T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
W20260709 12:19:42.307345 31174 log.cc:927] Time spent T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.288s	user 0.002s	sys 0.000s
I20260709 12:19:42.327775 31104 consensus_queue.cc:1048] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:42.334370 30346 raft_consensus.cc:1275] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer f03b88e02d9c4039964e2ab17a35bf52: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:42.315253 31054 consensus_queue.cc:1048] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:19:42.340333 31130 consensus_queue.cc:1048] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:19:42.398469 30392 consensus_peers.cc:597] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:42.399187 30392 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 53822.7us
W20260709 12:19:42.400182 30392 consensus_peers.cc:597] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:42.401167 30392 consensus_peers.cc:597] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:42.402099 30392 consensus_peers.cc:597] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:42.429420 30244 consensus_peers.cc:597] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:42.433133 30392 consensus_peers.cc:597] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:42.432410 30318 consensus_peers.cc:597] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:42.445220 30318 consensus_peers.cc:597] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:42.447180 30318 consensus_peers.cc:597] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:42.450101 30318 consensus_peers.cc:597] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:42.467736 30972 tablet_bootstrap.cc:492] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:42.490345 30972 tablet_bootstrap.cc:492] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:42.491465 30972 ts_tablet_manager.cc:1403] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.368s	user 0.018s	sys 0.006s
I20260709 12:19:42.496869 30977 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:42.497781 30977 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:42.500649 30101 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58108
I20260709 12:19:42.501493 30097 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35792 (request call id 100) took 1709 ms. Trace:
I20260709 12:19:42.501765 30977 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:42.504047 30099 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35784 (request call id 102) took 1322 ms. Trace:
I20260709 12:19:42.508507 30101 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:58108 (request call id 1) took 2487 ms. Trace:
I20260709 12:19:42.504587 30099 rpcz_store.cc:276] 0709 12:19:41.181806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.181996 (+   190us) service_pool.cc:224] Handling call
0709 12:19:42.503831 (+1321835us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:41.938628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:41.939617 (+   989us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:41.939679 (+    62us) write_op.cc:435] Acquired schema lock
0709 12:19:41.939708 (+    29us) tablet.cc:662] Decoding operations
0709 12:19:41.959872 (+ 20164us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:41.959983 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:41.960042 (+    59us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:19:42.032939 (+ 72897us) tablet.cc:701] Row locks acquired
0709 12:19:42.042371 (+  9432us) write_op.cc:260] PREPARE: finished
0709 12:19:42.047675 (+  5304us) write_op.cc:270] Start()
0709 12:19:42.047857 (+   182us) write_op.cc:276] Timestamp: P: 1783599582047609 usec, L: 0
0709 12:19:42.047891 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:19:42.049010 (+  1119us) log.cc:844] Serialized 916 byte log entry
0709 12:19:42.052034 (+  3024us) op_driver.cc:464] REPLICATION: finished
0709 12:19:42.052753 (+   719us) write_op.cc:301] APPLY: starting
0709 12:19:42.052858 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:42.052995 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:42.053161 (+   166us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:42.053693 (+   532us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:42.054008 (+   315us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:19:42.054068 (+    60us) write_op.cc:312] APPLY: finished
0709 12:19:42.054367 (+   299us) log.cc:844] Serialized 28 byte log entry
0709 12:19:42.054516 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:42.054609 (+    93us) write_op.cc:454] Released schema lock
0709 12:19:42.054672 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:42.055244 (+   572us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:42.055291 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":367492,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":419,"apply.run_cpu_time_us":2414,"apply.run_wall_time_us":2415,"num_ops":2,"prepare.queue_time_us":631756,"prepare.run_cpu_time_us":5319,"prepare.run_wall_time_us":110816,"replication_time_us":3946}]]}
I20260709 12:19:42.509066 30101 rpcz_store.cc:276] 0709 12:19:40.014645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.014793 (+   148us) service_pool.cc:224] Handling call
0709 12:19:42.502220 (+2487427us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252688,"reported_tablets":45}
W20260709 12:19:42.534293 31196 log.cc:927] Time spent T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:19:42.534487 31193 log.cc:927] Time spent T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:19:42.536216 31011 raft_consensus.cc:1275] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:42.538897 30100 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:35768 (request call id 89) took 1569 ms. Trace:
I20260709 12:19:42.502082 30097 rpcz_store.cc:276] 0709 12:19:40.791832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.791995 (+   163us) service_pool.cc:224] Handling call
0709 12:19:42.501151 (+1709156us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:41.547962 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:41.582606 (+ 34644us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:41.582659 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:19:41.582683 (+    24us) tablet.cc:662] Decoding operations
0709 12:19:41.634477 (+ 51794us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:41.636808 (+  2331us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:41.639149 (+  2341us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:19:41.641799 (+  2650us) tablet.cc:701] Row locks acquired
0709 12:19:41.641816 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:19:41.641954 (+   138us) write_op.cc:270] Start()
0709 12:19:41.642062 (+   108us) write_op.cc:276] Timestamp: P: 1783599581641912 usec, L: 0
0709 12:19:41.642086 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:19:41.711256 (+ 69170us) log.cc:844] Serialized 1298 byte log entry
0709 12:19:41.722149 (+ 10893us) op_driver.cc:464] REPLICATION: finished
0709 12:19:41.722927 (+   778us) write_op.cc:301] APPLY: starting
0709 12:19:41.722985 (+    58us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:41.723072 (+    87us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:41.723129 (+    57us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:41.723387 (+   258us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:41.723500 (+   113us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:19:41.723527 (+    27us) write_op.cc:312] APPLY: finished
0709 12:19:41.723666 (+   139us) log.cc:844] Serialized 34 byte log entry
0709 12:19:41.723764 (+    98us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:41.723831 (+    67us) write_op.cc:454] Released schema lock
0709 12:19:41.723855 (+    24us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:41.926068 (+202213us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b5400616cd4. stack: 00007f75bdb33343 00007f75bdb33240 00007f75bd4c21d4 00007f75c7200304 00007f75c7200299 00007f75c0bbb571 00007f75c0c4de28 00007f75c4688581 00007f75c4687d58 00007f75c468c9f1 00007f75c468c9a9 00007f75c468c939 00007f75c468c901 00007f75c468bb2d 0000000000388634 0000000000388479
0709 12:19:41.937627 (+ 11559us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:41.937688 (+    61us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":679855,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":579,"apply.run_cpu_time_us":1114,"apply.run_wall_time_us":1114,"num_ops":3,"prepare.queue_time_us":312157,"prepare.run_cpu_time_us":6642,"prepare.run_wall_time_us":378332,"replication_time_us":79941,"spinlock_wait_cycles":157480704}]]}
I20260709 12:19:42.590468 30951 consensus_queue.cc:1048] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:19:42.598397 31046 heartbeater.cc:499] Master 127.22.48.62:40753 was elected leader, sending a full tablet report...
I20260709 12:19:42.606241 31116 consensus_queue.cc:1048] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:42.539556 30100 rpcz_store.cc:276] 0709 12:19:40.969627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.969786 (+   159us) service_pool.cc:224] Handling call
0709 12:19:42.538606 (+1568820us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:41.368369 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:41.475922 (+107553us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:41.478013 (+  2091us) write_op.cc:435] Acquired schema lock
0709 12:19:41.479577 (+  1564us) tablet.cc:662] Decoding operations
0709 12:19:41.546211 (+ 66634us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:41.546264 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:41.546308 (+    44us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:19:41.546637 (+   329us) tablet.cc:701] Row locks acquired
0709 12:19:41.546656 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:19:41.546800 (+   144us) write_op.cc:270] Start()
0709 12:19:41.546908 (+   108us) write_op.cc:276] Timestamp: P: 1783599581546750 usec, L: 0
0709 12:19:41.546931 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:19:41.547539 (+   608us) log.cc:844] Serialized 1298 byte log entry
0709 12:19:41.650625 (+103086us) op_driver.cc:464] REPLICATION: finished
0709 12:19:41.717178 (+ 66553us) write_op.cc:301] APPLY: starting
0709 12:19:41.717245 (+    67us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:41.717373 (+   128us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:41.717497 (+   124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:41.717938 (+   441us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:41.718109 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:19:41.718156 (+    47us) write_op.cc:312] APPLY: finished
0709 12:19:41.718397 (+   241us) log.cc:844] Serialized 34 byte log entry
0709 12:19:41.718602 (+   205us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:41.718678 (+    76us) write_op.cc:454] Released schema lock
0709 12:19:41.718706 (+    28us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:41.718941 (+   235us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:41.718957 (+    16us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":667682,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":64242,"apply.run_cpu_time_us":1740,"apply.run_wall_time_us":1766,"num_ops":3,"prepare.queue_time_us":131574,"prepare.run_cpu_time_us":3831,"prepare.run_wall_time_us":189589,"replication_time_us":88919,"thread_start_us":113170,"threads_started":2}]]}
W20260709 12:19:42.658504 31201 log.cc:927] Time spent T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:19:42.658548 31018 raft_consensus.cc:3060] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:42.671391 30352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:42.671944 30345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e383c3fc4184c4ba49ba4d78433d661" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:42.689908 30972 raft_consensus.cc:359] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:42.690797 30972 raft_consensus.cc:740] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:42.693449 30972 consensus_queue.cc:260] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:42.710232 31197 log.cc:927] Time spent T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:19:42.711994 30972 ts_tablet_manager.cc:1434] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.220s	user 0.003s	sys 0.003s
I20260709 12:19:42.713013 30972 tablet_bootstrap.cc:492] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
W20260709 12:19:42.733979 31204 log.cc:927] Time spent T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:19:42.804276 30242 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.3:46753, user_credentials={real_user=slave}} blocked reactor thread for 44585.7us
W20260709 12:19:42.914498 31214 log.cc:927] Time spent T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
W20260709 12:19:42.915980 31205 log.cc:927] Time spent T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659: Append to log took a long time: real 0.258s	user 0.002s	sys 0.000s
W20260709 12:19:42.916620 31215 log.cc:927] Time spent T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:19:42.960153 30244 consensus_peers.cc:597] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:42.982937 31212 log.cc:927] Time spent T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.324s	user 0.000s	sys 0.003s
I20260709 12:19:42.986805 30273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e383c3fc4184c4ba49ba4d78433d661" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:43.011379 30272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52" is_pre_election: true
I20260709 12:19:43.135366 30972 tablet_bootstrap.cc:492] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.122639 30968 leader_election.cc:304] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:43.157291 30972 tablet_bootstrap.cc:492] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.158502 30972 ts_tablet_manager.cc:1403] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.446s	user 0.026s	sys 0.003s
I20260709 12:19:43.156406 30977 raft_consensus.cc:493] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader cf45045de3bd40b9a60aaaabe4322659)
W20260709 12:19:43.158703 30968 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:35801, user_credentials={real_user=slave}} blocked reactor thread for 109302us
W20260709 12:19:43.204054 31203 log.cc:927] Time spent T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.548s	user 0.000s	sys 0.003s
W20260709 12:19:43.207154 31211 log.cc:927] Time spent T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.470s	user 0.002s	sys 0.000s
I20260709 12:19:43.197717 30977 raft_consensus.cc:515] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.209612 30977 leader_election.cc:290] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
W20260709 12:19:43.211268 31207 log.cc:927] Time spent T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.560s	user 0.002s	sys 0.001s
I20260709 12:19:43.215739 31237 raft_consensus.cc:2749] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:43.242628 30972 raft_consensus.cc:359] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.244491 30972 raft_consensus.cc:740] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.252194 30972 consensus_queue.cc:260] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:43.260531 30244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:33137, user_credentials={real_user=slave}} blocked reactor thread for 62194.2us
I20260709 12:19:43.269018 30972 ts_tablet_manager.cc:1434] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.110s	user 0.005s	sys 0.001s
I20260709 12:19:43.271255 30972 tablet_bootstrap.cc:492] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
W20260709 12:19:43.288359 30392 consensus_peers.cc:597] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:43.294864 31216 log.cc:927] Time spent T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268: Append to log took a long time: real 0.329s	user 0.002s	sys 0.009s
I20260709 12:19:43.319154 30419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:43.326987 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:43.337100 30392 consensus_peers.cc:597] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:43.338402 30966 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:43.339208 30977 raft_consensus.cc:2749] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:43.342684 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9164fff77d194553bf16a7020fb1546a" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:43.332741 30420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "658e0669fba3478e91574f80953b72b7" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:43.372821 30097 catalog_manager.cc:5697] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:43.379779 31020 raft_consensus.cc:3060] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:43.378377 30097 catalog_manager.cc:5697] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } }
I20260709 12:19:43.387935 30097 catalog_manager.cc:5697] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 2 to 3, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 3 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } }
I20260709 12:19:43.389535 30097 catalog_manager.cc:5697] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } }
I20260709 12:19:43.390308 30966 leader_election.cc:304] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:43.391297 30977 raft_consensus.cc:2749] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:43.391040 30097 catalog_manager.cc:5697] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } }
I20260709 12:19:43.402552 30097 catalog_manager.cc:5697] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:43.410979 30392 consensus_peers.cc:597] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:43.419068 30097 catalog_manager.cc:5697] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f03b88e02d9c4039964e2ab17a35bf52" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.427451 30967 leader_election.cc:304] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 777b1410f165436aa725262b964ff0a6; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:43.428736 30977 raft_consensus.cc:2749] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:43.443379 30972 tablet_bootstrap.cc:492] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.444451 30972 tablet_bootstrap.cc:492] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.445031 30972 ts_tablet_manager.cc:1403] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.174s	user 0.012s	sys 0.005s
I20260709 12:19:43.447613 30972 raft_consensus.cc:359] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.450837 30972 raft_consensus.cc:740] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.452261 30972 consensus_queue.cc:260] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.458639 30972 ts_tablet_manager.cc:1434] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:19:43.459506 30972 tablet_bootstrap.cc:492] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.481401 30972 tablet_bootstrap.cc:492] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.482394 30972 tablet_bootstrap.cc:492] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.483017 30972 ts_tablet_manager.cc:1403] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.011s
I20260709 12:19:43.485818 30972 raft_consensus.cc:359] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.486493 30972 raft_consensus.cc:740] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.487265 30972 consensus_queue.cc:260] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.489547 30972 ts_tablet_manager.cc:1434] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:19:43.490343 30972 tablet_bootstrap.cc:492] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.497381 30100 catalog_manager.cc:5697] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.499056 30100 catalog_manager.cc:5697] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.501631 30100 catalog_manager.cc:5697] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.503877 30100 catalog_manager.cc:5697] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } }
I20260709 12:19:43.506338 30100 catalog_manager.cc:5697] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 1 to 2, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } }
I20260709 12:19:43.517518 30972 tablet_bootstrap.cc:492] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.520533 30972 tablet_bootstrap.cc:492] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.521143 30972 ts_tablet_manager.cc:1403] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.003s
I20260709 12:19:43.523828 30972 raft_consensus.cc:359] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.524487 30972 raft_consensus.cc:740] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.525260 30972 consensus_queue.cc:260] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.527565 30972 ts_tablet_manager.cc:1434] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:43.528385 30972 tablet_bootstrap.cc:492] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.556255 30972 tablet_bootstrap.cc:492] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.557195 30972 tablet_bootstrap.cc:492] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.557783 30972 ts_tablet_manager.cc:1403] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.003s
I20260709 12:19:43.560572 30972 raft_consensus.cc:359] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.561657 30972 raft_consensus.cc:740] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.562427 30972 consensus_queue.cc:260] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.564970 30972 ts_tablet_manager.cc:1434] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:19:43.565853 30972 tablet_bootstrap.cc:492] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.589026 30972 tablet_bootstrap.cc:492] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.589844 30972 tablet_bootstrap.cc:492] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.590520 30972 ts_tablet_manager.cc:1403] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 12:19:43.592309 30972 raft_consensus.cc:359] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.592813 30972 raft_consensus.cc:740] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.593662 30972 consensus_queue.cc:260] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.595954 30972 ts_tablet_manager.cc:1434] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:43.597088 30972 tablet_bootstrap.cc:492] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.620564 30972 tablet_bootstrap.cc:492] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.621521 30972 tablet_bootstrap.cc:492] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.622097 30972 ts_tablet_manager.cc:1403] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.007s
I20260709 12:19:43.624464 30972 raft_consensus.cc:359] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.625111 30972 raft_consensus.cc:740] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.625967 30972 consensus_queue.cc:260] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.628271 30972 ts_tablet_manager.cc:1434] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:43.629031 30972 tablet_bootstrap.cc:492] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.654784 30972 tablet_bootstrap.cc:492] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.657511 30972 tablet_bootstrap.cc:492] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.658264 30972 ts_tablet_manager.cc:1403] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.001s
I20260709 12:19:43.660817 30972 raft_consensus.cc:359] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.661520 30972 raft_consensus.cc:740] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.662329 30972 consensus_queue.cc:260] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.664958 30972 ts_tablet_manager.cc:1434] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:19:43.666496 30972 tablet_bootstrap.cc:492] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.675999 31014 raft_consensus.cc:3060] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:43.682267 30972 tablet_bootstrap.cc:492] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.683348 30972 tablet_bootstrap.cc:492] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.684033 30972 ts_tablet_manager.cc:1403] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:19:43.686584 30972 raft_consensus.cc:359] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.687304 30972 raft_consensus.cc:740] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.688282 30972 consensus_queue.cc:260] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.690256 30972 ts_tablet_manager.cc:1434] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:19:43.691474 30972 tablet_bootstrap.cc:492] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.720827 30972 tablet_bootstrap.cc:492] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.725659 30972 tablet_bootstrap.cc:492] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.726524 30972 ts_tablet_manager.cc:1403] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.009s
I20260709 12:19:43.728516 30972 raft_consensus.cc:359] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.729038 30972 raft_consensus.cc:740] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.729660 30972 consensus_queue.cc:260] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.731381 30972 ts_tablet_manager.cc:1434] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:19:43.732599 30972 tablet_bootstrap.cc:492] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.745729 31015 raft_consensus.cc:3060] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:43.751958 30972 tablet_bootstrap.cc:492] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.753019 30972 tablet_bootstrap.cc:492] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.753640 30972 ts_tablet_manager.cc:1403] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:19:43.756122 30972 raft_consensus.cc:359] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.756655 30972 raft_consensus.cc:740] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.757385 30972 consensus_queue.cc:260] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.759446 30972 ts_tablet_manager.cc:1434] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:43.761268 30972 tablet_bootstrap.cc:492] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.780436 30972 tablet_bootstrap.cc:492] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.781306 30972 tablet_bootstrap.cc:492] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.781930 30972 ts_tablet_manager.cc:1403] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
I20260709 12:19:43.784528 30972 raft_consensus.cc:359] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.785257 30972 raft_consensus.cc:740] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.785863 30972 consensus_queue.cc:260] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.787505 30972 ts_tablet_manager.cc:1434] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.003s
I20260709 12:19:43.788688 30972 tablet_bootstrap.cc:492] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.829627 30972 tablet_bootstrap.cc:492] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.830724 30972 tablet_bootstrap.cc:492] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.831453 30972 ts_tablet_manager.cc:1403] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.043s	user 0.028s	sys 0.008s
I20260709 12:19:43.834441 30972 raft_consensus.cc:359] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.835160 30972 raft_consensus.cc:740] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.835901 30972 consensus_queue.cc:260] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.838399 30972 ts_tablet_manager.cc:1434] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:43.840170 30972 tablet_bootstrap.cc:492] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.857407 30972 tablet_bootstrap.cc:492] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.858337 30972 tablet_bootstrap.cc:492] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.858860 30972 ts_tablet_manager.cc:1403] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:19:43.860865 30972 raft_consensus.cc:359] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.861505 30972 raft_consensus.cc:740] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.862164 30972 consensus_queue.cc:260] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.864194 30972 ts_tablet_manager.cc:1434] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:43.864910 30972 tablet_bootstrap.cc:492] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.879004 30972 tablet_bootstrap.cc:492] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.879793 30972 tablet_bootstrap.cc:492] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.880343 30972 ts_tablet_manager.cc:1403] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:19:43.882668 30972 raft_consensus.cc:359] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.883298 30972 raft_consensus.cc:740] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.883946 30972 consensus_queue.cc:260] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.886202 30972 ts_tablet_manager.cc:1434] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:19:43.887051 30972 tablet_bootstrap.cc:492] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.900425 31015 raft_consensus.cc:3060] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:43.911468 30972 tablet_bootstrap.cc:492] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.912482 30972 tablet_bootstrap.cc:492] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.913090 30972 ts_tablet_manager.cc:1403] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.012s
I20260709 12:19:43.915619 30972 raft_consensus.cc:359] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.916751 30972 raft_consensus.cc:740] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.917598 30972 consensus_queue.cc:260] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.919606 30972 ts_tablet_manager.cc:1434] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:19:43.920286 30972 tablet_bootstrap.cc:492] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.931833 30972 tablet_bootstrap.cc:492] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.932711 30972 tablet_bootstrap.cc:492] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.933300 30972 ts_tablet_manager.cc:1403] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:19:43.935745 30972 raft_consensus.cc:359] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.936278 30972 raft_consensus.cc:740] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.936892 30972 consensus_queue.cc:260] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:43.938431 30972 ts_tablet_manager.cc:1434] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:19:43.939424 30972 tablet_bootstrap.cc:492] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.954254 30972 tablet_bootstrap.cc:492] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.955065 30972 tablet_bootstrap.cc:492] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.955647 30972 ts_tablet_manager.cc:1403] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 12:19:43.957711 30972 raft_consensus.cc:359] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.958360 30972 raft_consensus.cc:740] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.959005 30972 consensus_queue.cc:260] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:43.960750 30972 ts_tablet_manager.cc:1434] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:19:43.961391 30972 tablet_bootstrap.cc:492] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:43.985601 31014 raft_consensus.cc:3060] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:43.985649 30972 tablet_bootstrap.cc:492] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.986963 30972 tablet_bootstrap.cc:492] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:43.987641 30972 ts_tablet_manager.cc:1403] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.004s
I20260709 12:19:43.990041 30972 raft_consensus.cc:359] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.990691 30972 raft_consensus.cc:740] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:43.991318 30972 consensus_queue.cc:260] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:43.993707 30972 ts_tablet_manager.cc:1434] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:19:43.994655 30972 tablet_bootstrap.cc:492] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:44.008623 30972 tablet_bootstrap.cc:492] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:44.009460 30972 tablet_bootstrap.cc:492] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:44.010092 30972 ts_tablet_manager.cc:1403] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 12:19:44.012581 30972 raft_consensus.cc:359] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:44.013119 30972 raft_consensus.cc:740] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.013691 30972 consensus_queue.cc:260] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:44.015604 30972 ts_tablet_manager.cc:1434] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:44.016625 30972 tablet_bootstrap.cc:492] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: Bootstrap starting.
I20260709 12:19:44.030501 30972 tablet_bootstrap.cc:492] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:44.031314 30972 tablet_bootstrap.cc:492] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: Bootstrap complete.
I20260709 12:19:44.031921 30972 ts_tablet_manager.cc:1403] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 12:19:44.034439 30972 raft_consensus.cc:359] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:44.035091 30972 raft_consensus.cc:740] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Initialized, Role: FOLLOWER
I20260709 12:19:44.035712 30972 consensus_queue.cc:260] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:44.039933 30972 ts_tablet_manager.cc:1434] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:19:44.087473 31014 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:44.099360 31020 raft_consensus.cc:3060] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.297170 31014 raft_consensus.cc:3060] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.372529 31015 raft_consensus.cc:3060] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.548723 31015 raft_consensus.cc:3060] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:44.574896 31015 raft_consensus.cc:3060] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:49.785393 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:49.856534 30420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5"
dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:19:49.857043 30420 raft_consensus.cc:606] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:49.869194 30349 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3"
dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:37294
I20260709 12:19:49.869619 30349 raft_consensus.cc:606] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:49.871841 30420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d"
dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:19:49.872305 30420 raft_consensus.cc:606] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 3 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:49.877151 30420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309"
dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:19:49.877677 30420 raft_consensus.cc:606] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:49.880018 30420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131"
dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:19:49.880513 30420 raft_consensus.cc:606] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:49.892040 30270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741"
dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:46464
I20260709 12:19:49.892530 30270 raft_consensus.cc:606] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:49.893689 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:49.895394 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:49.896353 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:49.939514 30889 raft_consensus.cc:993] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:49.940021 31104 raft_consensus.cc:1081] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:49.941316 31014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52672
I20260709 12:19:49.941882 31014 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:49.942499 31014 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:49.948982 31014 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:49.950431 31014 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:49.951282 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:49.951406 30420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:49.951911 30349 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:49.952276 30420 raft_consensus.cc:3055] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:49.952778 30420 raft_consensus.cc:740] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:49.953506 30420 consensus_queue.cc:260] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:49.954538 30420 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:49.957741 30349 raft_consensus.cc:2468] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:49.959197 30967 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:49.959441 30420 raft_consensus.cc:2468] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:49.961946 31290 raft_consensus.cc:2804] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:49.963238 31290 raft_consensus.cc:697] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:49.964037 31290 consensus_queue.cc:237] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:49.973930 30099 catalog_manager.cc:5697] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 2 to 3, leader changed from cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.001978 31280 raft_consensus.cc:993] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.002462 31222 raft_consensus.cc:1081] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.003984 31014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:50.004390 31014 raft_consensus.cc:493] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.004626 31014 raft_consensus.cc:3060] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.011059 31014 raft_consensus.cc:515] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:50.013139 31014 leader_election.cc:290] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:50.013981 30270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:50.014829 30270 raft_consensus.cc:3055] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.015062 30270 raft_consensus.cc:740] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:50.016207 30270 consensus_queue.cc:260] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:50.017311 30270 raft_consensus.cc:3060] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.019547 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5da03165521429c98ebf81c89a7b741" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:50.020169 30349 raft_consensus.cc:3060] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.025164 30270 raft_consensus.cc:2468] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:50.026325 30968 leader_election.cc:304] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:50.026575 30349 raft_consensus.cc:2468] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:50.027155 31290 raft_consensus.cc:2804] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.027645 31290 raft_consensus.cc:697] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:50.028498 31290 consensus_queue.cc:237] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:50.037858 30099 catalog_manager.cc:5697] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 1 to 2, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.047451 31104 raft_consensus.cc:993] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.047844 30889 raft_consensus.cc:1081] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 3 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.049015 31014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52672
I20260709 12:19:50.049396 31014 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.049614 31014 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:50.054386 31014 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:50.056560 31014 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 4 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:50.056710 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:50.057345 30418 raft_consensus.cc:3055] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:19:50.057420 30270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ec1ac5431f2413f96552ad10bbd800d" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:50.057677 30418 raft_consensus.cc:740] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:50.058012 30270 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:50.058437 30418 consensus_queue.cc:260] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:50.060770 30418 raft_consensus.cc:3060] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:50.069219 30418 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 4.
I20260709 12:19:50.070925 30966 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:50.071758 31290 raft_consensus.cc:2804] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:50.072278 31290 raft_consensus.cc:697] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 4 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:50.073450 31290 consensus_queue.cc:237] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:50.074553 30270 raft_consensus.cc:2468] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 4.
I20260709 12:19:50.085449 30099 catalog_manager.cc:5697] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 3 to 4, leader changed from cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 4 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.148231 30889 raft_consensus.cc:993] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.148703 31104 raft_consensus.cc:1081] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.150317 31014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52672
I20260709 12:19:50.150862 31014 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.151197 31014 raft_consensus.cc:3060] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:50.156416 31014 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:50.158077 31014 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:50.158727 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:50.159101 30270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71502abf53ca4ef3b1193915fa8c2309" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:50.159350 30418 raft_consensus.cc:3055] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:50.159641 30270 raft_consensus.cc:3060] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:50.159653 30418 raft_consensus.cc:740] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:50.160646 30418 consensus_queue.cc:260] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:50.161854 30418 raft_consensus.cc:3060] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:50.165140 30270 raft_consensus.cc:2468] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:50.166216 30968 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:50.166930 31290 raft_consensus.cc:2804] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:50.167330 31290 raft_consensus.cc:697] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:50.168056 31290 consensus_queue.cc:237] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:50.169282 30418 raft_consensus.cc:2468] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:50.176970 30099 catalog_manager.cc:5697] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 2 to 3, leader changed from cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:50.186918 30889 raft_consensus.cc:993] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.187331 31104 raft_consensus.cc:1081] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.188541 31014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52672
I20260709 12:19:50.188958 31014 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.189179 31014 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:50.194931 31014 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:50.196560 31014 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:50.197191 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:50.197679 30349 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:50.198869 30418 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:50.199362 30418 raft_consensus.cc:3055] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:50.199550 30418 raft_consensus.cc:740] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:50.200181 30418 consensus_queue.cc:260] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:50.201035 30418 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:50.202191 30349 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:50.203150 30967 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:50.203936 31290 raft_consensus.cc:2804] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:50.204434 31290 raft_consensus.cc:697] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:50.205261 31290 consensus_queue.cc:237] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:50.206442 30418 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:50.215718 30099 catalog_manager.cc:5697] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 2 to 3, leader changed from cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.293072 31301 raft_consensus.cc:993] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.293826 31301 raft_consensus.cc:1081] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:50.295462 31014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52662
I20260709 12:19:50.296011 31014 raft_consensus.cc:493] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:50.296289 31014 raft_consensus.cc:3060] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.300941 31014 raft_consensus.cc:515] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:50.303242 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:50.303362 30420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:50.303838 30349 raft_consensus.cc:3055] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:50.303918 30420 raft_consensus.cc:3060] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.304224 30349 raft_consensus.cc:740] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:50.304948 30349 consensus_queue.cc:260] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:50.305341 31014 leader_election.cc:290] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:50.306038 30349 raft_consensus.cc:3060] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:50.310783 30420 raft_consensus.cc:2468] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:50.311816 30966 leader_election.cc:304] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:50.312665 31290 raft_consensus.cc:2804] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:50.312605 30349 raft_consensus.cc:2468] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:50.313395 31290 raft_consensus.cc:697] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:50.314263 31290 consensus_queue.cc:237] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:50.324958 30099 catalog_manager.cc:5697] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 1 to 2, leader changed from 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:50.457645 30420 raft_consensus.cc:1275] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:50.458945 31290 consensus_queue.cc:1048] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:50.471032 30346 raft_consensus.cc:1275] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:50.477620 31291 consensus_queue.cc:1048] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:50.517289 30349 raft_consensus.cc:1275] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.519093 31307 consensus_queue.cc:1048] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.530848 30270 raft_consensus.cc:1275] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.532073 31290 consensus_queue.cc:1048] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.587867 30270 raft_consensus.cc:1275] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 4 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:50.589241 31290 consensus_queue.cc:1048] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:50.598104 30420 raft_consensus.cc:1275] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:19:50.599849 31290 consensus_queue.cc:1048] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:50.617482 30346 raft_consensus.cc:1275] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:50.618752 31315 consensus_queue.cc:1048] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:50.630023 30420 raft_consensus.cc:1275] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:50.632321 31290 consensus_queue.cc:1048] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:50.709720 30420 raft_consensus.cc:1275] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:50.710937 31290 consensus_queue.cc:1048] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:50.721030 30270 raft_consensus.cc:1275] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:50.722687 31307 consensus_queue.cc:1048] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:50.788707 30349 raft_consensus.cc:1275] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.790447 31290 consensus_queue.cc:1048] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:50.844501 30424 raft_consensus.cc:1275] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:50.846182 31315 consensus_queue.cc:1048] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:50.931391 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:50.968729 30420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43"
dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
mode: GRACEFUL
new_leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:19:50.969237 30420 raft_consensus.cc:606] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Received request to transfer leadership to TS 0cd3caf5ad334c0cb6e695ee74a83268
I20260709 12:19:50.971639 30420 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54a5db9cc7d848d191162399432049df"
dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:58634
I20260709 12:19:50.972098 30420 raft_consensus.cc:606] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:50.974639 30270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec"
dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:46464
I20260709 12:19:50.975206 30270 raft_consensus.cc:606] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:50.977705 30270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369"
dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:46464
I20260709 12:19:50.978153 30270 raft_consensus.cc:606] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:50.980432 30270 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2e1e509bcc54ae485169e45c1649db8"
dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:46464
I20260709 12:19:50.980892 30270 raft_consensus.cc:606] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:50.982023 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:50.983706 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:50.984450 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:51.076229 31104 raft_consensus.cc:993] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:51.076825 30889 raft_consensus.cc:1081] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:51.078361 31014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "54a5db9cc7d848d191162399432049df"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52672
I20260709 12:19:51.078891 31014 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:51.079272 31014 raft_consensus.cc:3060] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:51.083840 31014 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:51.085633 31014 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:51.086314 30420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:51.086588 30270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54a5db9cc7d848d191162399432049df" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:51.087167 30420 raft_consensus.cc:3055] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:51.087244 30270 raft_consensus.cc:3060] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:51.087569 30420 raft_consensus.cc:740] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:51.088333 30420 consensus_queue.cc:260] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:51.089715 30420 raft_consensus.cc:3060] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:51.093685 30270 raft_consensus.cc:2468] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:51.094765 30968 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:51.095079 30420 raft_consensus.cc:2468] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:51.095618 31315 raft_consensus.cc:2804] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:51.096282 31315 raft_consensus.cc:697] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:51.097167 31315 consensus_queue.cc:237] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:51.109900 30099 catalog_manager.cc:5697] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 2 to 3, leader changed from cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.252701 30889 raft_consensus.cc:993] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659: : Instructing follower 0cd3caf5ad334c0cb6e695ee74a83268 to start an election
I20260709 12:19:51.253149 31104 raft_consensus.cc:1081] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Signalling peer 0cd3caf5ad334c0cb6e695ee74a83268 to start an election
I20260709 12:19:51.254664 30349 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43"
dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
 from {username='slave'} at 127.0.0.1:34064
I20260709 12:19:51.255144 30349 raft_consensus.cc:493] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:51.255416 30349 raft_consensus.cc:3060] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.262784 30349 raft_consensus.cc:515] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:51.264640 30349 leader_election.cc:290] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:51.265645 30270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:51.265640 30420 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d376ce929ab4707a05d036b3f6fdd43" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:51.266664 30270 raft_consensus.cc:3060] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.266675 30420 raft_consensus.cc:3055] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:51.267194 30420 raft_consensus.cc:740] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:51.267922 30420 consensus_queue.cc:260] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:51.269098 30420 raft_consensus.cc:3060] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.273684 30270 raft_consensus.cc:2468] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:51.275072 30317 leader_election.cc:304] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52; no voters: 
I20260709 12:19:51.275839 31302 raft_consensus.cc:2804] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:51.276067 30420 raft_consensus.cc:2468] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:51.276300 31302 raft_consensus.cc:697] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:51.277423 31302 consensus_queue.cc:237] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:51.290668 30099 catalog_manager.cc:5697] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 1 to 2, leader changed from cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.315295 31280 raft_consensus.cc:993] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:51.315711 31285 raft_consensus.cc:1081] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:51.317066 31014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:51.317557 31014 raft_consensus.cc:493] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:51.317860 31014 raft_consensus.cc:3060] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.325711 31014 raft_consensus.cc:515] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:51.327348 31014 leader_election.cc:290] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:51.328282 30270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:51.328996 30270 raft_consensus.cc:3055] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:51.328918 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b74bb8b13534e8daf883dde16e187ec" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:51.329457 30270 raft_consensus.cc:740] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:51.329602 30424 raft_consensus.cc:3060] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.330229 30270 consensus_queue.cc:260] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:51.331321 30270 raft_consensus.cc:3060] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.336762 30424 raft_consensus.cc:2468] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:51.337845 30966 leader_election.cc:304] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:51.337899 30270 raft_consensus.cc:2468] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:51.338691 31315 raft_consensus.cc:2804] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:51.339226 31315 raft_consensus.cc:697] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:51.340001 31315 consensus_queue.cc:237] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:51.352512 30099 catalog_manager.cc:5697] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 1 to 2, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.381398 31330 raft_consensus.cc:993] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:51.381862 31330 raft_consensus.cc:1081] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:51.383244 31014 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2e1e509bcc54ae485169e45c1649db8"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:51.383703 31014 raft_consensus.cc:493] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:51.384007 31014 raft_consensus.cc:3060] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.389886 31014 raft_consensus.cc:515] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:51.393062 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e1e509bcc54ae485169e45c1649db8" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:51.393611 30424 raft_consensus.cc:3060] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.394224 31014 leader_election.cc:290] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:51.394778 30270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e1e509bcc54ae485169e45c1649db8" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:51.395327 30270 raft_consensus.cc:3055] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:51.395624 30270 raft_consensus.cc:740] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:51.396323 30270 consensus_queue.cc:260] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:51.397504 30270 raft_consensus.cc:3060] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:51.404510 30424 raft_consensus.cc:2468] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:51.405916 30966 leader_election.cc:304] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:51.406328 30270 raft_consensus.cc:2468] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:51.406819 31315 raft_consensus.cc:2804] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:51.407382 31315 raft_consensus.cc:697] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:51.408190 31315 consensus_queue.cc:237] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:51.417371 30099 catalog_manager.cc:5697] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 1 to 2, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.749255 30271 raft_consensus.cc:1275] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.751977 31336 consensus_queue.cc:1048] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:51.819483 30424 raft_consensus.cc:1275] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:51.824573 31329 raft_consensus.cc:993] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:51.825150 31330 raft_consensus.cc:1081] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:51.827272 30274 raft_consensus.cc:1275] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.835397 31315 consensus_queue.cc:1048] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:51.834115 31307 consensus_queue.cc:1048] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:19:51.835402 31018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:51.838963 31018 raft_consensus.cc:493] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:51.839433 31018 raft_consensus.cc:3060] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:51.850930 31018 raft_consensus.cc:515] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:51.852970 30426 raft_consensus.cc:1275] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.854765 31018 leader_election.cc:290] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:51.855098 31336 consensus_queue.cc:1048] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:51.833453 30271 raft_consensus.cc:1275] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:51.863065 30349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:51.863826 30349 raft_consensus.cc:3060] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:51.888485 30349 raft_consensus.cc:2468] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:51.890187 31307 consensus_queue.cc:1048] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:51.891669 30967 leader_election.cc:304] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:51.892882 31315 raft_consensus.cc:2804] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:51.893436 31315 raft_consensus.cc:697] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:51.894560 31315 consensus_queue.cc:237] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:51.969384 30419 raft_consensus.cc:1275] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:51.972954 31307 consensus_queue.cc:1048] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:51.992436 30348 raft_consensus.cc:1240] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Rejecting Update request from peer f03b88e02d9c4039964e2ab17a35bf52 for earlier term 2. Current term is 3. Ops: []
I20260709 12:19:52.004153 30274 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a07a59f629f04857b16b3ce29fdb6369" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:52.005332 30274 raft_consensus.cc:3055] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:52.005950 30274 raft_consensus.cc:740] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:52.006382 30101 catalog_manager.cc:5697] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 2 to 3, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:51.996213 30424 raft_consensus.cc:1275] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:52.012310 30274 consensus_queue.cc:260] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:52.021656 30274 raft_consensus.cc:3060] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.027309 30277 raft_consensus.cc:1275] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:52.041975 31315 consensus_queue.cc:1048] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:19:52.046558 31307 consensus_queue.cc:1048] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:52.079860 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:52.110728 31351 log.cc:927] Time spent T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52: Append to log took a long time: real 0.075s	user 0.006s	sys 0.000s
I20260709 12:19:52.147251 30274 raft_consensus.cc:2468] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:52.271292 30277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c"
dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:46464
I20260709 12:19:52.272149 30277 raft_consensus.cc:606] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:52.275388 30277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0"
dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:46464
I20260709 12:19:52.275925 30277 raft_consensus.cc:606] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:52.278434 30348 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3"
dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:37294
I20260709 12:19:52.278903 30348 raft_consensus.cc:606] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:52.281057 30277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6"
dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
mode: GRACEFUL
new_leader_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:46464
I20260709 12:19:52.281553 30277 raft_consensus.cc:606] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Received request to transfer leadership to TS 777b1410f165436aa725262b964ff0a6
I20260709 12:19:52.282618 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:19:52.283759 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:52.284525 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:52.301204 30277 raft_consensus.cc:1275] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:52.302485 31291 consensus_queue.cc:1048] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:52.317435 30349 raft_consensus.cc:1275] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:52.322127 31291 consensus_queue.cc:1048] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:19:52.390264 31285 raft_consensus.cc:993] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:52.390858 31280 raft_consensus.cc:1081] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:52.392340 31015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:52.392874 31015 raft_consensus.cc:493] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:52.393200 31015 raft_consensus.cc:3060] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.401087 31015 raft_consensus.cc:515] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:52.403170 31015 leader_election.cc:290] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:52.404093 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:52.404168 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1901a31d4f045d7af7afe28951681d6" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:52.404790 30426 raft_consensus.cc:3060] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.404874 30277 raft_consensus.cc:3055] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:52.405344 30277 raft_consensus.cc:740] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:52.406042 30277 consensus_queue.cc:260] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:52.407015 30277 raft_consensus.cc:3060] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.410126 30426 raft_consensus.cc:2468] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:52.411662 30966 leader_election.cc:304] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:52.412575 31307 raft_consensus.cc:2804] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.413056 31307 raft_consensus.cc:697] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:52.413630 30277 raft_consensus.cc:2468] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:52.413991 31307 consensus_queue.cc:237] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:52.423691 30099 catalog_manager.cc:5697] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 1 to 2, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.470412 31336 raft_consensus.cc:993] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:52.471225 31336 raft_consensus.cc:1081] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:52.472966 31018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52662
I20260709 12:19:52.473704 31018 raft_consensus.cc:493] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:52.474051 31018 raft_consensus.cc:3060] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.483767 31018 raft_consensus.cc:515] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:52.486548 31018 leader_election.cc:290] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:52.486747 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:52.488019 30348 raft_consensus.cc:3055] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:52.488309 30348 raft_consensus.cc:740] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:52.489142 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:52.489053 30348 consensus_queue.cc:260] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:52.489717 30426 raft_consensus.cc:3060] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.491169 30348 raft_consensus.cc:3060] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.496995 30426 raft_consensus.cc:2468] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:52.498009 30348 raft_consensus.cc:2468] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:52.498056 30966 leader_election.cc:304] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:52.499035 31307 raft_consensus.cc:2804] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.499495 31307 raft_consensus.cc:697] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:52.500293 31307 consensus_queue.cc:237] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:52.508317 30099 catalog_manager.cc:5697] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 1 to 2, leader changed from 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.537923 31285 raft_consensus.cc:993] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:52.538437 31280 raft_consensus.cc:1081] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:52.539976 31018 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:52.540514 31018 raft_consensus.cc:493] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:52.540864 31018 raft_consensus.cc:3060] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.546809 31018 raft_consensus.cc:515] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:52.548544 31018 leader_election.cc:290] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:52.548928 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:52.549527 30277 raft_consensus.cc:3055] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:19:52.549796 30277 raft_consensus.cc:740] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:52.550534 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1466b047b58a4d00b64fdb9da5d34c2c" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:52.551092 30348 raft_consensus.cc:3060] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.550545 30277 consensus_queue.cc:260] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:52.554174 30277 raft_consensus.cc:3060] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:52.557598 30348 raft_consensus.cc:2468] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:52.559010 30967 leader_election.cc:304] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:52.559877 31291 raft_consensus.cc:2804] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:52.560318 31291 raft_consensus.cc:697] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:52.561250 31291 consensus_queue.cc:237] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:52.563107 30277 raft_consensus.cc:2468] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 2.
I20260709 12:19:52.571998 30099 catalog_manager.cc:5697] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 1 to 2, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:52.604645 30299 debug-util.cc:398] Leaking SignalData structure 0x7b080022b8c0 after lost signal to thread 22723
W20260709 12:19:52.605808 30299 debug-util.cc:398] Leaking SignalData structure 0x7b080022bfa0 after lost signal to thread 30135
W20260709 12:19:52.607015 30299 debug-util.cc:398] Leaking SignalData structure 0x7b0800052500 after lost signal to thread 30302
W20260709 12:19:52.608063 30299 debug-util.cc:398] Leaking SignalData structure 0x7b080020a6c0 after lost signal to thread 30376
W20260709 12:19:52.609385 30299 debug-util.cc:398] Leaking SignalData structure 0x7b08001410a0 after lost signal to thread 30450
W20260709 12:19:52.611136 30299 debug-util.cc:398] Leaking SignalData structure 0x7b0800196860 after lost signal to thread 31045
I20260709 12:19:52.658838 31329 raft_consensus.cc:993] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52: : Instructing follower 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:52.659394 31329 raft_consensus.cc:1081] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Signalling peer 777b1410f165436aa725262b964ff0a6 to start an election
I20260709 12:19:52.660768 31015 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0"
dest_uuid: "777b1410f165436aa725262b964ff0a6"
 from {username='slave'} at 127.0.0.1:52646
I20260709 12:19:52.661208 31015 raft_consensus.cc:493] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:52.661478 31015 raft_consensus.cc:3060] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.666481 31015 raft_consensus.cc:515] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:52.668131 31015 leader_election.cc:290] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:52.668708 30277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f03b88e02d9c4039964e2ab17a35bf52"
I20260709 12:19:52.669278 30277 raft_consensus.cc:3055] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:19:52.669581 30277 raft_consensus.cc:740] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f03b88e02d9c4039964e2ab17a35bf52, State: Running, Role: LEADER
I20260709 12:19:52.669647 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66ce942f42cf4c98adff100bd7b02ea0" candidate_uuid: "777b1410f165436aa725262b964ff0a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:52.671727 30348 raft_consensus.cc:3060] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.671446 30277 consensus_queue.cc:260] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:52.676908 30277 raft_consensus.cc:3060] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:19:52.677651 30348 raft_consensus.cc:2468] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:52.679435 30967 leader_election.cc:304] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6; no voters: 
I20260709 12:19:52.680187 31291 raft_consensus.cc:2804] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:52.680646 31291 raft_consensus.cc:697] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Becoming Leader. State: Replica: 777b1410f165436aa725262b964ff0a6, State: Running, Role: LEADER
I20260709 12:19:52.681594 31291 consensus_queue.cc:237] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:52.684279 30277 raft_consensus.cc:2468] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 777b1410f165436aa725262b964ff0a6 in term 3.
I20260709 12:19:52.695063 30099 catalog_manager.cc:5697] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 reported cstate change: term changed from 2 to 3, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 777b1410f165436aa725262b964ff0a6 (127.22.48.1). New cstate: current_term: 3 leader_uuid: "777b1410f165436aa725262b964ff0a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.978766 30419 raft_consensus.cc:1275] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:52.980103 31291 consensus_queue.cc:1048] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:52.995067 30277 raft_consensus.cc:1275] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:52.998065 31291 consensus_queue.cc:1048] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.007934 30344 raft_consensus.cc:1275] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.012945 31307 consensus_queue.cc:1048] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.019562 30270 raft_consensus.cc:1275] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.021899 31291 consensus_queue.cc:1048] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.045099 30348 raft_consensus.cc:1275] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.053328 31291 consensus_queue.cc:1048] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.067834 30419 raft_consensus.cc:1275] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:53.070360 31315 consensus_queue.cc:1048] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:19:53.072835 30274 raft_consensus.cc:1275] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:53.077258 31315 consensus_queue.cc:1048] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:53.126847 30348 raft_consensus.cc:1275] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Refusing update from remote peer 777b1410f165436aa725262b964ff0a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:53.131322 31307 consensus_queue.cc:1048] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:19:53.337052 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:53.378010 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:19:53.379346 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:53.379835 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:53.426853 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:53.472234 22720 tablet_server.cc:179] TabletServer@127.22.48.1:33137 shutting down...
W20260709 12:19:53.479775 30392 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 38 similar messages]
W20260709 12:19:53.502240 30392 consensus_peers.cc:597] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.540079 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:19:53.541147 30318 consensus_peers.cc:597] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.541498 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.543035 22720 raft_consensus.cc:2243] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.543727 22720 raft_consensus.cc:2272] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.547561 30318 consensus_peers.cc:597] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.547716 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.548956 22720 raft_consensus.cc:2243] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.549679 22720 raft_consensus.cc:2272] T a243cb1e81a84b1681899e957182bf40 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.551595 30318 consensus_peers.cc:597] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.553184 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.554363 22720 raft_consensus.cc:2243] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.554937 22720 raft_consensus.cc:2272] T 22e1306c0565463d9f7dd00b385e55c7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.558219 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.559274 22720 raft_consensus.cc:2243] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.560406 22720 raft_consensus.cc:2272] T 1466b047b58a4d00b64fdb9da5d34c2c P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.564796 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.565848 22720 raft_consensus.cc:2243] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.566422 22720 raft_consensus.cc:2272] T e44d3048f1f74e7481b0772d32316b86 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.569563 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.570595 22720 raft_consensus.cc:2243] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.571024 22720 raft_consensus.cc:2272] T 8f971b17bc9742d38fdccaea1020084a P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.573623 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.574239 22720 raft_consensus.cc:2243] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.574714 22720 raft_consensus.cc:2272] T 8cef54b2bf92402f9064be5769a44bd9 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.577455 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.578159 22720 raft_consensus.cc:2243] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.579308 22720 raft_consensus.cc:2272] T a5da03165521429c98ebf81c89a7b741 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.583819 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.584712 22720 raft_consensus.cc:2243] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.585186 22720 raft_consensus.cc:2272] T 623336ab8b78487db7b5b817879e958e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.588435 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.589505 22720 raft_consensus.cc:2243] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.590066 22720 raft_consensus.cc:2272] T 0a9b5ed70fdf49c0bf254214d8ca297c P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.593111 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.594061 22720 raft_consensus.cc:2243] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.595199 22720 raft_consensus.cc:2272] T 6ec1ac5431f2413f96552ad10bbd800d P 777b1410f165436aa725262b964ff0a6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.597910 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.598730 22720 raft_consensus.cc:2243] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.599840 22720 raft_consensus.cc:2272] T 71502abf53ca4ef3b1193915fa8c2309 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.603260 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.604144 22720 raft_consensus.cc:2243] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.605091 22720 raft_consensus.cc:2272] T afd6a0afe3684c689a3587a53a560ec3 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.609565 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.610352 22720 raft_consensus.cc:2243] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.611239 22720 raft_consensus.cc:2272] T f2e1e509bcc54ae485169e45c1649db8 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.613981 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.615068 22720 raft_consensus.cc:2243] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.615634 22720 raft_consensus.cc:2272] T 513668c5dbf240ab8c90da19361cac60 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.620332 22720 tablet_replica.cc:333] stopping tablet replica
W20260709 12:19:53.621059 30244 consensus_peers.cc:597] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.621304 22720 raft_consensus.cc:2243] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.622880 22720 raft_consensus.cc:2272] T 66ce942f42cf4c98adff100bd7b02ea0 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.630077 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.631310 22720 raft_consensus.cc:2243] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.632084 22720 raft_consensus.cc:2272] T 135faf5d4c1c461f818d5c4131fcf51d P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.634984 30392 consensus_peers.cc:597] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.635717 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.636857 22720 raft_consensus.cc:2243] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.637531 22720 raft_consensus.cc:2272] T 35d4a018024842a99a90f4bcc2a6887c P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.641347 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.642316 22720 raft_consensus.cc:2243] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.642952 22720 raft_consensus.cc:2272] T 9164fff77d194553bf16a7020fb1546a P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.646909 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.648518 22720 raft_consensus.cc:2243] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.649173 22720 raft_consensus.cc:2272] T 89955984673a4c1a984a5c1c5569ebe7 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.652283 30244 consensus_peers.cc:597] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.652626 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.653650 22720 raft_consensus.cc:2243] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.654894 22720 raft_consensus.cc:2272] T 54a5db9cc7d848d191162399432049df P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.658142 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.659087 22720 raft_consensus.cc:2243] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.660096 22720 raft_consensus.cc:2272] T e1901a31d4f045d7af7afe28951681d6 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.663724 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.664718 22720 raft_consensus.cc:2243] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.665382 22720 raft_consensus.cc:2272] T f8f7f948772a44d189f9c2255d68385e P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.665732 30392 consensus_peers.cc:597] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.668458 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.669435 22720 raft_consensus.cc:2243] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.670083 22720 raft_consensus.cc:2272] T dee40afb40fa45f8969bce6b71285204 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.673440 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.674337 22720 raft_consensus.cc:2243] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.675209 22720 raft_consensus.cc:2272] T ff03218495d14467b6f1a3ddc083aed9 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.678870 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.679704 22720 raft_consensus.cc:2243] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.680409 22720 raft_consensus.cc:2272] T 373645f6f2614fa5a09fd23279ce7973 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.684243 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.685168 22720 raft_consensus.cc:2243] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.685787 22720 raft_consensus.cc:2272] T 9d78f4a893e8471a8324169a33739e06 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.688589 30392 consensus_peers.cc:597] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.689190 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.690124 22720 raft_consensus.cc:2243] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.690696 22720 raft_consensus.cc:2272] T 4290068162194444a3f4d05ad418ca30 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.693890 30244 consensus_peers.cc:597] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.695132 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.696118 22720 raft_consensus.cc:2243] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.696750 22720 raft_consensus.cc:2272] T 658e0669fba3478e91574f80953b72b7 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.700065 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.700984 22720 raft_consensus.cc:2243] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.702152 22720 raft_consensus.cc:2272] T 783cd53e9f4142348a23db0cbf9cd131 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.705523 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.706346 22720 raft_consensus.cc:2243] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:53.706710 30318 consensus_peers.cc:597] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.706854 22720 raft_consensus.cc:2272] T 82b7f80a887443338c7b69d68b9e4886 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.710115 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.710994 22720 raft_consensus.cc:2243] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.711975 22720 raft_consensus.cc:2272] T a07a59f629f04857b16b3ce29fdb6369 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.714872 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.715735 22720 raft_consensus.cc:2243] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.716473 22720 raft_consensus.cc:2272] T 3a54afd7ab154ec88c23d17fc3926282 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.717345 30244 consensus_peers.cc:597] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.718035 30392 consensus_peers.cc:597] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.719535 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.720489 22720 raft_consensus.cc:2243] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.721046 22720 raft_consensus.cc:2272] T 33b3f7db61ad4d6e9464016245ab8079 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.722611 30392 consensus_peers.cc:597] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.724222 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.725210 22720 raft_consensus.cc:2243] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.725835 22720 raft_consensus.cc:2272] T 786293768cab4265a62418294d3f895b P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.729204 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.730057 22720 raft_consensus.cc:2243] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.731191 22720 raft_consensus.cc:2272] T 5a1ee8472def40b1a4437e3ba0e495f3 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.734323 22720 tablet_replica.cc:333] stopping tablet replica
W20260709 12:19:53.734573 30392 consensus_peers.cc:597] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.735169 22720 raft_consensus.cc:2243] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.735734 22720 raft_consensus.cc:2272] T 6e383c3fc4184c4ba49ba4d78433d661 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.738694 22720 tablet_replica.cc:333] stopping tablet replica
W20260709 12:19:53.738754 30244 consensus_peers.cc:597] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.739616 22720 raft_consensus.cc:2243] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.740219 22720 raft_consensus.cc:2272] T ac00a693be1041d8b90ef03408a91eab P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.743203 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.744021 22720 raft_consensus.cc:2243] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.744622 22720 raft_consensus.cc:2272] T a9b4e218f7bb4c3aa64bae842061937a P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.747650 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.748380 22720 raft_consensus.cc:2243] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.749405 22720 raft_consensus.cc:2272] T 6b74bb8b13534e8daf883dde16e187ec P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.752663 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.753412 22720 raft_consensus.cc:2243] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.754045 22720 raft_consensus.cc:2272] T 752fdec2f7b64590b55660b4d839c0ea P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.757293 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.758009 22720 raft_consensus.cc:2243] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:53.759056 22720 raft_consensus.cc:2272] T 5204ef0b216a4f66889d2612e1f673b5 P 777b1410f165436aa725262b964ff0a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.762163 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.763015 22720 raft_consensus.cc:2243] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.763577 22720 raft_consensus.cc:2272] T 4ff5b4e1a9b549f69fa44610140ab684 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.766650 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.767390 22720 raft_consensus.cc:2243] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:53.767483 30244 consensus_peers.cc:597] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.767990 22720 raft_consensus.cc:2272] T b715660e336d48828daede8c69a9d353 P 777b1410f165436aa725262b964ff0a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:53.770869 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:19:53.771588 22720 raft_consensus.cc:2243] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:53.772135 22720 raft_consensus.cc:2272] T c9ee34a652a74ed3bac1dc145136bf62 P 777b1410f165436aa725262b964ff0a6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:53.815907 30392 consensus_peers.cc:597] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.823860 30392 consensus_peers.cc:597] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.843770 30318 consensus_peers.cc:597] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.846514 30392 consensus_peers.cc:597] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.853967 30244 consensus_peers.cc:597] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.861560 30244 consensus_peers.cc:597] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.864038 30318 connection.cc:573] client connection to 127.22.48.1:33137 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:19:53.864552 30318 consensus_peers.cc:597] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.875555 30392 consensus_peers.cc:597] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:53.881006 22720 tablet_server.cc:196] TabletServer@127.22.48.1:33137 shutdown complete.
W20260709 12:19:53.944986 30318 consensus_peers.cc:597] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.952229 30244 consensus_peers.cc:597] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.980443 30244 consensus_peers.cc:597] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:53.986860 30318 consensus_peers.cc:597] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.002137 30318 consensus_peers.cc:597] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.009923 22720 tablet_server.cc:179] TabletServer@127.22.48.2:0 shutting down...
W20260709 12:19:54.027153 30244 consensus_peers.cc:597] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.069448 30391 consensus_peers.cc:597] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.074918 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:54.076335 22720 tablet_replica.cc:333] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.077379 22720 raft_consensus.cc:2243] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.078024 22720 raft_consensus.cc:2272] T 54a5db9cc7d848d191162399432049df P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.080932 22720 tablet_replica.cc:333] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.081770 22720 raft_consensus.cc:2243] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.082962 22720 raft_consensus.cc:2272] T 4290068162194444a3f4d05ad418ca30 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.086046 22720 tablet_replica.cc:333] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.086974 22720 raft_consensus.cc:2243] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.087503 22720 raft_consensus.cc:2272] T 8ce9c549b6414f61af3e10fccd6b5001 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.090420 22720 tablet_replica.cc:333] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.091305 22720 raft_consensus.cc:2243] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.092363 22720 raft_consensus.cc:2272] T 2ac3e8c89573415c9575c5a977d36af6 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.095285 22720 tablet_replica.cc:333] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.096199 22720 raft_consensus.cc:2243] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.097311 22720 raft_consensus.cc:2272] T 35d4a018024842a99a90f4bcc2a6887c P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:54.099512 30317 consensus_peers.cc:597] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.099334 30391 consensus_peers.cc:597] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.100239 22720 tablet_replica.cc:333] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.101179 22720 raft_consensus.cc:2243] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.102229 22720 raft_consensus.cc:2272] T 33b3f7db61ad4d6e9464016245ab8079 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.105185 22720 tablet_replica.cc:333] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.106122 22720 raft_consensus.cc:2243] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.107239 22720 raft_consensus.cc:2272] T 6eecf0b507c246e383799261c8caf613 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.110246 22720 tablet_replica.cc:333] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.111054 22720 raft_consensus.cc:2243] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.111609 22720 raft_consensus.cc:2272] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.114427 22720 tablet_replica.cc:333] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.115307 22720 raft_consensus.cc:2243] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.115855 22720 raft_consensus.cc:2272] T f2e1e509bcc54ae485169e45c1649db8 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.118543 22720 tablet_replica.cc:333] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.119357 22720 raft_consensus.cc:2243] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.119977 22720 raft_consensus.cc:2272] T 8f971b17bc9742d38fdccaea1020084a P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.123013 22720 tablet_replica.cc:333] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.124631 22720 raft_consensus.cc:2243] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.125551 22720 raft_consensus.cc:2272] T 89955984673a4c1a984a5c1c5569ebe7 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:54.127578 30317 consensus_peers.cc:597] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.130887 22720 tablet_replica.cc:333] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.131896 22720 raft_consensus.cc:2243] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.132455 22720 raft_consensus.cc:2272] T 0e0bb2451c3442cab4eee04748a2baa0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.135411 22720 tablet_replica.cc:333] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.136312 22720 raft_consensus.cc:2243] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.137414 22720 raft_consensus.cc:2272] T ff03218495d14467b6f1a3ddc083aed9 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.140218 22720 tablet_replica.cc:333] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.141079 22720 raft_consensus.cc:2243] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.141646 22720 raft_consensus.cc:2272] T 3d376ce929ab4707a05d036b3f6fdd43 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.144503 22720 tablet_replica.cc:333] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.145408 22720 raft_consensus.cc:2243] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.145967 22720 raft_consensus.cc:2272] T dee40afb40fa45f8969bce6b71285204 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.148880 22720 tablet_replica.cc:333] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.149786 22720 raft_consensus.cc:2243] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.150766 22720 raft_consensus.cc:2272] T 373645f6f2614fa5a09fd23279ce7973 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.153683 22720 tablet_replica.cc:333] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.157419 22720 raft_consensus.cc:2243] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.158149 22720 raft_consensus.cc:2272] T 9d78f4a893e8471a8324169a33739e06 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.160950 22720 tablet_replica.cc:333] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.161710 22720 raft_consensus.cc:2243] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.162194 22720 raft_consensus.cc:2272] T e1901a31d4f045d7af7afe28951681d6 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.164649 22720 tablet_replica.cc:333] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.165234 22720 raft_consensus.cc:2243] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.166028 22720 raft_consensus.cc:2272] T 902e818d7d70457b93827ef5cf71cdaf P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.169047 22720 tablet_replica.cc:333] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.169811 22720 raft_consensus.cc:2243] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.171164 22720 raft_consensus.cc:2272] T e44d3048f1f74e7481b0772d32316b86 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.173938 22720 tablet_replica.cc:333] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.174741 22720 raft_consensus.cc:2243] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.175266 22720 raft_consensus.cc:2272] T 2db98cf7c8374d57a7606069ab0d00dd P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.178010 22720 tablet_replica.cc:333] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.178807 22720 raft_consensus.cc:2243] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.179818 22720 raft_consensus.cc:2272] T 0308f2a10f594ad78170a8bc09436ffe P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.182668 22720 tablet_replica.cc:333] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.183429 22720 raft_consensus.cc:2243] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.183962 22720 raft_consensus.cc:2272] T a5da03165521429c98ebf81c89a7b741 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.186379 22720 tablet_replica.cc:333] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.187058 22720 raft_consensus.cc:2243] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.187554 22720 raft_consensus.cc:2272] T b715660e336d48828daede8c69a9d353 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.190337 22720 tablet_replica.cc:333] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.191018 22720 raft_consensus.cc:2243] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.191555 22720 raft_consensus.cc:2272] T 4ff5b4e1a9b549f69fa44610140ab684 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.194291 22720 tablet_replica.cc:333] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.195025 22720 raft_consensus.cc:2243] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.195539 22720 raft_consensus.cc:2272] T 6b74bb8b13534e8daf883dde16e187ec P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:54.195597 30317 consensus_peers.cc:597] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.197552 30391 consensus_peers.cc:597] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.198688 22720 tablet_replica.cc:333] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.199558 22720 raft_consensus.cc:2243] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.200075 22720 raft_consensus.cc:2272] T 89100a63be0348a1bf66a13a95a3f8c0 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.202857 22720 tablet_replica.cc:333] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.203621 22720 raft_consensus.cc:2243] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.204211 22720 raft_consensus.cc:2272] T 6ec1ac5431f2413f96552ad10bbd800d P f03b88e02d9c4039964e2ab17a35bf52 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.207114 22720 tablet_replica.cc:333] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.207974 22720 raft_consensus.cc:2243] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.208636 22720 raft_consensus.cc:2272] T 71502abf53ca4ef3b1193915fa8c2309 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.212467 22720 tablet_replica.cc:333] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.213275 22720 raft_consensus.cc:2243] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.213785 22720 raft_consensus.cc:2272] T 66ce942f42cf4c98adff100bd7b02ea0 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.215986 22720 tablet_replica.cc:333] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.216492 22720 raft_consensus.cc:2243] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.217046 22720 raft_consensus.cc:2272] T 623336ab8b78487db7b5b817879e958e P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.219310 22720 tablet_replica.cc:333] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.219820 22720 raft_consensus.cc:2243] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.220629 22720 raft_consensus.cc:2272] T 1e96ebb342bb4ab19893f38827cbfdfc P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.223524 22720 tablet_replica.cc:333] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.224241 22720 raft_consensus.cc:2243] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.225184 22720 raft_consensus.cc:2272] T 752fdec2f7b64590b55660b4d839c0ea P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.228060 22720 tablet_replica.cc:333] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.228859 22720 raft_consensus.cc:2243] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.229404 22720 raft_consensus.cc:2272] T 91938ea259f9468fa8dd1b771846e52a P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.232116 22720 tablet_replica.cc:333] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.232841 22720 raft_consensus.cc:2243] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.233316 22720 raft_consensus.cc:2272] T 1466b047b58a4d00b64fdb9da5d34c2c P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.236064 22720 tablet_replica.cc:333] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
W20260709 12:19:54.236806 30317 consensus_peers.cc:597] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.237954 30391 consensus_peers.cc:597] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.236817 22720 raft_consensus.cc:2243] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.242559 22720 raft_consensus.cc:2272] T dc2f75df59c846458323e4564150c3d7 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.245338 22720 tablet_replica.cc:333] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.246034 22720 raft_consensus.cc:2243] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.246639 22720 raft_consensus.cc:2272] T 6e383c3fc4184c4ba49ba4d78433d661 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.250424 22720 tablet_replica.cc:333] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.251379 22720 raft_consensus.cc:2243] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.252177 22720 raft_consensus.cc:2272] T ac00a693be1041d8b90ef03408a91eab P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.258138 22720 tablet_replica.cc:333] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.259872 22720 raft_consensus.cc:2243] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.260574 22720 raft_consensus.cc:2272] T 82b7f80a887443338c7b69d68b9e4886 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.263517 22720 tablet_replica.cc:333] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.264232 22720 raft_consensus.cc:2243] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.265084 22720 raft_consensus.cc:2272] T a07a59f629f04857b16b3ce29fdb6369 P f03b88e02d9c4039964e2ab17a35bf52 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.268186 22720 tablet_replica.cc:333] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.268886 22720 raft_consensus.cc:2243] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.269755 22720 raft_consensus.cc:2272] T 3a54afd7ab154ec88c23d17fc3926282 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.272683 22720 tablet_replica.cc:333] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.273376 22720 raft_consensus.cc:2243] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.274354 22720 raft_consensus.cc:2272] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.277025 22720 tablet_replica.cc:333] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.277683 22720 raft_consensus.cc:2243] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:54.278697 22720 raft_consensus.cc:2272] T 786293768cab4265a62418294d3f895b P f03b88e02d9c4039964e2ab17a35bf52 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:54.281217 22720 tablet_replica.cc:333] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52: stopping tablet replica
I20260709 12:19:54.281823 22720 raft_consensus.cc:2243] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:54.282369 22720 raft_consensus.cc:2272] T 7092c6b1d5ae4678ad3e75eb0bf15237 P f03b88e02d9c4039964e2ab17a35bf52 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:54.284641 30391 consensus_peers.cc:597] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.303565 30317 consensus_peers.cc:597] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.354923 30317 consensus_peers.cc:597] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.358701 30317 consensus_peers.cc:597] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.367201 30391 consensus_peers.cc:597] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.380204 30317 consensus_peers.cc:597] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.401037 30317 consensus_peers.cc:597] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.410791 30391 consensus_peers.cc:597] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.439213 30317 consensus_peers.cc:597] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:54.476626 30391 consensus_peers.cc:597] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.607174 31379 raft_consensus.cc:493] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
W20260709 12:19:54.608057 30317 consensus_peers.cc:597] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:54.607807 31379 raft_consensus.cc:515] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:54.610344 31379 leader_election.cc:290] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:54.611590 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:54.615919 30318 leader_election.cc:336] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:54.616405 30318 leader_election.cc:304] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:54.617112 31379 raft_consensus.cc:2749] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.637965 31379 raft_consensus.cc:493] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.638446 31379 raft_consensus.cc:515] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:54.640633 31379 leader_election.cc:290] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:54.645820 30318 leader_election.cc:336] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:54.649382 30317 leader_election.cc:336] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:54.649842 31389 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.649945 30317 leader_election.cc:304] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:54.650771 31336 raft_consensus.cc:2749] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:54.650506 31389 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:54.655025 31389 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:54.658134 30391 leader_election.cc:336] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:54.658857 30392 leader_election.cc:336] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:54.659245 30392 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:54.659853 31389 raft_consensus.cc:2749] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:54.694658 31341 raft_consensus.cc:493] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.695214 31341 raft_consensus.cc:515] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:54.697654 31341 leader_election.cc:290] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:54.700577 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:54.701314 30348 raft_consensus.cc:2468] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:54.702651 30390 leader_election.cc:304] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:54.703567 31389 raft_consensus.cc:2804] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:54.703972 31389 raft_consensus.cc:493] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.704389 31389 raft_consensus.cc:3060] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:54.709743 30392 leader_election.cc:336] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:54.713299 31389 raft_consensus.cc:515] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:54.717597 31389 leader_election.cc:290] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:54.718132 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd6a0afe3684c689a3587a53a560ec3" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:54.718828 30348 raft_consensus.cc:3060] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:54.724661 30392 leader_election.cc:336] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:54.726876 30348 raft_consensus.cc:2468] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 3.
I20260709 12:19:54.728124 30390 leader_election.cc:304] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:54.728806 31389 raft_consensus.cc:2804] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:54.729380 31389 raft_consensus.cc:697] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 3 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:54.730298 31389 consensus_queue.cc:237] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:54.740301 30099 catalog_manager.cc:5697] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 2 to 3, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 3 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:54.782055 31389 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.782591 31389 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:54.784722 31389 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:54.789732 30392 leader_election.cc:336] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:54.790208 30391 leader_election.cc:336] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:54.790607 30391 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:54.791321 31389 raft_consensus.cc:2749] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:54.915838 31389 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.916706 31389 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:54.919400 31384 raft_consensus.cc:493] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.919903 31384 raft_consensus.cc:515] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:54.921816 31384 leader_election.cc:290] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:54.925379 30392 leader_election.cc:336] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:54.925896 31336 raft_consensus.cc:493] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.926434 31336 raft_consensus.cc:515] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:54.928200 31389 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:54.928778 30391 leader_election.cc:336] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:54.930456 30392 leader_election.cc:336] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:54.933624 30317 leader_election.cc:336] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:54.936270 30392 leader_election.cc:304] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:54.938648 31384 raft_consensus.cc:2749] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.939999 31336 leader_election.cc:290] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:54.939910 30391 leader_election.cc:336] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:54.940749 30318 leader_election.cc:336] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:54.940884 30391 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:54.941457 30318 leader_election.cc:304] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:54.942193 31336 raft_consensus.cc:2749] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:54.942942 31389 raft_consensus.cc:2749] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:19:54.949947 31389 raft_consensus.cc:493] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.950783 31336 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:54.950461 31389 raft_consensus.cc:515] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:54.951262 31336 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:54.952709 31389 leader_election.cc:290] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:54.953361 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:54.953940 31336 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:54.954572 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
W20260709 12:19:54.959405 30392 leader_election.cc:336] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:54.959915 30392 leader_election.cc:304] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, 777b1410f165436aa725262b964ff0a6
I20260709 12:19:54.960613 31389 raft_consensus.cc:2749] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:54.960983 30318 leader_election.cc:336] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:54.961403 30318 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
I20260709 12:19:54.962586 31379 raft_consensus.cc:2749] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:55.000285 31379 raft_consensus.cc:493] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.000846 31379 raft_consensus.cc:515] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:55.003023 31379 leader_election.cc:290] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:55.007620 30318 leader_election.cc:336] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:55.008421 30317 leader_election.cc:336] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.008864 30317 leader_election.cc:304] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.009512 31379 raft_consensus.cc:2749] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:19:55.032306 31104 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.032945 31104 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:55.035121 31104 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:55.036062 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:55.036836 30348 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 3.
I20260709 12:19:55.038264 30390 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:55.038736 31379 raft_consensus.cc:493] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.039587 31379 raft_consensus.cc:515] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:55.042021 30392 leader_election.cc:336] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.039600 31104 raft_consensus.cc:2804] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:55.043408 31104 raft_consensus.cc:493] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.043853 31104 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:55.047202 30317 leader_election.cc:336] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.048182 31379 leader_election.cc:290] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:55.051307 30318 leader_election.cc:336] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.051725 30318 leader_election.cc:304] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.052290 31379 raft_consensus.cc:2749] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.053189 31104 raft_consensus.cc:515] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:55.058751 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "783cd53e9f4142348a23db0cbf9cd131" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:55.059387 30348 raft_consensus.cc:3060] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:19:55.063199 31104 leader_election.cc:290] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:55.068101 31389 raft_consensus.cc:493] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.068583 31389 raft_consensus.cc:515] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:55.068848 30392 leader_election.cc:336] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.070684 31389 leader_election.cc:290] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.073704 30348 raft_consensus.cc:2468] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 4.
I20260709 12:19:55.074985 30390 leader_election.cc:304] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
W20260709 12:19:55.076022 30391 leader_election.cc:336] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.076845 31389 raft_consensus.cc:2804] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:19:55.077004 30392 leader_election.cc:336] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.077374 31389 raft_consensus.cc:697] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 4 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:55.077579 30392 leader_election.cc:304] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.078336 31389 consensus_queue.cc:237] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:55.078647 31104 raft_consensus.cc:2749] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.085556 31389 raft_consensus.cc:493] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.086041 31389 raft_consensus.cc:515] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:55.089372 31389 leader_election.cc:290] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.092120 30101 catalog_manager.cc:5697] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 3 to 4, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 4 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:55.094889 30392 leader_election.cc:336] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.094851 31336 raft_consensus.cc:493] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.095607 31336 raft_consensus.cc:515] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:55.099875 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:55.100790 30426 raft_consensus.cc:2468] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:55.102556 30315 leader_election.cc:304] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:55.102610 31379 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.103137 31379 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:55.103565 31328 raft_consensus.cc:2804] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:19:55.103947 31328 raft_consensus.cc:493] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.104296 31328 raft_consensus.cc:3060] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:55.106297 30391 leader_election.cc:336] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.106647 31379 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:55.107290 30391 leader_election.cc:304] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.107686 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:55.109475 31389 raft_consensus.cc:2749] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.110845 31336 leader_election.cc:290] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:55.115598 31328 raft_consensus.cc:515] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:55.116788 30318 leader_election.cc:336] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.117311 30318 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, cf45045de3bd40b9a60aaaabe4322659
W20260709 12:19:55.118218 30318 leader_election.cc:336] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.119524 31328 leader_election.cc:290] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 election: Requested vote from peers cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:55.118863 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a1ee8472def40b1a4437e3ba0e495f3" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:55.119361 31336 raft_consensus.cc:2749] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:55.120260 30392 consensus_peers.cc:597] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.120275 30426 raft_consensus.cc:3060] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:19:55.126977 30318 leader_election.cc:336] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.127954 31104 raft_consensus.cc:493] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.128582 31104 raft_consensus.cc:515] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:55.128985 30426 raft_consensus.cc:2468] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 3.
I20260709 12:19:55.130016 30315 leader_election.cc:304] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:55.130861 31104 leader_election.cc:290] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.131035 31336 raft_consensus.cc:2804] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:19:55.131697 31336 raft_consensus.cc:697] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:55.132591 31336 consensus_queue.cc:237] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
W20260709 12:19:55.135767 30391 leader_election.cc:336] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:55.136790 30392 leader_election.cc:336] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.137259 30392 leader_election.cc:304] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.138163 31104 raft_consensus.cc:2749] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.144840 30101 catalog_manager.cc:5697] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 2 to 3, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 3 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.148728 31104 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.149219 31104 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:55.151154 31104 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:55.151857 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:55.152503 30348 raft_consensus.cc:2468] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 3.
I20260709 12:19:55.153592 30390 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:55.154369 31104 raft_consensus.cc:2804] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:19:55.154721 31104 raft_consensus.cc:493] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:55.155117 31104 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:55.156425 30392 leader_election.cc:336] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.162182 31104 raft_consensus.cc:515] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:55.163987 31104 leader_election.cc:290] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 election: Requested vote from peers 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753), 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137)
I20260709 12:19:55.164831 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204ef0b216a4f66889d2612e1f673b5" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:55.165457 30348 raft_consensus.cc:3060] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:19:55.170820 30392 leader_election.cc:336] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.172237 30348 raft_consensus.cc:2468] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 4.
I20260709 12:19:55.173437 30390 leader_election.cc:304] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6
I20260709 12:19:55.174119 31104 raft_consensus.cc:2804] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:19:55.174618 31104 raft_consensus.cc:697] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 4 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:55.175933 31104 consensus_queue.cc:237] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } }
I20260709 12:19:55.191098 30101 catalog_manager.cc:5697] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 3 to 4, leader changed from 777b1410f165436aa725262b964ff0a6 (127.22.48.1) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 4 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.203083 31104 raft_consensus.cc:493] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.203615 31104 raft_consensus.cc:515] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:55.206907 30348 raft_consensus.cc:1275] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:55.208693 31389 consensus_queue.cc:1048] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:55.212883 30391 leader_election.cc:336] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:55.214063 30392 leader_election.cc:336] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.214576 30392 leader_election.cc:304] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.216647 31389 raft_consensus.cc:2749] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.217615 31104 leader_election.cc:290] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.254729 31336 raft_consensus.cc:493] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.255432 31336 raft_consensus.cc:515] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:55.258188 31336 leader_election.cc:290] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:55.262913 30317 leader_election.cc:336] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:55.263552 30318 leader_election.cc:336] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.263899 30318 leader_election.cc:304] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.264473 31328 raft_consensus.cc:2749] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.313651 31104 raft_consensus.cc:493] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.314168 31104 raft_consensus.cc:515] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.315997 31104 leader_election.cc:290] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:55.317121 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:55.319602 30391 leader_election.cc:336] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.320026 30391 leader_election.cc:304] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.320830 31104 raft_consensus.cc:2749] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.334985 31328 raft_consensus.cc:493] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.335589 31328 raft_consensus.cc:515] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.338613 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:55.339260 30426 raft_consensus.cc:2468] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
I20260709 12:19:55.337998 31328 leader_election.cc:290] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:55.340395 30315 leader_election.cc:304] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:55.341167 31328 raft_consensus.cc:2804] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:55.341542 31328 raft_consensus.cc:493] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.341899 31328 raft_consensus.cc:3060] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:55.342694 30317 leader_election.cc:336] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.349114 31328 raft_consensus.cc:515] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.350807 31328 leader_election.cc:290] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:55.351715 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ac3e8c89573415c9575c5a977d36af6" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:55.352182 30426 raft_consensus.cc:3060] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.357157 30426 raft_consensus.cc:2468] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:55.358160 30315 leader_election.cc:304] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:55.359061 31328 raft_consensus.cc:2804] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:55.359563 31328 raft_consensus.cc:697] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:55.360303 31328 consensus_queue.cc:237] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.361699 31341 raft_consensus.cc:493] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.362210 31341 raft_consensus.cc:515] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.364435 31341 leader_election.cc:290] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:55.365888 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:55.366761 30317 leader_election.cc:336] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:55.373764 30391 leader_election.cc:336] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.374245 30391 leader_election.cc:304] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.375751 31104 raft_consensus.cc:2749] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:55.376566 22720 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30299)
I20260709 12:19:55.382076 30099 catalog_manager.cc:5697] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 1 to 2, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.442530 31328 raft_consensus.cc:493] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.443045 31328 raft_consensus.cc:515] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:55.444950 31328 leader_election.cc:290] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:55.449174 30317 leader_election.cc:336] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:55.450371 30318 leader_election.cc:336] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.450860 30318 leader_election.cc:304] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.451584 31328 raft_consensus.cc:2749] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.454135 31104 raft_consensus.cc:493] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.454651 31104 raft_consensus.cc:515] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.456960 31104 leader_election.cc:290] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:55.458086 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
W20260709 12:19:55.461378 30391 leader_election.cc:336] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.461907 30391 leader_election.cc:304] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 0cd3caf5ad334c0cb6e695ee74a83268, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.462627 31104 raft_consensus.cc:2749] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.475488 30348 raft_consensus.cc:1275] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 4 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:55.476727 31104 consensus_queue.cc:1048] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:19:55.495157 30392 consensus_peers.cc:597] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.502615 31379 raft_consensus.cc:493] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.503028 31104 raft_consensus.cc:493] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.503376 31379 raft_consensus.cc:515] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.503856 31104 raft_consensus.cc:515] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:55.505744 31104 leader_election.cc:290] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.505770 31379 leader_election.cc:290] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
W20260709 12:19:55.515545 30317 leader_election.cc:336] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.516947 30426 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:55.520208 30426 raft_consensus.cc:2468] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
W20260709 12:19:55.517553 30392 leader_election.cc:336] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.522671 31336 raft_consensus.cc:493] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.523406 31336 raft_consensus.cc:515] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:55.527324 31336 leader_election.cc:290] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.528844 30315 leader_election.cc:304] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.531251 31328 raft_consensus.cc:2804] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:55.531780 31328 raft_consensus.cc:493] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.532378 31328 raft_consensus.cc:3060] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.535002 31104 raft_consensus.cc:493] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.535573 31104 raft_consensus.cc:515] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:55.537655 31104 leader_election.cc:290] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.542065 31104 raft_consensus.cc:493] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.542552 31104 raft_consensus.cc:515] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:55.543627 30426 raft_consensus.cc:1275] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:19:55.544323 31104 leader_election.cc:290] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:55.541698 30318 leader_election.cc:336] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.545382 31336 consensus_queue.cc:1048] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:19:55.549373 30317 leader_election.cc:336] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.549816 30317 leader_election.cc:304] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
W20260709 12:19:55.550573 30391 leader_election.cc:336] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.550973 31408 raft_consensus.cc:2749] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.551134 30391 leader_election.cc:304] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
W20260709 12:19:55.550484 30392 leader_election.cc:336] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.552217 31408 raft_consensus.cc:493] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.552666 31408 raft_consensus.cc:515] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.554672 31104 raft_consensus.cc:2749] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.554788 31408 leader_election.cc:290] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
W20260709 12:19:55.555727 30392 leader_election.cc:336] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.556773 30419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:55.557492 30419 raft_consensus.cc:2468] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 1.
W20260709 12:19:55.557950 30391 leader_election.cc:336] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.558410 30391 leader_election.cc:304] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.558831 30315 leader_election.cc:304] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
W20260709 12:19:55.559641 30391 leader_election.cc:336] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.559829 31408 raft_consensus.cc:2804] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:55.560389 31408 raft_consensus.cc:493] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.559988 31328 raft_consensus.cc:515] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.560871 31408 raft_consensus.cc:3060] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.563673 30419 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0308f2a10f594ad78170a8bc09436ffe" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:55.564333 30419 raft_consensus.cc:3060] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.560535 31104 raft_consensus.cc:2749] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.560145 30391 leader_election.cc:304] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.572717 31328 leader_election.cc:290] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:55.573439 31384 raft_consensus.cc:2749] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:55.577018 30317 leader_election.cc:336] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:55.579727 30392 consensus_peers.cc:597] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:55.580214 30317 leader_election.cc:336] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.581862 31408 raft_consensus.cc:515] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.584975 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eecf0b507c246e383799261c8caf613" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659"
I20260709 12:19:55.585561 30424 raft_consensus.cc:3060] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.585458 30419 raft_consensus.cc:2468] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:55.591130 30315 leader_election.cc:304] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.592988 31379 raft_consensus.cc:2804] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:55.593434 31379 raft_consensus.cc:697] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:55.594336 31379 consensus_queue.cc:237] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.594981 31407 raft_consensus.cc:493] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.595527 31407 raft_consensus.cc:515] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:55.596570 30424 raft_consensus.cc:2468] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cd3caf5ad334c0cb6e695ee74a83268 in term 2.
I20260709 12:19:55.597597 31407 leader_election.cc:290] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.597826 31408 leader_election.cc:290] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:55.600492 31408 raft_consensus.cc:493] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.601627 31408 raft_consensus.cc:515] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.604487 31408 leader_election.cc:290] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4:34977)
I20260709 12:19:55.607208 30315 leader_election.cc:304] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: 
I20260709 12:19:55.608363 31407 raft_consensus.cc:2804] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:55.610456 31407 raft_consensus.cc:697] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Becoming Leader. State: Replica: 0cd3caf5ad334c0cb6e695ee74a83268, State: Running, Role: LEADER
I20260709 12:19:55.609097 30424 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cf45045de3bd40b9a60aaaabe4322659" is_pre_election: true
I20260709 12:19:55.611375 31407 consensus_queue.cc:237] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.631987 31408 raft_consensus.cc:493] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.632616 31408 raft_consensus.cc:515] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:55.633627 30317 leader_election.cc:336] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:55.635978 30318 leader_election.cc:336] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:55.636641 30318 consensus_peers.cc:597] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:55.637153 30317 leader_election.cc:336] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.639235 30317 leader_election.cc:304] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.641147 31328 raft_consensus.cc:2749] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:55.644162 31408 leader_election.cc:290] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.644193 30099 catalog_manager.cc:5697] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 1 to 2, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:55.649385 30318 leader_election.cc:336] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:55.653153 30317 leader_election.cc:336] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.653606 30317 leader_election.cc:304] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: cf45045de3bd40b9a60aaaabe4322659, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.654326 31336 raft_consensus.cc:2749] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:19:55.662043 30317 leader_election.cc:336] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.662487 30317 leader_election.cc:304] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.664006 31410 raft_consensus.cc:2749] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:19:55.675840 30099 catalog_manager.cc:5697] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 reported cstate change: term changed from 1 to 2, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:55.681118 30392 consensus_peers.cc:597] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.701715 31104 raft_consensus.cc:493] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.702440 30348 raft_consensus.cc:1275] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 4 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:19:55.702339 31104 raft_consensus.cc:515] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.703984 31384 consensus_queue.cc:1048] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:19:55.705134 31104 leader_election.cc:290] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:55.706877 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" is_pre_election: true
I20260709 12:19:55.707599 30348 raft_consensus.cc:2468] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 1.
W20260709 12:19:55.711997 30391 leader_election.cc:336] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.716127 30390 leader_election.cc:304] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.718317 31104 raft_consensus.cc:2804] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:19:55.718691 31104 raft_consensus.cc:493] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.719026 31104 raft_consensus.cc:3060] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:19:55.727210 31104 raft_consensus.cc:515] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.729220 31104 leader_election.cc:290] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Requested vote from peers f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801), 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753)
I20260709 12:19:55.735420 30348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e96ebb342bb4ab19893f38827cbfdfc" candidate_uuid: "cf45045de3bd40b9a60aaaabe4322659" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0cd3caf5ad334c0cb6e695ee74a83268"
I20260709 12:19:55.736598 30348 raft_consensus.cc:3060] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:19:55.743564 30391 leader_election.cc:336] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:55.744926 30348 raft_consensus.cc:2468] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf45045de3bd40b9a60aaaabe4322659 in term 2.
I20260709 12:19:55.746482 30390 leader_election.cc:304] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268, cf45045de3bd40b9a60aaaabe4322659; no voters: f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.747134 31384 raft_consensus.cc:2804] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:19:55.747639 31384 raft_consensus.cc:697] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Becoming Leader. State: Replica: cf45045de3bd40b9a60aaaabe4322659, State: Running, Role: LEADER
I20260709 12:19:55.748569 31384 consensus_queue.cc:237] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } }
I20260709 12:19:55.759999 31407 raft_consensus.cc:493] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:55.760573 31407 raft_consensus.cc:515] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
W20260709 12:19:55.760872 30318 consensus_peers.cc:597] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:55.763569 31407 leader_election.cc:290] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:55.765749 30101 catalog_manager.cc:5697] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 reported cstate change: term changed from 1 to 2, leader changed from f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2) to cf45045de3bd40b9a60aaaabe4322659 (127.22.48.4). New cstate: current_term: 2 leader_uuid: "cf45045de3bd40b9a60aaaabe4322659" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:55.767565 30317 leader_election.cc:336] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:55.769279 30318 leader_election.cc:336] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:55.770582 30318 leader_election.cc:304] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:55.771448 31407 raft_consensus.cc:2749] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:55.813280 30317 consensus_peers.cc:597] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:55.939185 30424 raft_consensus.cc:1275] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:55.940546 31407 consensus_queue.cc:1048] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:55.994731 30317 consensus_peers.cc:597] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:56.127768 30392 consensus_peers.cc:597] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.152184 30318 consensus_peers.cc:597] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.157030 31328 raft_consensus.cc:493] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:56.157613 31328 raft_consensus.cc:515] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:56.160208 31328 leader_election.cc:290] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:56.164143 30392 consensus_peers.cc:597] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.164803 30317 leader_election.cc:336] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:56.165603 30318 leader_election.cc:336] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:56.165961 30318 leader_election.cc:304] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:56.166600 31328 raft_consensus.cc:2749] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:56.182175 30392 consensus_peers.cc:597] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.183492 30424 raft_consensus.cc:1275] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:56.184845 31328 consensus_queue.cc:1048] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:56.192494 30392 consensus_peers.cc:597] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.198527 30344 raft_consensus.cc:1275] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Refusing update from remote peer cf45045de3bd40b9a60aaaabe4322659: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:56.200284 31384 consensus_queue.cc:1048] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:56.205814 30392 consensus_peers.cc:597] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.211163 30391 consensus_peers.cc:597] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:56.226454 30317 consensus_peers.cc:597] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.243536 30424 raft_consensus.cc:1275] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Refusing update from remote peer 0cd3caf5ad334c0cb6e695ee74a83268: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:19:56.246733 31328 consensus_queue.cc:1048] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:19:56.253473 30392 consensus_peers.cc:597] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.300536 30392 consensus_peers.cc:597] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.308449 30392 consensus_peers.cc:597] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.314549 30318 consensus_peers.cc:597] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.326999 30318 consensus_peers.cc:597] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.337011 31384 raft_consensus.cc:493] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:56.337639 31384 raft_consensus.cc:515] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
W20260709 12:19:56.342056 30392 consensus_peers.cc:597] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.342499 31384 leader_election.cc:290] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:56.344805 30391 leader_election.cc:336] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:56.345363 30392 leader_election.cc:336] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:56.345845 30392 leader_election.cc:304] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:56.346526 31384 raft_consensus.cc:2749] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:56.349068 30318 consensus_peers.cc:597] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.369735 30391 consensus_peers.cc:597] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.377024 22720 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30299)
W20260709 12:19:56.378410 30318 consensus_peers.cc:597] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.410300 30318 consensus_peers.cc:597] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.422534 30392 consensus_peers.cc:597] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.444018 31328 raft_consensus.cc:493] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:56.444615 31328 raft_consensus.cc:515] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:56.448897 31328 leader_election.cc:290] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:56.451503 30318 leader_election.cc:336] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:56.452080 30317 leader_election.cc:336] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:56.452494 30317 leader_election.cc:304] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:56.453236 31328 raft_consensus.cc:2749] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:56.461747 31384 raft_consensus.cc:493] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:56.462456 31384 raft_consensus.cc:515] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:56.469918 31384 leader_election.cc:290] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:56.472280 30392 leader_election.cc:336] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:56.473160 30391 leader_election.cc:336] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:56.473574 30391 leader_election.cc:304] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:56.474740 31384 raft_consensus.cc:2749] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:19:56.506476 30391 consensus_peers.cc:597] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.575337 31384 raft_consensus.cc:493] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:56.576092 31384 raft_consensus.cc:515] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:56.579578 31384 leader_election.cc:290] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:56.582329 30317 consensus_peers.cc:597] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.583727 30392 leader_election.cc:336] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:56.584493 30391 leader_election.cc:336] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:56.584929 30391 leader_election.cc:304] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:56.585841 31384 raft_consensus.cc:2749] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:56.610529 30391 consensus_peers.cc:597] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.640163 31410 raft_consensus.cc:493] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:56.640681 31410 raft_consensus.cc:515] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } } peers { permanent_uuid: "0cd3caf5ad334c0cb6e695ee74a83268" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 46753 } }
I20260709 12:19:56.643392 31410 leader_election.cc:290] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:56.649911 30317 leader_election.cc:336] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:56.650445 30318 leader_election.cc:336] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:56.650868 30318 leader_election.cc:304] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0cd3caf5ad334c0cb6e695ee74a83268; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:56.651526 31410 raft_consensus.cc:2749] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:19:56.650460 30317 consensus_peers.cc:597] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.656543 30317 consensus_peers.cc:597] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.664371 30317 consensus_peers.cc:597] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.693092 30317 consensus_peers.cc:597] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.718259 22720 tablet_server.cc:196] TabletServer@127.22.48.2:0 shutdown complete.
W20260709 12:19:56.751487 30317 consensus_peers.cc:597] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.754619 30318 consensus_peers.cc:597] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:56.769660 30318 consensus_peers.cc:597] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Couldn't send request to peer 777b1410f165436aa725262b964ff0a6. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.812075 22720 tablet_server.cc:179] TabletServer@127.22.48.3:0 shutting down...
W20260709 12:19:56.819234 30390 consensus_peers.cc:597] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:56.830726 30390 consensus_peers.cc:597] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:56.837160 30390 consensus_peers.cc:597] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:56.855672 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:56.856640 22720 tablet_replica.cc:333] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.857435 22720 raft_consensus.cc:2243] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.857980 22720 raft_consensus.cc:2272] T 8cef54b2bf92402f9064be5769a44bd9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:56.859022 30317 consensus_peers.cc:597] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.860515 22720 tablet_replica.cc:333] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.861135 22720 raft_consensus.cc:2243] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.861502 22720 raft_consensus.cc:2272] T afd6a0afe3684c689a3587a53a560ec3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.863775 22720 tablet_replica.cc:333] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.864382 22720 raft_consensus.cc:2243] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.865157 22720 raft_consensus.cc:2272] T 2ac3e8c89573415c9575c5a977d36af6 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.867938 22720 tablet_replica.cc:333] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.868479 22720 raft_consensus.cc:2243] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.869194 22720 raft_consensus.cc:2272] T 22e1306c0565463d9f7dd00b385e55c7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.871032 22720 tablet_replica.cc:333] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.871564 22720 raft_consensus.cc:2243] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.872264 22720 raft_consensus.cc:2272] T 8ce9c549b6414f61af3e10fccd6b5001 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.873944 22720 tablet_replica.cc:333] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.874878 22720 raft_consensus.cc:2243] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.875370 22720 raft_consensus.cc:2272] T 33b3f7db61ad4d6e9464016245ab8079 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.877337 22720 tablet_replica.cc:333] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.877956 22720 raft_consensus.cc:2243] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.878778 22720 raft_consensus.cc:2272] T 82b7f80a887443338c7b69d68b9e4886 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.881848 22720 tablet_replica.cc:333] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.882942 22720 raft_consensus.cc:2243] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.883684 22720 raft_consensus.cc:2272] T a07a59f629f04857b16b3ce29fdb6369 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.886617 22720 tablet_replica.cc:333] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.887596 22720 raft_consensus.cc:2243] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.888221 22720 raft_consensus.cc:2272] T c9ee34a652a74ed3bac1dc145136bf62 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.890893 22720 tablet_replica.cc:333] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.891744 22720 raft_consensus.cc:2243] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.892549 22720 raft_consensus.cc:2272] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.894670 22720 tablet_replica.cc:333] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.895232 22720 raft_consensus.cc:2243] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.895645 22720 raft_consensus.cc:2272] T 783cd53e9f4142348a23db0cbf9cd131 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.897598 22720 tablet_replica.cc:333] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.898147 22720 raft_consensus.cc:2243] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.898609 22720 raft_consensus.cc:2272] T 89955984673a4c1a984a5c1c5569ebe7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.900648 22720 tablet_replica.cc:333] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.901177 22720 raft_consensus.cc:2243] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.901891 22720 raft_consensus.cc:2272] T 6eecf0b507c246e383799261c8caf613 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.904356 22720 tablet_replica.cc:333] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.904932 22720 raft_consensus.cc:2243] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.905315 22720 raft_consensus.cc:2272] T 0a9b5ed70fdf49c0bf254214d8ca297c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.907330 22720 tablet_replica.cc:333] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.907974 31384 raft_consensus.cc:493] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:56.908752 31384 raft_consensus.cc:515] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:56.909467 22720 raft_consensus.cc:2243] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.910122 22720 raft_consensus.cc:2272] T 1e96ebb342bb4ab19893f38827cbfdfc P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.912189 31384 leader_election.cc:290] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:56.913688 22720 tablet_replica.cc:333] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
W20260709 12:19:56.914075 30391 consensus_peers.cc:597] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:19:56.914630 22720 raft_consensus.cc:2243] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.915769 22720 raft_consensus.cc:2272] T 2db98cf7c8374d57a7606069ab0d00dd P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:56.916723 30390 consensus_peers.cc:597] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:56.917248 30392 leader_election.cc:336] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:56.917887 30391 leader_election.cc:336] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:56.918356 30391 leader_election.cc:304] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:56.919106 22720 tablet_replica.cc:333] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.919117 31341 raft_consensus.cc:2749] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:56.919890 22720 raft_consensus.cc:2243] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.921525 22720 raft_consensus.cc:2272] T ac00a693be1041d8b90ef03408a91eab P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.923749 22720 tablet_replica.cc:333] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.924360 22720 raft_consensus.cc:2243] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.924866 22720 raft_consensus.cc:2272] T a9b4e218f7bb4c3aa64bae842061937a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.927529 22720 tablet_replica.cc:333] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.928284 22720 raft_consensus.cc:2243] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.928875 22720 raft_consensus.cc:2272] T 786293768cab4265a62418294d3f895b P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.931082 22720 tablet_replica.cc:333] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.931687 22720 raft_consensus.cc:2243] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.932508 22720 raft_consensus.cc:2272] T 5a1ee8472def40b1a4437e3ba0e495f3 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.934725 22720 tablet_replica.cc:333] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.935300 22720 raft_consensus.cc:2243] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.935768 22720 raft_consensus.cc:2272] T 7092c6b1d5ae4678ad3e75eb0bf15237 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.937839 22720 tablet_replica.cc:333] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.938498 22720 raft_consensus.cc:2243] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.938946 22720 raft_consensus.cc:2272] T 135faf5d4c1c461f818d5c4131fcf51d P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.941090 22720 tablet_replica.cc:333] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.941677 22720 raft_consensus.cc:2243] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.942140 22720 raft_consensus.cc:2272] T 9164fff77d194553bf16a7020fb1546a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.944290 22720 tablet_replica.cc:333] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.944883 22720 raft_consensus.cc:2243] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.945693 22720 raft_consensus.cc:2272] T 6e383c3fc4184c4ba49ba4d78433d661 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.947633 22720 tablet_replica.cc:333] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.948202 22720 raft_consensus.cc:2243] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.948644 22720 raft_consensus.cc:2272] T 91938ea259f9468fa8dd1b771846e52a P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.950519 22720 tablet_replica.cc:333] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.951061 22720 raft_consensus.cc:2243] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.951509 22720 raft_consensus.cc:2272] T dc2f75df59c846458323e4564150c3d7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.953485 22720 tablet_replica.cc:333] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.954078 22720 raft_consensus.cc:2243] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.954643 22720 raft_consensus.cc:2272] T 1466b047b58a4d00b64fdb9da5d34c2c P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.956532 22720 tablet_replica.cc:333] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.957083 22720 raft_consensus.cc:2243] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.957535 22720 raft_consensus.cc:2272] T 3e15a1e1f78e426d9a8ca0a51c2b1644 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.959506 22720 tablet_replica.cc:333] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.960156 22720 raft_consensus.cc:2243] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.960909 22720 raft_consensus.cc:2272] T 902e818d7d70457b93827ef5cf71cdaf P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.962802 22720 tablet_replica.cc:333] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.963390 22720 raft_consensus.cc:2243] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.964154 22720 raft_consensus.cc:2272] T a243cb1e81a84b1681899e957182bf40 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.966025 22720 tablet_replica.cc:333] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.966642 22720 raft_consensus.cc:2243] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.967453 22720 raft_consensus.cc:2272] T 0308f2a10f594ad78170a8bc09436ffe P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.970163 22720 tablet_replica.cc:333] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.970924 22720 raft_consensus.cc:2243] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.971508 22720 raft_consensus.cc:2272] T a5da03165521429c98ebf81c89a7b741 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.973446 22720 tablet_replica.cc:333] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.973915 22720 raft_consensus.cc:2243] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.974740 22720 raft_consensus.cc:2272] T 4ff5b4e1a9b549f69fa44610140ab684 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.976758 22720 tablet_replica.cc:333] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.977366 22720 raft_consensus.cc:2243] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.978116 22720 raft_consensus.cc:2272] T 658e0669fba3478e91574f80953b72b7 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.980155 22720 tablet_replica.cc:333] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.980729 22720 raft_consensus.cc:2243] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.981222 22720 raft_consensus.cc:2272] T ff03218495d14467b6f1a3ddc083aed9 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.983304 22720 tablet_replica.cc:333] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.983867 22720 raft_consensus.cc:2243] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.984277 22720 raft_consensus.cc:2272] T 0e0bb2451c3442cab4eee04748a2baa0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.986248 22720 tablet_replica.cc:333] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.986827 22720 raft_consensus.cc:2243] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.987569 22720 raft_consensus.cc:2272] T 3d376ce929ab4707a05d036b3f6fdd43 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.989609 22720 tablet_replica.cc:333] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.990162 22720 raft_consensus.cc:2243] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.990945 22720 raft_consensus.cc:2272] T dee40afb40fa45f8969bce6b71285204 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.992806 22720 tablet_replica.cc:333] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.993394 22720 raft_consensus.cc:2243] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:56.993793 22720 raft_consensus.cc:2272] T f8f7f948772a44d189f9c2255d68385e P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.995774 22720 tablet_replica.cc:333] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.996356 22720 raft_consensus.cc:2243] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:56.997164 22720 raft_consensus.cc:2272] T 89100a63be0348a1bf66a13a95a3f8c0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:56.999397 22720 tablet_replica.cc:333] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:56.999912 22720 raft_consensus.cc:2243] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.000321 22720 raft_consensus.cc:2272] T 752fdec2f7b64590b55660b4d839c0ea P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.002099 22720 tablet_replica.cc:333] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:57.002604 22720 raft_consensus.cc:2243] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.003007 31341 raft_consensus.cc:493] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:57.003057 22720 raft_consensus.cc:2272] T 5204ef0b216a4f66889d2612e1f673b5 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.003633 31341 raft_consensus.cc:515] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:57.005198 22720 tablet_replica.cc:333] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:57.005903 22720 raft_consensus.cc:2243] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.006583 31384 raft_consensus.cc:493] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 777b1410f165436aa725262b964ff0a6)
I20260709 12:19:57.007002 22720 raft_consensus.cc:2272] T 513668c5dbf240ab8c90da19361cac60 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.007095 31384 raft_consensus.cc:515] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:57.005402 31341 leader_election.cc:290] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:57.009555 30392 leader_election.cc:336] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:57.009850 22720 tablet_replica.cc:333] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268: stopping tablet replica
I20260709 12:19:57.009745 31384 leader_election.cc:290] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:57.010524 22720 raft_consensus.cc:2243] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.011042 22720 raft_consensus.cc:2272] T 66ce942f42cf4c98adff100bd7b02ea0 P 0cd3caf5ad334c0cb6e695ee74a83268 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:57.011343 30391 leader_election.cc:336] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:57.011781 30391 leader_election.cc:304] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:57.012563 31384 raft_consensus.cc:2749] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:57.014259 30391 leader_election.cc:336] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
W20260709 12:19:57.015220 30392 leader_election.cc:336] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:57.015631 30392 leader_election.cc:304] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:57.016290 31384 raft_consensus.cc:2749] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:57.024226 30391 consensus_peers.cc:597] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:57.026726 30390 consensus_peers.cc:597] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.034636 31384 raft_consensus.cc:493] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:57.035346 31384 raft_consensus.cc:515] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:57.037472 31384 leader_election.cc:290] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:57.042064 30391 consensus_peers.cc:597] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:57.042363 30392 leader_election.cc:336] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:57.042940 30391 leader_election.cc:336] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:57.043367 30391 leader_election.cc:304] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:57.044092 31384 raft_consensus.cc:2749] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:19:57.052873 30390 consensus_peers.cc:597] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.083007 22720 tablet_server.cc:196] TabletServer@127.22.48.3:0 shutdown complete.
W20260709 12:19:57.096053 30391 consensus_peers.cc:597] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:57.096563 30391 consensus_peers.cc:597] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 -> Peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Couldn't send request to peer f03b88e02d9c4039964e2ab17a35bf52. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:19:57.127943 30390 consensus_peers.cc:597] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:46753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.154917 22720 tablet_server.cc:179] TabletServer@127.22.48.4:0 shutting down...
W20260709 12:19:57.177696 30390 consensus_peers.cc:597] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:46753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:57.183079 30390 consensus_peers.cc:597] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:46753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.189004 31384 raft_consensus.cc:493] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:57.189558 31384 raft_consensus.cc:515] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:57.191507 31384 leader_election.cc:290] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
W20260709 12:19:57.195225 30392 leader_election.cc:336] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
W20260709 12:19:57.196048 30391 leader_election.cc:336] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:57.196491 30391 leader_election.cc:304] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:57.197266 31384 raft_consensus.cc:2749] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:57.203372 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:57.204236 22720 tablet_replica.cc:333] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.204879 22720 raft_consensus.cc:2243] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.205739 22720 raft_consensus.cc:2272] T 8cef54b2bf92402f9064be5769a44bd9 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.206380 31384 raft_consensus.cc:493] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f03b88e02d9c4039964e2ab17a35bf52)
I20260709 12:19:57.206791 31384 raft_consensus.cc:515] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf45045de3bd40b9a60aaaabe4322659" member_type: VOTER last_known_addr { host: "127.22.48.4" port: 34977 } } peers { permanent_uuid: "777b1410f165436aa725262b964ff0a6" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33137 } } peers { permanent_uuid: "f03b88e02d9c4039964e2ab17a35bf52" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35801 } }
I20260709 12:19:57.208272 22720 tablet_replica.cc:333] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.208570 31384 leader_election.cc:290] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137), f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801)
I20260709 12:19:57.209264 22720 raft_consensus.cc:2243] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.210314 22720 raft_consensus.cc:2272] T afd6a0afe3684c689a3587a53a560ec3 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:57.212250 30392 leader_election.cc:336] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 777b1410f165436aa725262b964ff0a6 (127.22.48.1:33137): Network error: Client connection negotiation failed: client connection to 127.22.48.1:33137: connect: Connection refused (error 111)
I20260709 12:19:57.212870 22720 tablet_replica.cc:333] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
W20260709 12:19:57.212831 30391 leader_election.cc:336] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f03b88e02d9c4039964e2ab17a35bf52 (127.22.48.2:35801): Network error: Client connection negotiation failed: client connection to 127.22.48.2:35801: connect: Connection refused (error 111)
I20260709 12:19:57.213326 30391 leader_election.cc:304] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf45045de3bd40b9a60aaaabe4322659; no voters: 777b1410f165436aa725262b964ff0a6, f03b88e02d9c4039964e2ab17a35bf52
I20260709 12:19:57.213862 22720 raft_consensus.cc:2243] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.213976 31384 raft_consensus.cc:2749] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:19:57.214490 22720 raft_consensus.cc:2272] T 54a5db9cc7d848d191162399432049df P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.216349 22720 tablet_replica.cc:333] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.216918 22720 raft_consensus.cc:2243] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.217342 22720 raft_consensus.cc:2272] T 2ac3e8c89573415c9575c5a977d36af6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.219280 22720 tablet_replica.cc:333] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.219821 22720 raft_consensus.cc:2243] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.220232 22720 raft_consensus.cc:2272] T 22e1306c0565463d9f7dd00b385e55c7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.222463 22720 tablet_replica.cc:333] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.223006 22720 raft_consensus.cc:2243] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.223441 22720 raft_consensus.cc:2272] T 8ce9c549b6414f61af3e10fccd6b5001 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.225204 22720 tablet_replica.cc:333] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.225735 22720 raft_consensus.cc:2243] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.226523 22720 raft_consensus.cc:2272] T c9ee34a652a74ed3bac1dc145136bf62 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.228688 22720 tablet_replica.cc:333] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.229321 22720 raft_consensus.cc:2243] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.229817 22720 raft_consensus.cc:2272] T 4333c8ec1cd04d1d8ec97b1f5a79f8a5 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.232203 22720 tablet_replica.cc:333] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.232805 22720 raft_consensus.cc:2243] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:57.233085 30390 consensus_peers.cc:597] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:46753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.233273 22720 raft_consensus.cc:2272] T 513668c5dbf240ab8c90da19361cac60 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.235849 22720 tablet_replica.cc:333] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.236447 22720 raft_consensus.cc:2243] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.236886 22720 raft_consensus.cc:2272] T 6eecf0b507c246e383799261c8caf613 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:57.239090 30390 consensus_peers.cc:597] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:46753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.239414 22720 tablet_replica.cc:333] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.240115 22720 raft_consensus.cc:2243] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.240645 22720 raft_consensus.cc:2272] T f2e1e509bcc54ae485169e45c1649db8 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.242599 22720 tablet_replica.cc:333] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.243139 22720 raft_consensus.cc:2243] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.243935 22720 raft_consensus.cc:2272] T 8f971b17bc9742d38fdccaea1020084a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.245764 22720 tablet_replica.cc:333] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.246318 22720 raft_consensus.cc:2243] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.246707 22720 raft_consensus.cc:2272] T e1901a31d4f045d7af7afe28951681d6 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.248361 22720 tablet_replica.cc:333] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.248859 22720 raft_consensus.cc:2243] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.249552 22720 raft_consensus.cc:2272] T a9b4e218f7bb4c3aa64bae842061937a P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.251345 22720 tablet_replica.cc:333] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.251868 22720 raft_consensus.cc:2243] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.252245 22720 raft_consensus.cc:2272] T 2db98cf7c8374d57a7606069ab0d00dd P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.253891 22720 tablet_replica.cc:333] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.254562 22720 raft_consensus.cc:2243] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.255468 22720 raft_consensus.cc:2272] T 783cd53e9f4142348a23db0cbf9cd131 P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.257911 22720 tablet_replica.cc:333] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.258605 22720 raft_consensus.cc:2243] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.259524 22720 raft_consensus.cc:2272] T 0e0bb2451c3442cab4eee04748a2baa0 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:57.259824 30390 consensus_peers.cc:597] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:46753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.261540 22720 tablet_replica.cc:333] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.262082 22720 raft_consensus.cc:2243] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.262521 22720 raft_consensus.cc:2272] T 3d376ce929ab4707a05d036b3f6fdd43 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.264292 22720 tablet_replica.cc:333] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.264777 22720 raft_consensus.cc:2243] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.265112 22720 raft_consensus.cc:2272] T 373645f6f2614fa5a09fd23279ce7973 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.266920 22720 tablet_replica.cc:333] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.267400 22720 raft_consensus.cc:2243] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.268056 22720 raft_consensus.cc:2272] T f8f7f948772a44d189f9c2255d68385e P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.269881 22720 tablet_replica.cc:333] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.270452 22720 raft_consensus.cc:2243] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.271175 22720 raft_consensus.cc:2272] T 9d78f4a893e8471a8324169a33739e06 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.272974 22720 tablet_replica.cc:333] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.273450 22720 raft_consensus.cc:2243] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.273803 22720 raft_consensus.cc:2272] T 35d4a018024842a99a90f4bcc2a6887c P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.275592 22720 tablet_replica.cc:333] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.276082 22720 raft_consensus.cc:2243] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.276772 22720 raft_consensus.cc:2272] T 135faf5d4c1c461f818d5c4131fcf51d P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.278648 22720 tablet_replica.cc:333] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.279156 22720 raft_consensus.cc:2243] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.279861 22720 raft_consensus.cc:2272] T 9164fff77d194553bf16a7020fb1546a P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.281589 22720 tablet_replica.cc:333] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.282073 22720 raft_consensus.cc:2243] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.282450 22720 raft_consensus.cc:2272] T 5a1ee8472def40b1a4437e3ba0e495f3 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.284272 22720 tablet_replica.cc:333] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.284761 22720 raft_consensus.cc:2243] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.285444 22720 raft_consensus.cc:2272] T 7092c6b1d5ae4678ad3e75eb0bf15237 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.287343 22720 tablet_replica.cc:333] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.288041 22720 raft_consensus.cc:2243] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.288568 22720 raft_consensus.cc:2272] T e44d3048f1f74e7481b0772d32316b86 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.290896 22720 tablet_replica.cc:333] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
W20260709 12:19:57.291142 30390 consensus_peers.cc:597] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 -> Peer 0cd3caf5ad334c0cb6e695ee74a83268 (127.22.48.3:46753): Couldn't send request to peer 0cd3caf5ad334c0cb6e695ee74a83268. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.3:46753: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:57.291625 22720 raft_consensus.cc:2243] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.292083 22720 raft_consensus.cc:2272] T 902e818d7d70457b93827ef5cf71cdaf P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.294152 22720 tablet_replica.cc:333] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.294672 22720 raft_consensus.cc:2243] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.295037 22720 raft_consensus.cc:2272] T a243cb1e81a84b1681899e957182bf40 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.296757 22720 tablet_replica.cc:333] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.297251 22720 raft_consensus.cc:2243] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.297627 22720 raft_consensus.cc:2272] T 4290068162194444a3f4d05ad418ca30 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.299885 22720 tablet_replica.cc:333] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.300657 22720 raft_consensus.cc:2243] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.301124 22720 raft_consensus.cc:2272] T 658e0669fba3478e91574f80953b72b7 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.303035 22720 tablet_replica.cc:333] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.303583 22720 raft_consensus.cc:2243] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.304059 22720 raft_consensus.cc:2272] T 0308f2a10f594ad78170a8bc09436ffe P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.305789 22720 tablet_replica.cc:333] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.306481 22720 raft_consensus.cc:2243] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.307019 22720 raft_consensus.cc:2272] T 3a54afd7ab154ec88c23d17fc3926282 P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.309365 22720 tablet_replica.cc:333] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.309885 22720 raft_consensus.cc:2243] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.310737 22720 raft_consensus.cc:2272] T 91938ea259f9468fa8dd1b771846e52a P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.312460 22720 tablet_replica.cc:333] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.312981 22720 raft_consensus.cc:2243] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.313697 22720 raft_consensus.cc:2272] T dc2f75df59c846458323e4564150c3d7 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.315554 22720 tablet_replica.cc:333] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.316082 22720 raft_consensus.cc:2243] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.316488 22720 raft_consensus.cc:2272] T 71502abf53ca4ef3b1193915fa8c2309 P cf45045de3bd40b9a60aaaabe4322659 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.318257 22720 tablet_replica.cc:333] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.318821 22720 raft_consensus.cc:2243] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.319221 22720 raft_consensus.cc:2272] T 6ec1ac5431f2413f96552ad10bbd800d P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.320999 22720 tablet_replica.cc:333] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.321506 22720 raft_consensus.cc:2243] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.322227 22720 raft_consensus.cc:2272] T b715660e336d48828daede8c69a9d353 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.324102 22720 tablet_replica.cc:333] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.324640 22720 raft_consensus.cc:2243] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.325392 22720 raft_consensus.cc:2272] T 5204ef0b216a4f66889d2612e1f673b5 P cf45045de3bd40b9a60aaaabe4322659 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.327191 22720 tablet_replica.cc:333] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.327869 22720 raft_consensus.cc:2243] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.328366 22720 raft_consensus.cc:2272] T 6b74bb8b13534e8daf883dde16e187ec P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.330834 22720 tablet_replica.cc:333] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.331441 22720 raft_consensus.cc:2243] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:57.331969 22720 raft_consensus.cc:2272] T 89100a63be0348a1bf66a13a95a3f8c0 P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.333832 22720 tablet_replica.cc:333] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.334359 22720 raft_consensus.cc:2243] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.335058 22720 raft_consensus.cc:2272] T 623336ab8b78487db7b5b817879e958e P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.336843 22720 tablet_replica.cc:333] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.337304 22720 raft_consensus.cc:2243] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.338052 22720 raft_consensus.cc:2272] T 0a9b5ed70fdf49c0bf254214d8ca297c P cf45045de3bd40b9a60aaaabe4322659 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.340013 22720 tablet_replica.cc:333] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659: stopping tablet replica
I20260709 12:19:57.340487 22720 raft_consensus.cc:2243] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.341174 22720 raft_consensus.cc:2272] T 1e96ebb342bb4ab19893f38827cbfdfc P cf45045de3bd40b9a60aaaabe4322659 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.405169 22720 tablet_server.cc:196] TabletServer@127.22.48.4:0 shutdown complete.
I20260709 12:19:57.467360 22720 master.cc:562] Master@127.22.48.62:40753 shutting down...
W20260709 12:19:57.500888 30149 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:19:57.501968 22720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:57.502522 22720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:57.502821 22720 tablet_replica.cc:333] T 00000000000000000000000000000000 P 600cb9934c6c471d973261032a31e530: stopping tablet replica
I20260709 12:19:57.523815 22720 master.cc:584] Master@127.22.48.62:40753 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (30062 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:19:57.618429 22720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.48.62:33323
I20260709 12:19:57.619601 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:57.625523 31423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:57.625866 31424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:57.626870 31426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:57.628041 22720 server_base.cc:1061] running on GCE node
I20260709 12:19:57.629113 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:57.629359 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:57.629549 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599597629522 us; error 0 us; skew 500 ppm
I20260709 12:19:57.630126 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:57.632582 22720 webserver.cc:533] Webserver started at http://127.22.48.62:42647/ using document root <none> and password file <none>
I20260709 12:19:57.633103 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:57.633311 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:57.633596 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:57.634994 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/master-0-root/instance:
uuid: "1f3de4f9dbfe413a96db6fce61840b41"
format_stamp: "Formatted at 2026-07-09 12:19:57 on dist-test-slave-044g"
I20260709 12:19:57.639297 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:57.642647 31431 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:57.643360 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:57.643641 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/master-0-root
uuid: "1f3de4f9dbfe413a96db6fce61840b41"
format_stamp: "Formatted at 2026-07-09 12:19:57 on dist-test-slave-044g"
I20260709 12:19:57.643932 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:57.659519 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:57.660717 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:57.699962 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.62:33323
I20260709 12:19:57.700053 31482 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.62:33323 every 8 connection(s)
I20260709 12:19:57.703761 31483 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:57.713925 31483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41: Bootstrap starting.
I20260709 12:19:57.718617 31483 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:57.722596 31483 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41: No bootstrap required, opened a new log
I20260709 12:19:57.724653 31483 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de4f9dbfe413a96db6fce61840b41" member_type: VOTER }
I20260709 12:19:57.725015 31483 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:57.725200 31483 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f3de4f9dbfe413a96db6fce61840b41, State: Initialized, Role: FOLLOWER
I20260709 12:19:57.725862 31483 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de4f9dbfe413a96db6fce61840b41" member_type: VOTER }
I20260709 12:19:57.726349 31483 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:19:57.726567 31483 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:19:57.726794 31483 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:57.731623 31483 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de4f9dbfe413a96db6fce61840b41" member_type: VOTER }
I20260709 12:19:57.732112 31483 leader_election.cc:304] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f3de4f9dbfe413a96db6fce61840b41; no voters: 
I20260709 12:19:57.733166 31483 leader_election.cc:290] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:19:57.733573 31486 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:57.734969 31486 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 1 LEADER]: Becoming Leader. State: Replica: 1f3de4f9dbfe413a96db6fce61840b41, State: Running, Role: LEADER
I20260709 12:19:57.735620 31486 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de4f9dbfe413a96db6fce61840b41" member_type: VOTER }
I20260709 12:19:57.736076 31483 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:19:57.739967 31487 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f3de4f9dbfe413a96db6fce61840b41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de4f9dbfe413a96db6fce61840b41" member_type: VOTER } }
I20260709 12:19:57.740669 31487 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:57.740314 31488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f3de4f9dbfe413a96db6fce61840b41. Latest consensus state: current_term: 1 leader_uuid: "1f3de4f9dbfe413a96db6fce61840b41" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f3de4f9dbfe413a96db6fce61840b41" member_type: VOTER } }
I20260709 12:19:57.741279 31488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [sys.catalog]: This master's current role is: LEADER
I20260709 12:19:57.744139 31492 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:19:57.752831 31492 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:19:57.756309 22720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:19:57.762696 31492 catalog_manager.cc:1383] Generated new cluster ID: a286005d718748ecb6506514787895c2
I20260709 12:19:57.763000 31492 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:19:57.782720 31492 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:19:57.784010 31492 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:19:57.802817 31492 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41: Generated new TSK 0
I20260709 12:19:57.803471 31492 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:19:57.822719 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:57.828821 31504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:57.829748 31505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:57.835542 31507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:57.836023 22720 server_base.cc:1061] running on GCE node
I20260709 12:19:57.836964 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:57.837198 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:57.837363 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599597837347 us; error 0 us; skew 500 ppm
I20260709 12:19:57.837935 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:57.840641 22720 webserver.cc:533] Webserver started at http://127.22.48.1:36021/ using document root <none> and password file <none>
I20260709 12:19:57.841219 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:57.841418 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:57.841687 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:57.842839 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-0-root/instance:
uuid: "169171504d4b466d9a5748e1eb660780"
format_stamp: "Formatted at 2026-07-09 12:19:57 on dist-test-slave-044g"
I20260709 12:19:57.847301 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:19:57.850579 31512 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:57.851408 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:19:57.851699 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "169171504d4b466d9a5748e1eb660780"
format_stamp: "Formatted at 2026-07-09 12:19:57 on dist-test-slave-044g"
I20260709 12:19:57.851990 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:57.877619 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:57.878937 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:57.880604 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:57.882817 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:57.883049 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:57.883293 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:57.883497 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:57.927167 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:43317
I20260709 12:19:57.927299 31574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:43317 every 8 connection(s)
I20260709 12:19:57.932296 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:57.940246 31579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:57.941346 31580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:57.943833 22720 server_base.cc:1061] running on GCE node
W20260709 12:19:57.944229 31582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:57.945115 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:57.945374 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:57.945614 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599597945597 us; error 0 us; skew 500 ppm
I20260709 12:19:57.946187 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:57.949975 22720 webserver.cc:533] Webserver started at http://127.22.48.2:44539/ using document root <none> and password file <none>
I20260709 12:19:57.950624 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:57.950628 31575 heartbeater.cc:344] Connected to a master server at 127.22.48.62:33323
I20260709 12:19:57.951408 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:57.951632 31575 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:57.951769 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:57.952770 31575 heartbeater.cc:507] Master 127.22.48.62:33323 requested a full tablet report, sending...
I20260709 12:19:57.953797 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-1-root/instance:
uuid: "f0f90650f89842899b446002404b9e9b"
format_stamp: "Formatted at 2026-07-09 12:19:57 on dist-test-slave-044g"
I20260709 12:19:57.955032 31448 ts_manager.cc:194] Registered new tserver with Master: 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317)
I20260709 12:19:57.956804 31448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52300
I20260709 12:19:57.959290 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:19:57.962921 31587 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:57.963766 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:19:57.964107 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-1-root
uuid: "f0f90650f89842899b446002404b9e9b"
format_stamp: "Formatted at 2026-07-09 12:19:57 on dist-test-slave-044g"
I20260709 12:19:57.964447 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:57.976904 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:57.978232 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:57.979840 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:57.982554 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:57.982805 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:57.983085 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:57.983282 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:58.028025 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.2:35529
I20260709 12:19:58.028152 31649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.2:35529 every 8 connection(s)
I20260709 12:19:58.033066 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:19:58.040126 31653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:19:58.040795 31654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:58.043699 22720 server_base.cc:1061] running on GCE node
W20260709 12:19:58.044624 31657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:19:58.045030 31650 heartbeater.cc:344] Connected to a master server at 127.22.48.62:33323
I20260709 12:19:58.045656 31650 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:58.046084 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:19:58.046482 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:19:58.046692 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599598046677 us; error 0 us; skew 500 ppm
I20260709 12:19:58.046623 31650 heartbeater.cc:507] Master 127.22.48.62:33323 requested a full tablet report, sending...
I20260709 12:19:58.047505 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:19:58.048991 31448 ts_manager.cc:194] Registered new tserver with Master: f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:19:58.050524 31448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52302
I20260709 12:19:58.050506 22720 webserver.cc:533] Webserver started at http://127.22.48.3:45047/ using document root <none> and password file <none>
I20260709 12:19:58.051939 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:19:58.052374 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:19:58.052955 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:19:58.054562 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-2-root/instance:
uuid: "65e845fdf8a14fefb33640e0e26febef"
format_stamp: "Formatted at 2026-07-09 12:19:58 on dist-test-slave-044g"
I20260709 12:19:58.059367 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:19:58.062708 31661 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:58.063517 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:19:58.063774 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-2-root
uuid: "65e845fdf8a14fefb33640e0e26febef"
format_stamp: "Formatted at 2026-07-09 12:19:58 on dist-test-slave-044g"
I20260709 12:19:58.064034 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:19:58.112668 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:19:58.113822 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:19:58.115258 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:19:58.117496 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:19:58.117681 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:58.117980 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:19:58.118139 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:19:58.160902 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.3:33215
I20260709 12:19:58.161012 31723 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.3:33215 every 8 connection(s)
I20260709 12:19:58.175096 31724 heartbeater.cc:344] Connected to a master server at 127.22.48.62:33323
I20260709 12:19:58.175604 31724 heartbeater.cc:461] Registering TS with master...
I20260709 12:19:58.176376 31724 heartbeater.cc:507] Master 127.22.48.62:33323 requested a full tablet report, sending...
I20260709 12:19:58.178467 31448 ts_manager.cc:194] Registered new tserver with Master: 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.178754 22720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014613379s
I20260709 12:19:58.180241 31448 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52316
I20260709 12:19:58.204756 31448 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52326:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:19:58.207638 31448 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:19:58.291330 31540 tablet_service.cc:1511] Processing CreateTablet for tablet 171e0901a9fd4781abc0e8be58e63d82 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:58.292797 31540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e0901a9fd4781abc0e8be58e63d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.300185 31539 tablet_service.cc:1511] Processing CreateTablet for tablet fb7ad8ae89f6455bba4a2d690869aacb (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:58.301643 31539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7ad8ae89f6455bba4a2d690869aacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.302315 31536 tablet_service.cc:1511] Processing CreateTablet for tablet 62130437a41f440db726b1f8bc017671 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:58.303612 31536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62130437a41f440db726b1f8bc017671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.305370 31538 tablet_service.cc:1511] Processing CreateTablet for tablet 0b870c0a2fbd4eccb1f82a10fd91ecd2 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:58.306716 31538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b870c0a2fbd4eccb1f82a10fd91ecd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.311256 31537 tablet_service.cc:1511] Processing CreateTablet for tablet f3be5a22de4d490b92ffa8e19f275843 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:58.312583 31537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3be5a22de4d490b92ffa8e19f275843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.312345 31535 tablet_service.cc:1511] Processing CreateTablet for tablet 13e889a1791e4c89b6f3ea6ea97c4b32 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:58.313648 31535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e889a1791e4c89b6f3ea6ea97c4b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.315589 31534 tablet_service.cc:1511] Processing CreateTablet for tablet 04b8c1e6457b471ea499cd1905f55926 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:58.315753 31689 tablet_service.cc:1511] Processing CreateTablet for tablet 171e0901a9fd4781abc0e8be58e63d82 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:58.316267 31688 tablet_service.cc:1511] Processing CreateTablet for tablet fb7ad8ae89f6455bba4a2d690869aacb (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:58.316951 31534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b8c1e6457b471ea499cd1905f55926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.317175 31689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e0901a9fd4781abc0e8be58e63d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.318929 31683 tablet_service.cc:1511] Processing CreateTablet for tablet 04b8c1e6457b471ea499cd1905f55926 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:58.320286 31683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b8c1e6457b471ea499cd1905f55926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.320631 31532 tablet_service.cc:1511] Processing CreateTablet for tablet 78eb714c784c42f7a0f990ca4723eca7 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:58.321714 31532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78eb714c784c42f7a0f990ca4723eca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.323691 31687 tablet_service.cc:1511] Processing CreateTablet for tablet 0b870c0a2fbd4eccb1f82a10fd91ecd2 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:58.325182 31687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b870c0a2fbd4eccb1f82a10fd91ecd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.324879 31685 tablet_service.cc:1511] Processing CreateTablet for tablet 62130437a41f440db726b1f8bc017671 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:58.323725 31684 tablet_service.cc:1511] Processing CreateTablet for tablet 13e889a1791e4c89b6f3ea6ea97c4b32 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:58.326175 31685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62130437a41f440db726b1f8bc017671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.327198 31686 tablet_service.cc:1511] Processing CreateTablet for tablet f3be5a22de4d490b92ffa8e19f275843 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:58.328502 31686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3be5a22de4d490b92ffa8e19f275843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.331450 31531 tablet_service.cc:1511] Processing CreateTablet for tablet 626ce3ca661b4f73a46f6611c3c8708a (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:58.332031 31682 tablet_service.cc:1511] Processing CreateTablet for tablet 8ee64b54aa734183bce9b64527425a4b (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:58.332758 31531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626ce3ca661b4f73a46f6611c3c8708a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.333498 31682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee64b54aa734183bce9b64527425a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.334621 31684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e889a1791e4c89b6f3ea6ea97c4b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.319490 31533 tablet_service.cc:1511] Processing CreateTablet for tablet 8ee64b54aa734183bce9b64527425a4b (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:58.335620 31533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee64b54aa734183bce9b64527425a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.340507 31681 tablet_service.cc:1511] Processing CreateTablet for tablet 78eb714c784c42f7a0f990ca4723eca7 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:58.341768 31681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78eb714c784c42f7a0f990ca4723eca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.343284 31688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7ad8ae89f6455bba4a2d690869aacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.347429 31680 tablet_service.cc:1511] Processing CreateTablet for tablet 626ce3ca661b4f73a46f6611c3c8708a (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:58.348735 31680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626ce3ca661b4f73a46f6611c3c8708a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.366493 31615 tablet_service.cc:1511] Processing CreateTablet for tablet 171e0901a9fd4781abc0e8be58e63d82 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:19:58.367944 31615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 171e0901a9fd4781abc0e8be58e63d82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.379554 31614 tablet_service.cc:1511] Processing CreateTablet for tablet fb7ad8ae89f6455bba4a2d690869aacb (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:19:58.381035 31614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb7ad8ae89f6455bba4a2d690869aacb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.404762 31739 tablet_bootstrap.cc:492] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
I20260709 12:19:58.423954 31613 tablet_service.cc:1511] Processing CreateTablet for tablet 0b870c0a2fbd4eccb1f82a10fd91ecd2 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:19:58.425396 31613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0b870c0a2fbd4eccb1f82a10fd91ecd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.427524 31612 tablet_service.cc:1511] Processing CreateTablet for tablet f3be5a22de4d490b92ffa8e19f275843 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:19:58.428969 31612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3be5a22de4d490b92ffa8e19f275843. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.431427 31611 tablet_service.cc:1511] Processing CreateTablet for tablet 62130437a41f440db726b1f8bc017671 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:19:58.432725 31611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62130437a41f440db726b1f8bc017671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.435388 31610 tablet_service.cc:1511] Processing CreateTablet for tablet 13e889a1791e4c89b6f3ea6ea97c4b32 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:19:58.437166 31610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13e889a1791e4c89b6f3ea6ea97c4b32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.439445 31608 tablet_service.cc:1511] Processing CreateTablet for tablet 8ee64b54aa734183bce9b64527425a4b (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:19:58.440429 31739 tablet_bootstrap.cc:654] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.440738 31608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ee64b54aa734183bce9b64527425a4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.443605 31606 tablet_service.cc:1511] Processing CreateTablet for tablet 626ce3ca661b4f73a46f6611c3c8708a (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:19:58.445235 31606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 626ce3ca661b4f73a46f6611c3c8708a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.447649 31609 tablet_service.cc:1511] Processing CreateTablet for tablet 04b8c1e6457b471ea499cd1905f55926 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:19:58.449303 31609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04b8c1e6457b471ea499cd1905f55926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.451789 31607 tablet_service.cc:1511] Processing CreateTablet for tablet 78eb714c784c42f7a0f990ca4723eca7 (DEFAULT_TABLE table=test-workload [id=c71c0abed7ae4925948d5671d7eee897]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:19:58.453464 31607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78eb714c784c42f7a0f990ca4723eca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:58.477936 31740 tablet_bootstrap.cc:492] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:58.517400 31741 tablet_bootstrap.cc:492] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:58.523815 31741 tablet_bootstrap.cc:654] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.538959 31741 tablet_bootstrap.cc:492] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:58.539469 31741 ts_tablet_manager.cc:1403] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.008s
I20260709 12:19:58.541816 31741 raft_consensus.cc:359] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.542184 31740 tablet_bootstrap.cc:654] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.549233 31741 raft_consensus.cc:385] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.549651 31741 raft_consensus.cc:740] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.550427 31741 consensus_queue.cc:260] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.554685 31739 tablet_bootstrap.cc:492] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:58.555282 31739 ts_tablet_manager.cc:1403] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.000s
I20260709 12:19:58.555927 31650 heartbeater.cc:499] Master 127.22.48.62:33323 was elected leader, sending a full tablet report...
I20260709 12:19:58.556416 31741 ts_tablet_manager.cc:1434] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 12:19:58.556982 31740 tablet_bootstrap.cc:492] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:58.557367 31741 tablet_bootstrap.cc:492] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:58.557463 31740 ts_tablet_manager.cc:1403] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.002s
I20260709 12:19:58.560405 31740 raft_consensus.cc:359] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.561100 31740 raft_consensus.cc:385] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.561406 31740 raft_consensus.cc:740] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.561530 31739 raft_consensus.cc:359] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:58.562832 31739 raft_consensus.cc:385] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.562381 31740 consensus_queue.cc:260] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.563211 31739 raft_consensus.cc:740] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.563822 31741 tablet_bootstrap.cc:654] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.564332 31739 consensus_queue.cc:260] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:58.571936 31740 ts_tablet_manager.cc:1434] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.002s
I20260709 12:19:58.572755 31575 heartbeater.cc:499] Master 127.22.48.62:33323 was elected leader, sending a full tablet report...
I20260709 12:19:58.578382 31740 tablet_bootstrap.cc:492] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:58.583599 31724 heartbeater.cc:499] Master 127.22.48.62:33323 was elected leader, sending a full tablet report...
I20260709 12:19:58.584735 31739 ts_tablet_manager.cc:1434] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.014s
I20260709 12:19:58.586198 31739 tablet_bootstrap.cc:492] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
I20260709 12:19:58.591410 31741 tablet_bootstrap.cc:492] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:58.591791 31740 tablet_bootstrap.cc:654] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.591939 31741 ts_tablet_manager.cc:1403] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.035s	user 0.028s	sys 0.004s
I20260709 12:19:58.593398 31739 tablet_bootstrap.cc:654] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.595131 31741 raft_consensus.cc:359] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.595922 31741 raft_consensus.cc:385] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.596235 31741 raft_consensus.cc:740] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.596989 31741 consensus_queue.cc:260] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.599225 31741 ts_tablet_manager.cc:1434] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:19:58.600147 31741 tablet_bootstrap.cc:492] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:58.606477 31741 tablet_bootstrap.cc:654] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.607066 31739 tablet_bootstrap.cc:492] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:58.607854 31739 ts_tablet_manager.cc:1403] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.010s
I20260709 12:19:58.611814 31739 raft_consensus.cc:359] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.612938 31739 raft_consensus.cc:385] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.613385 31739 raft_consensus.cc:740] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.614609 31739 consensus_queue.cc:260] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.617331 31739 ts_tablet_manager.cc:1434] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:19:58.618000 31741 tablet_bootstrap.cc:492] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:58.618618 31741 ts_tablet_manager.cc:1403] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.010s
I20260709 12:19:58.618777 31739 tablet_bootstrap.cc:492] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
I20260709 12:19:58.621647 31741 raft_consensus.cc:359] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.622416 31741 raft_consensus.cc:385] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.622799 31741 raft_consensus.cc:740] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.623872 31741 consensus_queue.cc:260] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.626708 31741 ts_tablet_manager.cc:1434] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:19:58.627959 31741 tablet_bootstrap.cc:492] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:58.629503 31739 tablet_bootstrap.cc:654] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.636085 31741 tablet_bootstrap.cc:654] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.643538 31739 tablet_bootstrap.cc:492] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:58.644362 31739 ts_tablet_manager.cc:1403] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.009s
I20260709 12:19:58.647637 31741 tablet_bootstrap.cc:492] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:58.648206 31741 ts_tablet_manager.cc:1403] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:19:58.648311 31739 raft_consensus.cc:359] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.649487 31739 raft_consensus.cc:385] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.649945 31739 raft_consensus.cc:740] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.651288 31739 consensus_queue.cc:260] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.652055 31741 raft_consensus.cc:359] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.653417 31741 raft_consensus.cc:385] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.653762 31741 raft_consensus.cc:740] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.654639 31741 consensus_queue.cc:260] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.657124 31741 ts_tablet_manager.cc:1434] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:19:58.657183 31739 ts_tablet_manager.cc:1434] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:19:58.658142 31741 tablet_bootstrap.cc:492] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:58.659087 31739 tablet_bootstrap.cc:492] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
I20260709 12:19:58.665767 31741 tablet_bootstrap.cc:654] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.668325 31739 tablet_bootstrap.cc:654] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.678169 31741 tablet_bootstrap.cc:492] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:58.678723 31741 ts_tablet_manager.cc:1403] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:19:58.681154 31739 tablet_bootstrap.cc:492] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:58.681591 31740 tablet_bootstrap.cc:492] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:58.682190 31740 ts_tablet_manager.cc:1403] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.104s	user 0.048s	sys 0.041s
I20260709 12:19:58.681717 31741 raft_consensus.cc:359] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.682466 31739 ts_tablet_manager.cc:1403] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 12:19:58.682654 31741 raft_consensus.cc:385] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.683032 31741 raft_consensus.cc:740] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.683914 31741 consensus_queue.cc:260] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.685483 31739 raft_consensus.cc:359] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.685333 31740 raft_consensus.cc:359] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.686123 31739 raft_consensus.cc:385] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.686221 31740 raft_consensus.cc:385] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.686537 31739 raft_consensus.cc:740] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.686731 31740 raft_consensus.cc:740] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.687726 31741 ts_tablet_manager.cc:1434] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:58.687445 31739 consensus_queue.cc:260] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.687922 31740 consensus_queue.cc:260] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.688812 31741 tablet_bootstrap.cc:492] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:58.690140 31740 ts_tablet_manager.cc:1434] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260709 12:19:58.691169 31740 tablet_bootstrap.cc:492] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:58.694025 31739 ts_tablet_manager.cc:1434] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:19:58.695155 31739 tablet_bootstrap.cc:492] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
I20260709 12:19:58.695730 31741 tablet_bootstrap.cc:654] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.697429 31740 tablet_bootstrap.cc:654] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.700560 31747 raft_consensus.cc:493] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.701089 31747 raft_consensus.cc:515] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.702867 31739 tablet_bootstrap.cc:654] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.708433 31747 leader_election.cc:290] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:19:58.725538 31739 tablet_bootstrap.cc:492] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:58.726125 31739 ts_tablet_manager.cc:1403] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.002s
I20260709 12:19:58.729334 31739 raft_consensus.cc:359] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.730048 31739 raft_consensus.cc:385] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.730239 31740 tablet_bootstrap.cc:492] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:58.730406 31739 raft_consensus.cc:740] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.730939 31740 ts_tablet_manager.cc:1403] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.006s
I20260709 12:19:58.733386 31739 consensus_queue.cc:260] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.734653 31625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:58.735886 31739 ts_tablet_manager.cc:1434] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:19:58.736676 31740 raft_consensus.cc:359] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.737071 31739 tablet_bootstrap.cc:492] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
I20260709 12:19:58.737298 31740 raft_consensus.cc:385] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.737703 31740 raft_consensus.cc:740] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.733863 31744 raft_consensus.cc:493] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.738468 31744 raft_consensus.cc:515] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.741302 31741 tablet_bootstrap.cc:492] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:58.741888 31741 ts_tablet_manager.cc:1403] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.053s	user 0.023s	sys 0.023s
I20260709 12:19:58.744076 31739 tablet_bootstrap.cc:654] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.745002 31741 raft_consensus.cc:359] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.745888 31741 raft_consensus.cc:385] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:19:58.745992 31665 leader_election.cc:343] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f90650f89842899b446002404b9e9b (127.22.48.2:35529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.746210 31741 raft_consensus.cc:740] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.746258 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:58.747234 31741 consensus_queue.cc:260] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.748293 31744 leader_election.cc:290] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.749034 31744 raft_consensus.cc:493] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:58.749174 31664 leader_election.cc:343] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.749874 31664 leader_election.cc:304] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef; no voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b
I20260709 12:19:58.751543 31747 raft_consensus.cc:2749] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:19:58.752071 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:19:58.749631 31744 raft_consensus.cc:515] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.758967 31744 leader_election.cc:290] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.764470 31744 raft_consensus.cc:493] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.766224 31744 raft_consensus.cc:515] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.769326 31744 leader_election.cc:290] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.738489 31740 consensus_queue.cc:260] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.780234 31740 ts_tablet_manager.cc:1434] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 12:19:58.781651 31740 tablet_bootstrap.cc:492] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:58.797454 31763 raft_consensus.cc:493] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.798223 31763 raft_consensus.cc:515] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.799804 31744 raft_consensus.cc:493] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.800457 31744 raft_consensus.cc:515] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.800966 31763 leader_election.cc:290] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.802814 31744 leader_election.cc:290] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.806231 31740 tablet_bootstrap.cc:654] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.812741 31741 ts_tablet_manager.cc:1434] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.070s	user 0.024s	sys 0.043s
I20260709 12:19:58.813841 31741 tablet_bootstrap.cc:492] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:58.814425 31740 tablet_bootstrap.cc:492] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:58.814647 31739 tablet_bootstrap.cc:492] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:58.815044 31740 ts_tablet_manager.cc:1403] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.004s
I20260709 12:19:58.815214 31739 ts_tablet_manager.cc:1403] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.079s	user 0.039s	sys 0.035s
I20260709 12:19:58.818308 31740 raft_consensus.cc:359] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.818602 31739 raft_consensus.cc:359] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.819093 31740 raft_consensus.cc:385] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.819375 31739 raft_consensus.cc:385] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.819558 31740 raft_consensus.cc:740] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.820062 31741 tablet_bootstrap.cc:654] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.819772 31739 raft_consensus.cc:740] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.820713 31740 consensus_queue.cc:260] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.821487 31739 consensus_queue.cc:260] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.823863 31739 ts_tablet_manager.cc:1434] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:19:58.823869 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:58.824975 31739 tablet_bootstrap.cc:492] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
I20260709 12:19:58.825966 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:58.826648 31550 raft_consensus.cc:2468] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 0.
I20260709 12:19:58.828547 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:58.832458 31739 tablet_bootstrap.cc:654] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.830466 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:58.843806 31550 raft_consensus.cc:2468] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 0.
I20260709 12:19:58.846717 31740 ts_tablet_manager.cc:1434] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:19:58.850214 31764 raft_consensus.cc:493] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.852082 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
W20260709 12:19:58.853238 31590 leader_election.cc:343] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.859088 31590 leader_election.cc:304] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:58.859506 31740 tablet_bootstrap.cc:492] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:58.860146 31744 raft_consensus.cc:2804] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.857430 31764 raft_consensus.cc:515] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.860525 31744 raft_consensus.cc:493] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.861045 31744 raft_consensus.cc:3060] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:58.860348 31590 leader_election.cc:343] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.862128 31590 leader_election.cc:304] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:58.862905 31763 raft_consensus.cc:2804] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.863277 31763 raft_consensus.cc:493] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.863634 31763 raft_consensus.cc:3060] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.863962 31739 tablet_bootstrap.cc:492] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:58.864122 31764 leader_election.cc:290] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
W20260709 12:19:58.866613 31590 leader_election.cc:343] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.868044 31747 raft_consensus.cc:493] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.868527 31747 raft_consensus.cc:515] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.868827 31744 raft_consensus.cc:515] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.868973 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:58.869732 31699 raft_consensus.cc:2468] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 0.
I20260709 12:19:58.870432 31698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:58.870680 31747 leader_election.cc:290] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:19:58.870779 31763 raft_consensus.cc:515] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.864485 31739 ts_tablet_manager.cc:1403] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.027s
I20260709 12:19:58.871860 31625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:58.872568 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:58.873507 31549 raft_consensus.cc:2468] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 0.
I20260709 12:19:58.874301 31698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:58.874460 31590 leader_election.cc:304] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 169171504d4b466d9a5748e1eb660780
I20260709 12:19:58.874926 31664 leader_election.cc:304] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:19:58.875811 31747 raft_consensus.cc:2804] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.875602 31764 raft_consensus.cc:2804] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.876324 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:58.876366 31747 raft_consensus.cc:493] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.876514 31764 raft_consensus.cc:493] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.877166 31747 raft_consensus.cc:3060] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.877278 31763 leader_election.cc:290] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.877296 31764 raft_consensus.cc:3060] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.878763 31746 raft_consensus.cc:493] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.879271 31746 raft_consensus.cc:515] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
W20260709 12:19:58.875759 31590 leader_election.cc:343] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.880054 31739 raft_consensus.cc:359] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.881722 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:58.881922 31746 leader_election.cc:290] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f90650f89842899b446002404b9e9b (127.22.48.2:35529), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.882050 31739 raft_consensus.cc:385] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.877951 31696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130437a41f440db726b1f8bc017671" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:58.886412 31696 raft_consensus.cc:2468] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 0.
I20260709 12:19:58.886566 31744 leader_election.cc:290] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.873656 31625 raft_consensus.cc:2393] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65e845fdf8a14fefb33640e0e26febef in current term 1: Already voted for candidate f0f90650f89842899b446002404b9e9b in this term.
I20260709 12:19:58.882869 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:58.874951 31698 raft_consensus.cc:2468] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 0.
I20260709 12:19:58.872524 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130437a41f440db726b1f8bc017671" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:58.884591 31549 raft_consensus.cc:3060] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.889814 31746 raft_consensus.cc:493] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.890365 31741 tablet_bootstrap.cc:492] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:58.890306 31746 raft_consensus.cc:515] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.890864 31740 tablet_bootstrap.cc:654] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.890956 31741 ts_tablet_manager.cc:1403] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.077s	user 0.025s	sys 0.023s
I20260709 12:19:58.892360 31746 leader_election.cc:290] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f90650f89842899b446002404b9e9b (127.22.48.2:35529), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.894409 31741 raft_consensus.cc:359] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.895183 31741 raft_consensus.cc:385] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.895542 31741 raft_consensus.cc:740] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.896945 31549 raft_consensus.cc:2468] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:58.885176 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:19:58.885116 31747 raft_consensus.cc:515] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.901813 31699 raft_consensus.cc:2393] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f0f90650f89842899b446002404b9e9b in current term 1: Already voted for candidate 65e845fdf8a14fefb33640e0e26febef in this term.
I20260709 12:19:58.902572 31747 leader_election.cc:290] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:19:58.902798 31764 raft_consensus.cc:515] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.887806 31739 raft_consensus.cc:740] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.896466 31741 consensus_queue.cc:260] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.904414 31739 consensus_queue.cc:260] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.905156 31764 leader_election.cc:290] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.905768 31741 ts_tablet_manager.cc:1434] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:19:58.905653 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:58.906652 31739 ts_tablet_manager.cc:1434] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:19:58.906811 31741 tablet_bootstrap.cc:492] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:58.908648 31625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:19:58.908998 31740 tablet_bootstrap.cc:492] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:58.909430 31625 raft_consensus.cc:2393] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65e845fdf8a14fefb33640e0e26febef in current term 1: Already voted for candidate f0f90650f89842899b446002404b9e9b in this term.
I20260709 12:19:58.909539 31740 ts_tablet_manager.cc:1403] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.001s
I20260709 12:19:58.911022 31665 leader_election.cc:304] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef; no voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b
I20260709 12:19:58.918303 31625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:58.918476 31747 raft_consensus.cc:2749] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.919636 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:58.919800 31740 raft_consensus.cc:359] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.914259 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:58.913105 31741 tablet_bootstrap.cc:654] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.914707 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
W20260709 12:19:58.920970 31516 leader_election.cc:343] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f90650f89842899b446002404b9e9b (127.22.48.2:35529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.919713 31739 tablet_bootstrap.cc:492] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
W20260709 12:19:58.921751 31516 leader_election.cc:343] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f90650f89842899b446002404b9e9b (127.22.48.2:35529): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:58.921869 31515 leader_election.cc:343] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.922358 31515 leader_election.cc:304] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 169171504d4b466d9a5748e1eb660780; no voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b
I20260709 12:19:58.922354 31740 raft_consensus.cc:385] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.923061 31740 raft_consensus.cc:740] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
W20260709 12:19:58.923622 31515 leader_election.cc:343] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:58.884652 31590 leader_election.cc:343] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.924095 31515 leader_election.cc:304] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 169171504d4b466d9a5748e1eb660780; no voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b
I20260709 12:19:58.923913 31740 consensus_queue.cc:260] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.924346 31590 leader_election.cc:304] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f0f90650f89842899b446002404b9e9b; no voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef
I20260709 12:19:58.925375 31746 raft_consensus.cc:2749] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.925983 31764 raft_consensus.cc:2749] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.926291 31746 raft_consensus.cc:2749] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:58.928066 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:19:58.928695 31697 raft_consensus.cc:3060] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.930876 31739 tablet_bootstrap.cc:654] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.938658 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:19:58.939534 31699 raft_consensus.cc:3060] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:19:58.942652 31590 leader_election.cc:343] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.943411 31590 leader_election.cc:304] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:58.944139 31764 raft_consensus.cc:2804] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.944281 31590 leader_election.cc:304] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 169171504d4b466d9a5748e1eb660780
I20260709 12:19:58.944723 31764 raft_consensus.cc:697] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:19:58.945106 31744 raft_consensus.cc:2804] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.945526 31744 raft_consensus.cc:493] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.945994 31744 raft_consensus.cc:3060] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.946267 31697 raft_consensus.cc:2468] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:58.945940 31764 consensus_queue.cc:237] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.948402 31699 raft_consensus.cc:2468] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:58.950265 31739 tablet_bootstrap.cc:492] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:58.945493 31590 leader_election.cc:304] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 169171504d4b466d9a5748e1eb660780
I20260709 12:19:58.952005 31763 raft_consensus.cc:2804] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:58.952492 31763 raft_consensus.cc:493] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:58.952929 31763 raft_consensus.cc:3060] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.954583 31739 ts_tablet_manager.cc:1403] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.007s
I20260709 12:19:58.959842 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:58.960057 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:58.953858 31590 leader_election.cc:304] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:58.960736 31549 raft_consensus.cc:3060] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.962821 31741 tablet_bootstrap.cc:492] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:58.963296 31741 ts_tablet_manager.cc:1403] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.004s
I20260709 12:19:58.963239 31763 raft_consensus.cc:515] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.963536 31744 raft_consensus.cc:515] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.965436 31744 leader_election.cc:290] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.966055 31744 raft_consensus.cc:2804] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.966454 31739 raft_consensus.cc:359] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.966498 31744 raft_consensus.cc:697] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:19:58.966660 31763 leader_election.cc:290] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:58.967242 31739 raft_consensus.cc:385] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.967595 31739 raft_consensus.cc:740] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.967765 31744 consensus_queue.cc:237] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.968613 31549 raft_consensus.cc:2468] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:58.968906 31739 consensus_queue.cc:260] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.966886 31740 ts_tablet_manager.cc:1434] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.020s
I20260709 12:19:58.968613 31741 raft_consensus.cc:359] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.970856 31741 raft_consensus.cc:385] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:58.971174 31741 raft_consensus.cc:740] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:58.971850 31741 consensus_queue.cc:260] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.973888 31741 ts_tablet_manager.cc:1434] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:19:58.975129 31741 tablet_bootstrap.cc:492] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:58.976225 31740 tablet_bootstrap.cc:492] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:58.980109 31739 ts_tablet_manager.cc:1434] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:19:58.980888 31590 leader_election.cc:304] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:58.981220 31741 tablet_bootstrap.cc:654] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:58.981819 31777 raft_consensus.cc:2804] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:58.982662 31777 raft_consensus.cc:697] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:19:58.983321 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130437a41f440db726b1f8bc017671" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:19:58.983502 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130437a41f440db726b1f8bc017671" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:58.984025 31699 raft_consensus.cc:3060] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:58.983585 31777 consensus_queue.cc:237] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:58.985459 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:58.986743 31747 raft_consensus.cc:493] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.987418 31747 raft_consensus.cc:515] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:58.991149 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:58.992692 31699 raft_consensus.cc:2468] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
W20260709 12:19:58.992914 31664 leader_election.cc:343] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:58.997419 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:19:58.997992 31697 raft_consensus.cc:3060] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.001773 31740 tablet_bootstrap.cc:654] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
W20260709 12:19:59.002902 31590 leader_election.cc:343] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:59.004340 31590 leader_election.cc:343] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:19:59.004967 31590 leader_election.cc:343] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.006151 31747 leader_election.cc:290] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:19:59.007346 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
W20260709 12:19:59.008809 31665 leader_election.cc:343] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f0f90650f89842899b446002404b9e9b (127.22.48.2:35529): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.009251 31665 leader_election.cc:304] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef; no voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b
I20260709 12:19:59.010313 31747 raft_consensus.cc:2749] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:59.010794 31741 tablet_bootstrap.cc:492] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:59.011307 31741 ts_tablet_manager.cc:1403] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.007s
I20260709 12:19:59.014040 31741 raft_consensus.cc:359] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.014746 31697 raft_consensus.cc:2468] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:59.014762 31741 raft_consensus.cc:385] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.015621 31741 raft_consensus.cc:740] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.017171 31739 tablet_bootstrap.cc:492] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
I20260709 12:19:59.019258 31773 raft_consensus.cc:493] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.017894 31741 consensus_queue.cc:260] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.019520 31740 tablet_bootstrap.cc:492] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:59.019754 31773 raft_consensus.cc:515] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.020247 31777 raft_consensus.cc:493] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.005728 31590 leader_election.cc:304] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 169171504d4b466d9a5748e1eb660780
I20260709 12:19:59.022449 31777 raft_consensus.cc:515] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.022823 31773 leader_election.cc:290] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f90650f89842899b446002404b9e9b (127.22.48.2:35529), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.023036 31764 raft_consensus.cc:2804] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.023244 31590 leader_election.cc:304] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 169171504d4b466d9a5748e1eb660780
I20260709 12:19:59.023656 31764 raft_consensus.cc:697] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:19:59.024600 31764 consensus_queue.cc:237] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.025372 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:59.026129 31624 raft_consensus.cc:2468] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 169171504d4b466d9a5748e1eb660780 in term 0.
I20260709 12:19:59.026487 31777 leader_election.cc:290] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.027199 31777 raft_consensus.cc:2804] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.027114 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:59.027783 31777 raft_consensus.cc:697] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:19:59.027885 31697 raft_consensus.cc:2468] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 169171504d4b466d9a5748e1eb660780 in term 0.
I20260709 12:19:59.027791 31739 tablet_bootstrap.cc:654] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.028839 31516 leader_election.cc:304] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:59.028731 31777 consensus_queue.cc:237] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.029700 31773 raft_consensus.cc:2804] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.030107 31773 raft_consensus.cc:493] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.030472 31773 raft_consensus.cc:3060] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.021030 31740 ts_tablet_manager.cc:1403] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.004s
I20260709 12:19:59.038206 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:59.038797 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:59.039661 31550 raft_consensus.cc:2468] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 0.
I20260709 12:19:59.042259 31773 raft_consensus.cc:515] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.045732 31590 leader_election.cc:304] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:59.045976 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:19:59.047359 31624 raft_consensus.cc:3060] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.048143 31744 raft_consensus.cc:2804] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.048586 31744 raft_consensus.cc:493] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.048928 31744 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.050132 31446 catalog_manager.cc:5697] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.052205 31446 catalog_manager.cc:5697] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.053882 31446 catalog_manager.cc:5697] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.057390 31744 raft_consensus.cc:515] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.060537 31773 leader_election.cc:290] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 election: Requested vote from peers f0f90650f89842899b446002404b9e9b (127.22.48.2:35529), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.061784 31624 raft_consensus.cc:2468] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 169171504d4b466d9a5748e1eb660780 in term 1.
I20260709 12:19:59.063405 31516 leader_election.cc:304] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
W20260709 12:19:59.058557 31590 leader_election.cc:343] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.059883 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:19:59.064644 31697 raft_consensus.cc:3060] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.066583 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:59.067209 31550 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.069762 31773 raft_consensus.cc:2804] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.070257 31773 raft_consensus.cc:697] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 1 LEADER]: Becoming Leader. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Running, Role: LEADER
I20260709 12:19:59.071105 31773 consensus_queue.cc:237] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.060470 31741 ts_tablet_manager.cc:1434] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.002s
I20260709 12:19:59.073571 31741 tablet_bootstrap.cc:492] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b: Bootstrap starting.
I20260709 12:19:59.075557 31697 raft_consensus.cc:2468] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 169171504d4b466d9a5748e1eb660780 in term 1.
I20260709 12:19:59.065192 31744 leader_election.cc:290] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.077258 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:19:59.075901 31550 raft_consensus.cc:2468] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:59.079334 31739 tablet_bootstrap.cc:492] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:59.079262 31740 raft_consensus.cc:359] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.079910 31739 ts_tablet_manager.cc:1403] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.024s
I20260709 12:19:59.080250 31740 raft_consensus.cc:385] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.082499 31740 raft_consensus.cc:740] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.082329 31739 raft_consensus.cc:359] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.083037 31739 raft_consensus.cc:385] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.083329 31739 raft_consensus.cc:740] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.083560 31740 consensus_queue.cc:260] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.084012 31739 consensus_queue.cc:260] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
W20260709 12:19:59.085012 31590 leader_election.cc:343] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.083499 31741 tablet_bootstrap.cc:654] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.086308 31739 ts_tablet_manager.cc:1434] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:19:59.086117 31590 leader_election.cc:304] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 65e845fdf8a14fefb33640e0e26febef
I20260709 12:19:59.087246 31739 tablet_bootstrap.cc:492] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef: Bootstrap starting.
I20260709 12:19:59.088706 31744 raft_consensus.cc:2804] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.089540 31744 raft_consensus.cc:697] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:19:59.090632 31744 consensus_queue.cc:237] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.093187 31739 tablet_bootstrap.cc:654] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.094537 31740 ts_tablet_manager.cc:1434] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.002s
I20260709 12:19:59.097167 31740 tablet_bootstrap.cc:492] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:59.098510 31741 tablet_bootstrap.cc:492] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b: No bootstrap required, opened a new log
I20260709 12:19:59.098994 31741 ts_tablet_manager.cc:1403] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:19:59.102806 31741 raft_consensus.cc:359] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:59.103483 31741 raft_consensus.cc:385] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.103760 31741 raft_consensus.cc:740] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.104483 31741 consensus_queue.cc:260] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:59.106690 31741 ts_tablet_manager.cc:1434] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:19:59.109634 31739 tablet_bootstrap.cc:492] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef: No bootstrap required, opened a new log
I20260709 12:19:59.110160 31739 ts_tablet_manager.cc:1403] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260709 12:19:59.110214 31740 tablet_bootstrap.cc:654] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.112905 31739 raft_consensus.cc:359] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.113574 31739 raft_consensus.cc:385] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.113857 31739 raft_consensus.cc:740] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.114689 31739 consensus_queue.cc:260] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.117105 31739 ts_tablet_manager.cc:1434] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:59.118023 31445 catalog_manager.cc:5697] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 reported cstate change: term changed from 0 to 1, leader changed from <none> to 169171504d4b466d9a5748e1eb660780 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "169171504d4b466d9a5748e1eb660780" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.134335 31740 tablet_bootstrap.cc:492] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:59.133394 31447 catalog_manager.cc:5697] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.134920 31740 ts_tablet_manager.cc:1403] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.015s
I20260709 12:19:59.135499 31447 catalog_manager.cc:5697] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.137279 31447 catalog_manager.cc:5697] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.137960 31740 raft_consensus.cc:359] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.138710 31740 raft_consensus.cc:385] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.139011 31740 raft_consensus.cc:740] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.139753 31740 consensus_queue.cc:260] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.142011 31740 ts_tablet_manager.cc:1434] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:19:59.143028 31740 tablet_bootstrap.cc:492] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:59.147006 31773 raft_consensus.cc:493] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.147526 31773 raft_consensus.cc:515] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.148818 31740 tablet_bootstrap.cc:654] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.149287 31773 leader_election.cc:290] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f90650f89842899b446002404b9e9b (127.22.48.2:35529), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.150022 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:59.151734 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:59.152527 31699 raft_consensus.cc:2393] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 169171504d4b466d9a5748e1eb660780 in current term 1: Already voted for candidate f0f90650f89842899b446002404b9e9b in this term.
I20260709 12:19:59.153671 31515 leader_election.cc:304] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 169171504d4b466d9a5748e1eb660780; no voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b
I20260709 12:19:59.154352 31740 tablet_bootstrap.cc:492] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:59.154687 31773 raft_consensus.cc:3060] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.154826 31740 ts_tablet_manager.cc:1403] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260709 12:19:59.157260 31740 raft_consensus.cc:359] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.157708 31740 raft_consensus.cc:385] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.157927 31740 raft_consensus.cc:740] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.158622 31740 consensus_queue.cc:260] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.160166 31740 ts_tablet_manager.cc:1434] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:19:59.160410 31773 raft_consensus.cc:2749] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:59.160964 31740 tablet_bootstrap.cc:492] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:59.165874 31744 raft_consensus.cc:493] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.166615 31740 tablet_bootstrap.cc:654] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.166402 31744 raft_consensus.cc:515] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:59.168579 31744 leader_election.cc:290] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.169548 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:59.170339 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:59.170982 31699 raft_consensus.cc:2468] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 0.
I20260709 12:19:59.172246 31590 leader_election.cc:304] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 
W20260709 12:19:59.173060 31590 leader_election.cc:343] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:19:59.173878 31744 raft_consensus.cc:2804] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.173985 31740 tablet_bootstrap.cc:492] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:59.174381 31744 raft_consensus.cc:493] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.174695 31740 ts_tablet_manager.cc:1403] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:19:59.174748 31744 raft_consensus.cc:3060] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.177657 31740 raft_consensus.cc:359] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:59.178316 31740 raft_consensus.cc:385] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.178580 31740 raft_consensus.cc:740] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.179240 31740 consensus_queue.cc:260] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:59.181236 31740 ts_tablet_manager.cc:1434] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:19:59.182124 31740 tablet_bootstrap.cc:492] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:19:59.182173 31744 raft_consensus.cc:515] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:59.184994 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:59.185608 31550 raft_consensus.cc:3060] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.188441 31740 tablet_bootstrap.cc:654] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: Neither blocks nor log segments found. Creating new log.
I20260709 12:19:59.188582 31744 leader_election.cc:290] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.189896 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:19:59.190527 31699 raft_consensus.cc:3060] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.192488 31550 raft_consensus.cc:2468] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:59.193579 31590 leader_election.cc:304] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:59.194846 31744 raft_consensus.cc:2804] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.195384 31744 raft_consensus.cc:697] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:19:59.196321 31744 consensus_queue.cc:237] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:19:59.199496 31740 tablet_bootstrap.cc:492] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: No bootstrap required, opened a new log
I20260709 12:19:59.199985 31740 ts_tablet_manager.cc:1403] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:19:59.199985 31699 raft_consensus.cc:2468] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:59.202554 31740 raft_consensus.cc:359] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.203244 31740 raft_consensus.cc:385] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:19:59.203549 31740 raft_consensus.cc:740] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:19:59.204380 31740 consensus_queue.cc:260] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.206327 31740 ts_tablet_manager.cc:1434] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:19:59.207968 31445 catalog_manager.cc:5697] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:59.292672 31747 raft_consensus.cc:493] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.293270 31747 raft_consensus.cc:515] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.295447 31747 leader_election.cc:290] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:19:59.296166 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:59.296887 31550 raft_consensus.cc:2468] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 0.
I20260709 12:19:59.297016 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:59.297678 31624 raft_consensus.cc:2468] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 0.
I20260709 12:19:59.297834 31664 leader_election.cc:304] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:19:59.298694 31747 raft_consensus.cc:2804] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.299052 31747 raft_consensus.cc:493] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.299335 31747 raft_consensus.cc:3060] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.304165 31747 raft_consensus.cc:515] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.305753 31747 leader_election.cc:290] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:19:59.306533 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:59.306722 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:19:59.307075 31550 raft_consensus.cc:3060] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.307335 31624 raft_consensus.cc:3060] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.312034 31550 raft_consensus.cc:2468] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 1.
I20260709 12:19:59.312165 31624 raft_consensus.cc:2468] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 1.
I20260709 12:19:59.313262 31664 leader_election.cc:304] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:19:59.314092 31747 raft_consensus.cc:2804] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.315083 31747 raft_consensus.cc:697] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 1 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:19:59.315924 31747 consensus_queue.cc:237] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.323422 31447 catalog_manager.cc:5697] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 0 to 1, leader changed from <none> to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 1 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:59.351099 31773 raft_consensus.cc:493] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.351712 31773 raft_consensus.cc:515] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.353529 31773 leader_election.cc:290] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f90650f89842899b446002404b9e9b (127.22.48.2:35529), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.354413 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130437a41f440db726b1f8bc017671" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:59.354629 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130437a41f440db726b1f8bc017671" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:59.355366 31699 raft_consensus.cc:2393] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 169171504d4b466d9a5748e1eb660780 in current term 1: Already voted for candidate f0f90650f89842899b446002404b9e9b in this term.
I20260709 12:19:59.356366 31515 leader_election.cc:304] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 169171504d4b466d9a5748e1eb660780; no voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b
I20260709 12:19:59.357051 31773 raft_consensus.cc:3060] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.363801 31773 raft_consensus.cc:2749] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:59.366968 31744 raft_consensus.cc:493] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.367457 31744 raft_consensus.cc:515] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.369226 31744 leader_election.cc:290] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.370013 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:59.370155 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:59.370672 31550 raft_consensus.cc:2468] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 0.
I20260709 12:19:59.370824 31699 raft_consensus.cc:2468] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 0.
I20260709 12:19:59.371716 31590 leader_election.cc:304] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:59.372445 31744 raft_consensus.cc:2804] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:19:59.372820 31744 raft_consensus.cc:493] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.373147 31744 raft_consensus.cc:3060] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.378747 31744 raft_consensus.cc:515] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.380553 31744 leader_election.cc:290] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.381434 31550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:19:59.381744 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:19:59.382011 31550 raft_consensus.cc:3060] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.382437 31699 raft_consensus.cc:3060] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.387745 31550 raft_consensus.cc:2468] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:59.387779 31699 raft_consensus.cc:2468] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:19:59.389027 31590 leader_election.cc:304] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:19:59.389842 31744 raft_consensus.cc:2804] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:19:59.390316 31744 raft_consensus.cc:697] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:19:59.391019 31744 consensus_queue.cc:237] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.396222 31744 consensus_queue.cc:1048] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.398850 31447 catalog_manager.cc:5697] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 0 to 1, leader changed from <none> to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:59.409042 31744 consensus_queue.cc:1048] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.418113 31773 raft_consensus.cc:493] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.418695 31773 raft_consensus.cc:515] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.420758 31773 leader_election.cc:290] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f0f90650f89842899b446002404b9e9b (127.22.48.2:35529), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:19:59.421878 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:19:59.422312 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "169171504d4b466d9a5748e1eb660780" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:59.422791 31697 raft_consensus.cc:2393] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 169171504d4b466d9a5748e1eb660780 in current term 1: Already voted for candidate f0f90650f89842899b446002404b9e9b in this term.
I20260709 12:19:59.423285 31744 consensus_queue.cc:1048] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.425357 31516 leader_election.cc:304] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 169171504d4b466d9a5748e1eb660780; no voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b
I20260709 12:19:59.426508 31773 raft_consensus.cc:3060] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.433982 31773 raft_consensus.cc:2749] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:59.436221 31782 consensus_queue.cc:1048] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.441609 31747 raft_consensus.cc:493] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.442214 31747 raft_consensus.cc:515] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:19:59.445655 31747 leader_election.cc:290] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:19:59.446413 31549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "169171504d4b466d9a5748e1eb660780" is_pre_election: true
I20260709 12:19:59.446741 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0f90650f89842899b446002404b9e9b" is_pre_election: true
I20260709 12:19:59.447328 31549 raft_consensus.cc:2393] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65e845fdf8a14fefb33640e0e26febef in current term 1: Already voted for candidate f0f90650f89842899b446002404b9e9b in this term.
I20260709 12:19:59.448735 31664 leader_election.cc:304] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef; no voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b
I20260709 12:19:59.450489 31747 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:19:59.457398 31747 raft_consensus.cc:2749] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:19:59.475282 22720 ts_manager.cc:295] Set tserver state for 169171504d4b466d9a5748e1eb660780 to MAINTENANCE_MODE
I20260709 12:19:59.476104 22720 tablet_server.cc:179] TabletServer@127.22.48.1:0 shutting down...
I20260709 12:19:59.497275 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:19:59.498370 22720 tablet_replica.cc:333] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.499264 22720 raft_consensus.cc:2243] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:59.499651 22720 raft_consensus.cc:2272] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:59.501701 22720 tablet_replica.cc:333] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.502336 22720 raft_consensus.cc:2243] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:59.502795 22720 raft_consensus.cc:2272] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:59.505273 22720 tablet_replica.cc:333] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.505630 31782 consensus_queue.cc:1048] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.505870 22720 raft_consensus.cc:2243] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:59.506500 22720 raft_consensus.cc:2272] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:59.508713 22720 tablet_replica.cc:333] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.509305 22720 raft_consensus.cc:2243] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:19:59.510157 22720 pending_rounds.cc:70] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Trying to abort 1 pending ops.
I20260709 12:19:59.510423 22720 pending_rounds.cc:77] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305623957830385664 op_type: NO_OP noop_request { }
I20260709 12:19:59.510779 22720 raft_consensus.cc:2889] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:19:59.511089 22720 raft_consensus.cc:2272] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:59.513715 22720 tablet_replica.cc:333] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.514753 22720 raft_consensus.cc:2243] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:59.515437 22720 raft_consensus.cc:2272] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:59.518226 22720 tablet_replica.cc:333] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.519021 22720 raft_consensus.cc:2243] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:59.519069 31590 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 405 similar messages]
I20260709 12:19:59.519505 22720 raft_consensus.cc:2272] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:59.522078 22720 tablet_replica.cc:333] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.522821 22720 raft_consensus.cc:2243] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:59.523255 22720 raft_consensus.cc:2272] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:59.525501 22720 tablet_replica.cc:333] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.526211 22720 raft_consensus.cc:2243] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:59.526731 22720 raft_consensus.cc:2272] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:19:59.528990 31590 consensus_peers.cc:597] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:59.529335 22720 tablet_replica.cc:333] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.529920 22720 raft_consensus.cc:2243] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:59.530339 22720 raft_consensus.cc:2272] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:59.532013 22720 tablet_replica.cc:333] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: stopping tablet replica
I20260709 12:19:59.532488 22720 raft_consensus.cc:2243] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:59.532859 22720 raft_consensus.cc:2272] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:59.554314 22720 tablet_server.cc:196] TabletServer@127.22.48.1:0 shutdown complete.
W20260709 12:19:59.557334 31590 consensus_peers.cc:597] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:59.583016 31590 consensus_peers.cc:597] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:59.592419 31763 consensus_queue.cc:1048] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.616555 31763 consensus_queue.cc:1048] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:59.617110 31590 consensus_peers.cc:597] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:59.644615 31763 consensus_queue.cc:1048] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:19:59.703603 31777 consensus_queue.cc:1048] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:59.717651 31590 consensus_peers.cc:597] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:59.739755 31747 consensus_queue.cc:1048] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:59.753345 31664 consensus_peers.cc:597] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:59.753409 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:19:59.818446 31590 consensus_peers.cc:597] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:59.971403 31744 consensus_queue.cc:1048] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:19:59.984283 31590 consensus_peers.cc:597] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:00.033767 31590 consensus_peers.cc:597] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:00.754427 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:00.907500 31744 raft_consensus.cc:493] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.908118 31744 raft_consensus.cc:515] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:00.909888 31744 leader_election.cc:290] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:20:00.910902 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef" is_pre_election: true
I20260709 12:20:00.911547 31697 raft_consensus.cc:2468] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 1.
I20260709 12:20:00.912794 31590 leader_election.cc:304] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:20:00.913589 31744 raft_consensus.cc:2804] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:20:00.913688 31590 leader_election.cc:336] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111)
I20260709 12:20:00.913964 31744 raft_consensus.cc:493] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.914345 31744 raft_consensus.cc:3060] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:00.919111 31744 raft_consensus.cc:515] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:00.920533 31744 leader_election.cc:290] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:20:00.921981 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:20:00.922549 31697 raft_consensus.cc:3060] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:00.924021 31590 leader_election.cc:336] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111)
I20260709 12:20:00.927256 31697 raft_consensus.cc:2468] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 2.
I20260709 12:20:00.928229 31590 leader_election.cc:304] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 169171504d4b466d9a5748e1eb660780
I20260709 12:20:00.928819 31744 raft_consensus.cc:2804] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:00.929198 31744 raft_consensus.cc:697] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:00.929951 31744 consensus_queue.cc:237] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:00.936312 31445 catalog_manager.cc:5697] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 1 to 2, leader changed from 169171504d4b466d9a5748e1eb660780 (127.22.48.1) to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:01.410395 31697 raft_consensus.cc:1275] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:20:01.411520 31764 consensus_queue.cc:1048] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:01.426155 31590 consensus_peers.cc:597] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:01.755409 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:20:01.860255 31590 consensus_peers.cc:597] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:02.128051 31664 consensus_peers.cc:597] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:02.199535 31590 consensus_peers.cc:597] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:02.214941 31590 consensus_peers.cc:597] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:02.272545 31590 consensus_peers.cc:597] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:02.332561 31590 consensus_peers.cc:597] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:02.459481 31590 consensus_peers.cc:597] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:02.517742 31590 consensus_peers.cc:597] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:02.752163 31590 consensus_peers.cc:597] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:02.756780 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:20:03.758049 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:20:04.139859 31590 consensus_peers.cc:597] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:04.300940 31590 consensus_peers.cc:597] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:04.553900 31590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111) [suppressed 96 similar messages]
I20260709 12:20:04.573205 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:04.580400 31843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:04.581236 31844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:04.583101 31846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:04.583884 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:04.585192 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:04.585433 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:04.585569 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599604585559 us; error 0 us; skew 500 ppm
I20260709 12:20:04.586077 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:04.588601 22720 webserver.cc:533] Webserver started at http://127.22.48.1:36021/ using document root <none> and password file <none>
I20260709 12:20:04.589077 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:04.589231 22720 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:20:04.593082 22720 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 12:20:04.596935 31851 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:04.597666 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:04.597965 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "169171504d4b466d9a5748e1eb660780"
format_stamp: "Formatted at 2026-07-09 12:19:57 on dist-test-slave-044g"
I20260709 12:20:04.598441 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:20:04.606225 31664 consensus_peers.cc:597] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:04.620363 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:04.621785 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:04.623376 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:04.627105 31858 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:20:04.657220 31590 consensus_peers.cc:597] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:04.677016 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:20:04.677445 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.051s	user 0.003s	sys 0.000s
I20260709 12:20:04.677800 22720 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:20:04.683024 31858 tablet_bootstrap.cc:492] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:20:04.694471 31858 tablet_bootstrap.cc:492] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.695206 31858 tablet_bootstrap.cc:492] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.695864 31858 ts_tablet_manager.cc:1403] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.006s
W20260709 12:20:04.698771 31590 consensus_peers.cc:597] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:04.698815 31858 raft_consensus.cc:359] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:20:04.699934 31858 raft_consensus.cc:740] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.700728 31858 consensus_queue.cc:260] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:20:04.703787 31858 ts_tablet_manager.cc:1434] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.006s
I20260709 12:20:04.704567 31858 tablet_bootstrap.cc:492] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:20:04.716331 31858 tablet_bootstrap.cc:492] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:20:04.717214 31858 tablet_bootstrap.cc:492] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.717788 31858 ts_tablet_manager.cc:1403] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:20:04.719520 22720 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:20:04.719910 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.042s	user 0.043s	sys 0.000s
I20260709 12:20:04.720449 31858 raft_consensus.cc:359] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.721161 31858 raft_consensus.cc:740] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.721880 31858 consensus_queue.cc:260] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.723515 31858 ts_tablet_manager.cc:1434] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:20:04.724207 31858 tablet_bootstrap.cc:492] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
W20260709 12:20:04.734023 31590 consensus_peers.cc:597] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:04.738479 31858 tablet_bootstrap.cc:492] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.739354 31858 tablet_bootstrap.cc:492] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.740128 31858 ts_tablet_manager.cc:1403] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 12:20:04.742857 31858 raft_consensus.cc:359] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.743561 31858 raft_consensus.cc:740] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.744248 31858 consensus_queue.cc:260] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.746228 31858 ts_tablet_manager.cc:1434] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 12:20:04.747210 31858 tablet_bootstrap.cc:492] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:20:04.759007 31858 tablet_bootstrap.cc:492] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:20:04.759136 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:04.759783 31858 tablet_bootstrap.cc:492] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.760316 31858 ts_tablet_manager.cc:1403] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 12:20:04.762354 31858 raft_consensus.cc:359] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.762858 31858 raft_consensus.cc:740] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.763553 31858 consensus_queue.cc:260] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.765607 31858 ts_tablet_manager.cc:1434] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:20:04.766378 31858 tablet_bootstrap.cc:492] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:20:04.778542 31858 tablet_bootstrap.cc:492] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.779796 31858 tablet_bootstrap.cc:492] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.780683 31858 ts_tablet_manager.cc:1403] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 12:20:04.784015 31858 raft_consensus.cc:359] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.784811 31858 raft_consensus.cc:740] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.785795 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:43317
I20260709 12:20:04.785876 31920 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:43317 every 8 connection(s)
I20260709 12:20:04.785682 31858 consensus_queue.cc:260] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.787989 31858 ts_tablet_manager.cc:1434] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:04.788834 31858 tablet_bootstrap.cc:492] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
W20260709 12:20:04.791198 31922 tablet.cc:2406] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:04.791823 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:04.803750 31858 tablet_bootstrap.cc:492] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.804452 31858 tablet_bootstrap.cc:492] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.805068 31858 ts_tablet_manager.cc:1403] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:20:04.808089 31858 raft_consensus.cc:359] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.808825 31858 raft_consensus.cc:740] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.809607 31858 consensus_queue.cc:260] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.811487 31858 ts_tablet_manager.cc:1434] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:20:04.812237 31858 tablet_bootstrap.cc:492] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:20:04.812839 31921 heartbeater.cc:344] Connected to a master server at 127.22.48.62:33323
I20260709 12:20:04.813301 31921 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:04.814229 31921 heartbeater.cc:507] Master 127.22.48.62:33323 requested a full tablet report, sending...
I20260709 12:20:04.819079 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:04.819850 31624 raft_consensus.cc:606] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:04.821421 31445 ts_manager.cc:194] Re-registered known tserver with Master: 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317)
I20260709 12:20:04.822696 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:04.823230 31624 raft_consensus.cc:606] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:04.825690 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62130437a41f440db726b1f8bc017671"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:04.825939 31858 tablet_bootstrap.cc:492] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.826170 31624 raft_consensus.cc:606] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:04.826875 31858 tablet_bootstrap.cc:492] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.827567 31858 ts_tablet_manager.cc:1403] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:20:04.828649 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:04.829142 31624 raft_consensus.cc:606] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:04.830106 31858 raft_consensus.cc:359] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.830832 31858 raft_consensus.cc:740] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.831449 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:04.831967 31624 raft_consensus.cc:606] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:04.831561 31858 consensus_queue.cc:260] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.833223 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:20:04.833731 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:04.833796 31858 ts_tablet_manager.cc:1434] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:20:04.833936 31445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52338
I20260709 12:20:04.834582 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:04.834806 31858 tablet_bootstrap.cc:492] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:20:04.837587 31921 heartbeater.cc:499] Master 127.22.48.62:33323 was elected leader, sending a full tablet report...
I20260709 12:20:04.846395 31858 tablet_bootstrap.cc:492] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.847249 31858 tablet_bootstrap.cc:492] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.847911 31858 ts_tablet_manager.cc:1403] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:20:04.850440 31858 raft_consensus.cc:359] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.851128 31858 raft_consensus.cc:740] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.851831 31858 consensus_queue.cc:260] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.853870 31858 ts_tablet_manager.cc:1434] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:04.854597 31858 tablet_bootstrap.cc:492] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:20:04.869174 31842 raft_consensus.cc:993] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:04.869807 31744 raft_consensus.cc:1081] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:04.870023 31858 tablet_bootstrap.cc:492] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.870921 31858 tablet_bootstrap.cc:492] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.871377 31858 ts_tablet_manager.cc:1403] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:20:04.873122 31858 raft_consensus.cc:359] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.873557 31858 raft_consensus.cc:740] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.874233 31858 consensus_queue.cc:260] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.874909 31699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:04.875552 31699 raft_consensus.cc:493] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:04.875955 31699 raft_consensus.cc:3060] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.876319 31858 ts_tablet_manager.cc:1434] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:04.877262 31858 tablet_bootstrap.cc:492] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: Bootstrap starting.
I20260709 12:20:04.888832 31699 raft_consensus.cc:515] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.898698 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:04.901424 31624 raft_consensus.cc:3055] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:04.902019 31624 raft_consensus.cc:740] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:04.904971 31858 tablet_bootstrap.cc:492] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:20:04.904326 31624 consensus_queue.cc:260] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.908089 31624 raft_consensus.cc:3060] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.906138 31858 tablet_bootstrap.cc:492] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: Bootstrap complete.
I20260709 12:20:04.910800 31858 ts_tablet_manager.cc:1403] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.012s
I20260709 12:20:04.913600 31858 raft_consensus.cc:359] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.914475 31858 raft_consensus.cc:740] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 169171504d4b466d9a5748e1eb660780, State: Initialized, Role: FOLLOWER
I20260709 12:20:04.897732 31699 leader_election.cc:290] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:04.915138 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:04.915975 31895 raft_consensus.cc:3060] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:04.915189 31858 consensus_queue.cc:260] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.918993 31858 ts_tablet_manager.cc:1434] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:04.922693 31624 raft_consensus.cc:2468] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:04.924450 31665 leader_election.cc:304] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65e845fdf8a14fefb33640e0e26febef, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:20:04.924717 31895 raft_consensus.cc:2468] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:04.926047 31837 raft_consensus.cc:2804] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:04.927485 31837 raft_consensus.cc:697] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:04.928651 31837 consensus_queue.cc:237] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:04.938033 31445 catalog_manager.cc:5697] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 1 to 2, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 2 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.007546 31842 raft_consensus.cc:993] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:05.007982 31744 raft_consensus.cc:1081] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:05.009392 31699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:05.009896 31699 raft_consensus.cc:493] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.010186 31699 raft_consensus.cc:3060] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.016062 31699 raft_consensus.cc:515] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.017777 31699 leader_election.cc:290] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:05.018601 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:05.018816 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:05.019217 31895 raft_consensus.cc:3060] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.019423 31624 raft_consensus.cc:3055] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.019793 31624 raft_consensus.cc:740] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:05.020473 31624 consensus_queue.cc:260] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.021461 31624 raft_consensus.cc:3060] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.024446 31895 raft_consensus.cc:2468] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:05.025519 31664 leader_election.cc:304] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:05.026362 31837 raft_consensus.cc:2804] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:05.026780 31837 raft_consensus.cc:697] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:05.026777 31624 raft_consensus.cc:2468] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:05.027900 31837 consensus_queue.cc:237] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.035336 31445 catalog_manager.cc:5697] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 1 to 2, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 2 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.069468 31842 raft_consensus.cc:993] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:05.069958 31744 raft_consensus.cc:1081] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:05.071429 31699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62130437a41f440db726b1f8bc017671"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:05.071985 31699 raft_consensus.cc:493] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.072293 31699 raft_consensus.cc:3060] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.077915 31699 raft_consensus.cc:515] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.079768 31699 leader_election.cc:290] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:05.080524 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130437a41f440db726b1f8bc017671" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:05.080960 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62130437a41f440db726b1f8bc017671" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:05.081130 31895 raft_consensus.cc:3060] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.081547 31624 raft_consensus.cc:3055] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.081853 31624 raft_consensus.cc:740] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:05.082662 31624 consensus_queue.cc:260] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.083707 31624 raft_consensus.cc:3060] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.086653 31895 raft_consensus.cc:2468] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:05.087666 31664 leader_election.cc:304] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:05.088395 31837 raft_consensus.cc:2804] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:05.088899 31837 raft_consensus.cc:697] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:05.089252 31624 raft_consensus.cc:2468] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:05.089967 31837 consensus_queue.cc:237] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.097462 31445 catalog_manager.cc:5697] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 1 to 2, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 2 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.147529 31744 raft_consensus.cc:993] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:05.148013 31744 raft_consensus.cc:1081] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:05.149703 31697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:05.150363 31697 raft_consensus.cc:493] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.150763 31697 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.156213 31697 raft_consensus.cc:515] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.157670 31697 leader_election.cc:290] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:05.158531 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:05.158751 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:05.159236 31895 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.159318 31624 raft_consensus.cc:3055] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.159811 31624 raft_consensus.cc:740] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:05.160631 31624 consensus_queue.cc:260] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.161999 31624 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.167672 31895 raft_consensus.cc:2468] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:05.169241 31664 leader_election.cc:304] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:05.169636 31624 raft_consensus.cc:2468] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:05.170176 31837 raft_consensus.cc:2804] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:05.170737 31837 raft_consensus.cc:697] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:05.171741 31837 consensus_queue.cc:237] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.179616 31445 catalog_manager.cc:5697] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 1 to 2, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 2 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.223037 31946 raft_consensus.cc:993] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:05.223551 31744 raft_consensus.cc:1081] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:05.224982 31697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:05.225569 31697 raft_consensus.cc:493] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.225903 31697 raft_consensus.cc:3060] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.231014 31697 raft_consensus.cc:515] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.232637 31697 leader_election.cc:290] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:05.233897 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:05.233923 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:05.234545 31895 raft_consensus.cc:3060] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.234970 31624 raft_consensus.cc:3055] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:05.235313 31624 raft_consensus.cc:740] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:05.236238 31624 consensus_queue.cc:260] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.238893 31624 raft_consensus.cc:3060] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.242832 31895 raft_consensus.cc:2468] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:05.244352 31664 leader_election.cc:304] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:05.245249 31837 raft_consensus.cc:2804] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:05.245728 31837 raft_consensus.cc:697] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:05.246727 31837 consensus_queue.cc:237] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.247344 31624 raft_consensus.cc:2468] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:05.253942 31894 raft_consensus.cc:3060] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:05.254964 31447 catalog_manager.cc:5697] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 1 to 2, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 2 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:05.261598 31894 pending_rounds.cc:85] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Aborting all ops after (but not including) 0
I20260709 12:20:05.261976 31894 pending_rounds.cc:107] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:20:05.262324 31894 raft_consensus.cc:2889] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:05.370378 31894 raft_consensus.cc:1275] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.371678 31837 consensus_queue.cc:1048] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:05.377285 31624 raft_consensus.cc:1275] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.379148 31837 consensus_queue.cc:1048] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.471885 31624 raft_consensus.cc:1275] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.473141 31953 consensus_queue.cc:1048] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.482926 31894 raft_consensus.cc:1275] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.485457 31953 consensus_queue.cc:1048] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.515288 31624 raft_consensus.cc:1275] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.516923 31953 consensus_queue.cc:1048] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.527416 31894 raft_consensus.cc:1275] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.529246 31953 consensus_queue.cc:1048] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.655426 31894 raft_consensus.cc:1275] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.656656 31953 consensus_queue.cc:1048] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.665535 31624 raft_consensus.cc:1275] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.667212 31937 consensus_queue.cc:1048] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:05.731231 31894 raft_consensus.cc:1275] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.732911 31937 consensus_queue.cc:1048] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:05.746265 31624 raft_consensus.cc:1275] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:05.747814 31960 consensus_queue.cc:1048] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:20:05.760462 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:05.844100 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:05.851634 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:05.852146 31624 raft_consensus.cc:606] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:05.865013 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
mode: GRACEFUL
new_leader_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:20:05.865595 31697 raft_consensus.cc:606] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Received request to transfer leadership to TS f0f90650f89842899b446002404b9e9b
I20260709 12:20:05.868266 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
mode: GRACEFUL
new_leader_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:20:05.868767 31697 raft_consensus.cc:606] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 1 LEADER]: Received request to transfer leadership to TS f0f90650f89842899b446002404b9e9b
I20260709 12:20:05.869856 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:05.870402 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:05.870959 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:05.924999 31937 raft_consensus.cc:993] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef: : Instructing follower f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:05.925632 31960 raft_consensus.cc:1081] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Signalling peer f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:05.927121 31624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:20:05.927618 31624 raft_consensus.cc:493] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:05.927973 31624 raft_consensus.cc:3060] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:05.933269 31624 raft_consensus.cc:515] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.934779 31624 leader_election.cc:290] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:20:05.935688 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:05.936131 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ee64b54aa734183bce9b64527425a4b" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:20:05.936237 31894 raft_consensus.cc:3060] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:05.936697 31697 raft_consensus.cc:3055] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:05.936996 31697 raft_consensus.cc:740] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:05.937793 31697 consensus_queue.cc:260] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.938768 31697 raft_consensus.cc:3060] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:05.942381 31894 raft_consensus.cc:2468] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:05.943305 31697 raft_consensus.cc:2468] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:05.943466 31590 leader_election.cc:304] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:20:05.944226 31744 raft_consensus.cc:2804] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:05.944640 31744 raft_consensus.cc:697] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:05.945325 31744 consensus_queue.cc:237] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:05.952476 31445 catalog_manager.cc:5697] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 2 to 3, leader changed from 65e845fdf8a14fefb33640e0e26febef (127.22.48.3) to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.074249 31965 raft_consensus.cc:993] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:06.074767 31744 raft_consensus.cc:1081] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:06.076082 31697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:06.076481 31697 raft_consensus.cc:493] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.076711 31697 raft_consensus.cc:3060] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.081284 31697 raft_consensus.cc:515] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:20:06.082640 31697 leader_election.cc:290] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:06.083654 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:06.083673 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "171e0901a9fd4781abc0e8be58e63d82" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:06.084362 31894 raft_consensus.cc:3060] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.084546 31624 raft_consensus.cc:3055] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.085151 31624 raft_consensus.cc:740] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:06.086148 31624 consensus_queue.cc:260] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:20:06.087280 31624 raft_consensus.cc:3060] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.090512 31894 raft_consensus.cc:2468] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:06.091675 31664 leader_election.cc:304] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:06.092507 31937 raft_consensus.cc:2804] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.092986 31937 raft_consensus.cc:697] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:06.093864 31937 consensus_queue.cc:237] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } }
I20260709 12:20:06.095351 31624 raft_consensus.cc:2468] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:06.102487 31445 catalog_manager.cc:5697] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 1 to 2, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 2 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.111304 31960 raft_consensus.cc:993] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef: : Instructing follower f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:06.111867 31837 raft_consensus.cc:1081] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 1 LEADER]: Signalling peer f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:06.113880 31624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:20:06.114506 31624 raft_consensus.cc:493] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:06.114882 31624 raft_consensus.cc:3060] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.119848 31624 raft_consensus.cc:515] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:06.121215 31624 leader_election.cc:290] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:20:06.122092 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:06.122263 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:20:06.122674 31894 raft_consensus.cc:3060] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.122870 31697 raft_consensus.cc:3055] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:06.123226 31697 raft_consensus.cc:740] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:06.123884 31697 consensus_queue.cc:260] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:06.124810 31697 raft_consensus.cc:3060] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:06.127882 31894 raft_consensus.cc:2468] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 2.
I20260709 12:20:06.129199 31590 leader_election.cc:304] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:20:06.129916 31744 raft_consensus.cc:2804] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:06.130386 31744 raft_consensus.cc:697] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:06.130436 31697 raft_consensus.cc:2468] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 2.
I20260709 12:20:06.131289 31744 consensus_queue.cc:237] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:06.138031 31445 catalog_manager.cc:5697] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 1 to 2, leader changed from 65e845fdf8a14fefb33640e0e26febef (127.22.48.3) to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:06.354842 31697 raft_consensus.cc:1275] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:06.356103 31744 consensus_queue.cc:1048] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:06.363984 31894 raft_consensus.cc:1275] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:06.367743 31965 consensus_queue.cc:1048] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:20:06.508883 31894 raft_consensus.cc:1275] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.510085 31960 consensus_queue.cc:1048] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.518602 31624 raft_consensus.cc:1275] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.520689 31960 consensus_queue.cc:1048] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.676704 31697 raft_consensus.cc:1275] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.677939 31965 consensus_queue.cc:1048] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:06.685815 31894 raft_consensus.cc:1275] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:06.687292 31965 consensus_queue.cc:1048] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:06.761430 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:06.877265 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:06.884814 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:06.885361 31624 raft_consensus.cc:606] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:06.888283 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
mode: GRACEFUL
new_leader_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:20:06.888969 31697 raft_consensus.cc:606] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Received request to transfer leadership to TS f0f90650f89842899b446002404b9e9b
I20260709 12:20:06.891829 31625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:06.892473 31625 raft_consensus.cc:606] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:06.893554 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:06.894055 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:06.894632 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:07.000942 31981 raft_consensus.cc:993] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:07.001461 31965 raft_consensus.cc:1081] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:07.003131 31697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:07.003630 31697 raft_consensus.cc:493] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.003908 31697 raft_consensus.cc:3060] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.008409 31697 raft_consensus.cc:515] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:07.009824 31697 leader_election.cc:290] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:07.010784 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:07.011080 31625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:07.011473 31894 raft_consensus.cc:3060] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.011732 31625 raft_consensus.cc:3055] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:07.012140 31625 raft_consensus.cc:740] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:07.012881 31625 consensus_queue.cc:260] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:07.014022 31625 raft_consensus.cc:3060] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:07.016882 31894 raft_consensus.cc:2468] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:07.017962 31664 leader_election.cc:304] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:07.018989 31960 raft_consensus.cc:2804] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:07.019729 31960 raft_consensus.cc:697] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:07.020596 31960 consensus_queue.cc:237] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:07.021163 31625 raft_consensus.cc:2468] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:07.029232 31445 catalog_manager.cc:5697] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 1 to 2, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 2 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.250563 31974 raft_consensus.cc:993] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:07.251271 31981 raft_consensus.cc:1081] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:07.253149 31697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:07.253580 31697 raft_consensus.cc:493] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.253865 31697 raft_consensus.cc:3060] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.259371 31697 raft_consensus.cc:515] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:07.260852 31697 leader_election.cc:290] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 3 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:07.261684 31894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:07.261971 31625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04b8c1e6457b471ea499cd1905f55926" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:07.262442 31894 raft_consensus.cc:3060] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.262599 31625 raft_consensus.cc:3055] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:07.263047 31625 raft_consensus.cc:740] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:07.264003 31625 consensus_queue.cc:260] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:07.265388 31625 raft_consensus.cc:3060] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.270501 31894 raft_consensus.cc:2468] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 3.
I20260709 12:20:07.271955 31664 leader_election.cc:304] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:07.272888 31960 raft_consensus.cc:2804] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:07.273289 31960 raft_consensus.cc:697] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 3 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:07.273331 31625 raft_consensus.cc:2468] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 3.
I20260709 12:20:07.274155 31960 consensus_queue.cc:237] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:07.281255 31445 catalog_manager.cc:5697] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 2 to 3, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 3 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:07.419180 31937 raft_consensus.cc:993] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef: : Instructing follower f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:07.419756 31960 raft_consensus.cc:1081] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Signalling peer f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:07.421128 31625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:20:07.421554 31625 raft_consensus.cc:493] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.421802 31625 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.426769 31625 raft_consensus.cc:515] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:07.428655 31625 leader_election.cc:290] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:20:07.429370 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:07.430071 31895 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.430341 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:20:07.430985 31697 raft_consensus.cc:3055] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:07.431234 31697 raft_consensus.cc:740] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:07.431973 31697 consensus_queue.cc:260] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:07.432900 31697 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:07.435130 31895 raft_consensus.cc:2468] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:07.436219 31590 leader_election.cc:304] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:20:07.437060 31981 raft_consensus.cc:2804] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:07.437497 31981 raft_consensus.cc:697] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:07.438306 31697 raft_consensus.cc:2468] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:07.438239 31981 consensus_queue.cc:237] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:07.445482 31445 catalog_manager.cc:5697] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 2 to 3, leader changed from 65e845fdf8a14fefb33640e0e26febef (127.22.48.3) to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:07.488726 31895 raft_consensus.cc:1275] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.490098 31960 consensus_queue.cc:1048] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.500566 31625 raft_consensus.cc:1275] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:07.502902 31992 consensus_queue.cc:1048] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.675511 31624 raft_consensus.cc:1275] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:07.676828 31937 consensus_queue.cc:1048] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:07.687493 31895 raft_consensus.cc:1275] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:07.689108 31960 consensus_queue.cc:1048] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:07.762390 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:07.846356 31895 raft_consensus.cc:1275] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:07.847699 31981 consensus_queue.cc:1048] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:07.857439 31697 raft_consensus.cc:1275] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:07.858980 31981 consensus_queue.cc:1048] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:07.901688 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:07.908957 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
mode: GRACEFUL
new_leader_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:20:07.909519 31697 raft_consensus.cc:606] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Received request to transfer leadership to TS f0f90650f89842899b446002404b9e9b
I20260709 12:20:07.912132 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
mode: GRACEFUL
new_leader_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:20:07.912675 31697 raft_consensus.cc:606] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Received request to transfer leadership to TS f0f90650f89842899b446002404b9e9b
I20260709 12:20:07.915336 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:07.915781 31624 raft_consensus.cc:606] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:07.916916 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:07.917342 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:07.917856 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.088263 31981 raft_consensus.cc:993] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:08.088812 31999 raft_consensus.cc:1081] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:08.090458 31697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:08.090893 31697 raft_consensus.cc:493] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:08.091173 31697 raft_consensus.cc:3060] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:08.095518 31697 raft_consensus.cc:515] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.097788 31697 leader_election.cc:290] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:08.098716 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:08.099231 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78eb714c784c42f7a0f990ca4723eca7" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:08.099462 31895 raft_consensus.cc:3060] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:08.099846 31624 raft_consensus.cc:3055] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:08.100183 31624 raft_consensus.cc:740] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:08.100943 31624 consensus_queue.cc:260] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.102186 31624 raft_consensus.cc:3060] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:08.106719 31895 raft_consensus.cc:2468] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:08.107056 31624 raft_consensus.cc:2468] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 2.
I20260709 12:20:08.107884 31664 leader_election.cc:304] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:08.108830 31960 raft_consensus.cc:2804] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:08.109323 31960 raft_consensus.cc:697] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:08.110399 31960 consensus_queue.cc:237] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.118870 31445 catalog_manager.cc:5697] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 1 to 2, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 2 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:08.411422 32002 raft_consensus.cc:993] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef: : Instructing follower f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:08.412065 31960 raft_consensus.cc:1081] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Signalling peer f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:08.413563 31624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:20:08.414021 31624 raft_consensus.cc:493] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:08.414281 31624 raft_consensus.cc:3060] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.418816 31624 raft_consensus.cc:515] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.420187 31624 leader_election.cc:290] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:20:08.421130 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:08.421329 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "626ce3ca661b4f73a46f6611c3c8708a" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:20:08.421700 31895 raft_consensus.cc:3060] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.421914 31697 raft_consensus.cc:3055] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:08.422247 31697 raft_consensus.cc:740] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:08.422907 31697 consensus_queue.cc:260] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.423806 31697 raft_consensus.cc:3060] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.427016 31895 raft_consensus.cc:2468] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:08.428121 31590 leader_election.cc:304] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:20:08.429232 31999 raft_consensus.cc:2804] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.429400 31697 raft_consensus.cc:2468] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:08.429750 31999 raft_consensus.cc:697] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:08.430812 31999 consensus_queue.cc:237] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.437708 31445 catalog_manager.cc:5697] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 2 to 3, leader changed from 65e845fdf8a14fefb33640e0e26febef (127.22.48.3) to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.472886 32002 raft_consensus.cc:993] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef: : Instructing follower f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:08.473387 31960 raft_consensus.cc:1081] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Signalling peer f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:08.474879 31624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:20:08.475332 31624 raft_consensus.cc:493] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:08.475603 31624 raft_consensus.cc:3060] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.479934 31624 raft_consensus.cc:515] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.481300 31624 leader_election.cc:290] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:20:08.482450 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:08.482805 31697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13e889a1791e4c89b6f3ea6ea97c4b32" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:20:08.483129 31895 raft_consensus.cc:3060] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.483367 31697 raft_consensus.cc:3055] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:08.483713 31697 raft_consensus.cc:740] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:08.484478 31697 consensus_queue.cc:260] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.485631 31697 raft_consensus.cc:3060] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:08.490868 31895 raft_consensus.cc:2468] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:08.492131 31590 leader_election.cc:304] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:20:08.492182 31697 raft_consensus.cc:2468] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:08.492985 32008 raft_consensus.cc:2804] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:08.493542 32008 raft_consensus.cc:697] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:08.494448 32008 consensus_queue.cc:237] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.495391 31895 raft_consensus.cc:1275] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:08.496667 31960 consensus_queue.cc:1048] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:08.502806 31445 catalog_manager.cc:5697] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 2 to 3, leader changed from 65e845fdf8a14fefb33640e0e26febef (127.22.48.3) to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.520682 31624 raft_consensus.cc:1275] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:08.521899 31992 consensus_queue.cc:1048] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:20:08.763383 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:08.875581 31697 raft_consensus.cc:1275] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:08.876816 32008 consensus_queue.cc:1048] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.884429 31895 raft_consensus.cc:1275] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:08.885802 31999 consensus_queue.cc:1048] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:08.923969 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.932083 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:08.932618 31624 raft_consensus.cc:606] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:08.935151 31697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
mode: GRACEFUL
new_leader_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:56984
I20260709 12:20:08.935638 31697 raft_consensus.cc:606] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Received request to transfer leadership to TS f0f90650f89842899b446002404b9e9b
I20260709 12:20:08.938158 31981 raft_consensus.cc:993] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:08.938643 31999 raft_consensus.cc:1081] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:08.939167 31624 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
mode: GRACEFUL
new_leader_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:43818
I20260709 12:20:08.939778 31624 raft_consensus.cc:606] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Received request to transfer leadership to TS 65e845fdf8a14fefb33640e0e26febef
I20260709 12:20:08.940119 31699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:08.940626 31699 raft_consensus.cc:493] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:08.940815 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:20:08.941033 31699 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.941488 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:08.942219 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.948266 31699 raft_consensus.cc:515] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.950251 31699 leader_election.cc:290] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 4 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:08.951081 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:08.951282 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0b870c0a2fbd4eccb1f82a10fd91ecd2" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:08.951706 31895 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.951792 31624 raft_consensus.cc:3055] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:20:08.952186 31624 raft_consensus.cc:740] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:08.952931 31624 consensus_queue.cc:260] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.954094 31624 raft_consensus.cc:3060] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:20:08.958647 31895 raft_consensus.cc:2468] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 4.
I20260709 12:20:08.959878 31664 leader_election.cc:304] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:08.960668 31992 raft_consensus.cc:2804] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:20:08.960842 31624 raft_consensus.cc:2468] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 4.
I20260709 12:20:08.961165 31992 raft_consensus.cc:697] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 4 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:08.962066 31992 consensus_queue.cc:237] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:08.968433 31445 catalog_manager.cc:5697] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 3 to 4, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 4 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:09.000473 31699 raft_consensus.cc:1275] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:09.001705 31999 consensus_queue.cc:1048] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.010219 31895 raft_consensus.cc:1275] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:09.018002 32008 consensus_queue.cc:1048] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.041990 32002 raft_consensus.cc:993] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef: : Instructing follower f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:09.042508 31992 raft_consensus.cc:1081] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Signalling peer f0f90650f89842899b446002404b9e9b to start an election
I20260709 12:20:09.044044 31624 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843"
dest_uuid: "f0f90650f89842899b446002404b9e9b"
 from {username='slave'} at 127.0.0.1:43800
I20260709 12:20:09.044516 31624 raft_consensus.cc:493] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:09.044786 31624 raft_consensus.cc:3060] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.049316 31624 raft_consensus.cc:515] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:09.050807 31624 leader_election.cc:290] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), 65e845fdf8a14fefb33640e0e26febef (127.22.48.3:33215)
I20260709 12:20:09.051676 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:09.051872 31699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3be5a22de4d490b92ffa8e19f275843" candidate_uuid: "f0f90650f89842899b446002404b9e9b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
I20260709 12:20:09.052413 31699 raft_consensus.cc:3055] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:09.052392 31895 raft_consensus.cc:3060] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.052858 31699 raft_consensus.cc:740] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:09.053583 31699 consensus_queue.cc:260] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:09.054522 31699 raft_consensus.cc:3060] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.057922 31895 raft_consensus.cc:2468] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:09.058995 31590 leader_election.cc:304] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, f0f90650f89842899b446002404b9e9b; no voters: 
I20260709 12:20:09.059777 32008 raft_consensus.cc:2804] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:09.060222 32008 raft_consensus.cc:697] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Becoming Leader. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:09.060566 31699 raft_consensus.cc:2468] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0f90650f89842899b446002404b9e9b in term 3.
I20260709 12:20:09.061004 32008 consensus_queue.cc:237] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:09.068024 31447 catalog_manager.cc:5697] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b reported cstate change: term changed from 2 to 3, leader changed from 65e845fdf8a14fefb33640e0e26febef (127.22.48.3) to f0f90650f89842899b446002404b9e9b (127.22.48.2). New cstate: current_term: 3 leader_uuid: "f0f90650f89842899b446002404b9e9b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:09.352953 31895 raft_consensus.cc:1275] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 4 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:09.354436 31992 consensus_queue.cc:1048] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:09.361404 31624 raft_consensus.cc:1275] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 4 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:20:09.362900 31960 consensus_queue.cc:1048] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:09.370814 31981 raft_consensus.cc:993] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b: : Instructing follower 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:09.371315 31981 raft_consensus.cc:1081] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Signalling peer 65e845fdf8a14fefb33640e0e26febef to start an election
I20260709 12:20:09.372790 31699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb"
dest_uuid: "65e845fdf8a14fefb33640e0e26febef"
 from {username='slave'} at 127.0.0.1:33744
I20260709 12:20:09.373234 31699 raft_consensus.cc:493] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:09.373515 31699 raft_consensus.cc:3060] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.379241 31699 raft_consensus.cc:515] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:09.380810 31699 leader_election.cc:290] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 3 election: Requested vote from peers 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317), f0f90650f89842899b446002404b9e9b (127.22.48.2:35529)
I20260709 12:20:09.381672 31624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f0f90650f89842899b446002404b9e9b"
I20260709 12:20:09.381603 31895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb7ad8ae89f6455bba4a2d690869aacb" candidate_uuid: "65e845fdf8a14fefb33640e0e26febef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "169171504d4b466d9a5748e1eb660780"
I20260709 12:20:09.382426 31624 raft_consensus.cc:3055] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:09.382457 31895 raft_consensus.cc:3060] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.382892 31624 raft_consensus.cc:740] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f0f90650f89842899b446002404b9e9b, State: Running, Role: LEADER
I20260709 12:20:09.383657 31624 consensus_queue.cc:260] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:09.384770 31624 raft_consensus.cc:3060] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:09.389214 31895 raft_consensus.cc:2468] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 3.
I20260709 12:20:09.390295 31664 leader_election.cc:304] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 169171504d4b466d9a5748e1eb660780, 65e845fdf8a14fefb33640e0e26febef; no voters: 
I20260709 12:20:09.390993 31624 raft_consensus.cc:2468] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e845fdf8a14fefb33640e0e26febef in term 3.
I20260709 12:20:09.391040 31960 raft_consensus.cc:2804] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:09.391724 31960 raft_consensus.cc:697] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 3 LEADER]: Becoming Leader. State: Replica: 65e845fdf8a14fefb33640e0e26febef, State: Running, Role: LEADER
I20260709 12:20:09.392417 31960 consensus_queue.cc:237] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } }
I20260709 12:20:09.400030 31447 catalog_manager.cc:5697] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef reported cstate change: term changed from 2 to 3, leader changed from f0f90650f89842899b446002404b9e9b (127.22.48.2) to 65e845fdf8a14fefb33640e0e26febef (127.22.48.3). New cstate: current_term: 3 leader_uuid: "65e845fdf8a14fefb33640e0e26febef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:09.602161 31895 raft_consensus.cc:1275] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:09.603515 32008 consensus_queue.cc:1048] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.609042 31699 raft_consensus.cc:1275] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Refusing update from remote peer f0f90650f89842899b446002404b9e9b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:09.610710 31999 consensus_queue.cc:1048] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e845fdf8a14fefb33640e0e26febef" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:20:09.764389 31496 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:20:09.821652 31624 raft_consensus.cc:1275] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:09.823042 31960 consensus_queue.cc:1048] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0f90650f89842899b446002404b9e9b" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:09.832077 31895 raft_consensus.cc:1275] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Refusing update from remote peer 65e845fdf8a14fefb33640e0e26febef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:09.833791 31992 consensus_queue.cc:1048] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [LEADER]: Connected to new peer: Peer: permanent_uuid: "169171504d4b466d9a5748e1eb660780" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 43317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:09.952455 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:09.982648 22720 tablet_server.cc:179] TabletServer@127.22.48.1:43317 shutting down...
I20260709 12:20:10.000934 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:10.001808 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.002498 22720 raft_consensus.cc:2243] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.002983 22720 raft_consensus.cc:2272] T f3be5a22de4d490b92ffa8e19f275843 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.005865 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.006522 22720 raft_consensus.cc:2243] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.006961 22720 raft_consensus.cc:2272] T 78eb714c784c42f7a0f990ca4723eca7 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.008785 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.009629 22720 raft_consensus.cc:2243] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.010162 22720 raft_consensus.cc:2272] T 626ce3ca661b4f73a46f6611c3c8708a P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.012501 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.012995 22720 raft_consensus.cc:2243] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.013475 22720 raft_consensus.cc:2272] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.015214 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.015676 22720 raft_consensus.cc:2243] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.016185 22720 raft_consensus.cc:2272] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 169171504d4b466d9a5748e1eb660780 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:10.019042 31590 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 6 similar messages]
I20260709 12:20:10.019090 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.019972 22720 raft_consensus.cc:2243] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.020439 22720 raft_consensus.cc:2272] T 62130437a41f440db726b1f8bc017671 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.022527 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.023041 22720 raft_consensus.cc:2243] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:10.023074 31590 consensus_peers.cc:597] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:10.023545 22720 raft_consensus.cc:2272] T 8ee64b54aa734183bce9b64527425a4b P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.025370 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.025887 22720 raft_consensus.cc:2243] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.026376 22720 raft_consensus.cc:2272] T fb7ad8ae89f6455bba4a2d690869aacb P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.028708 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.029217 22720 raft_consensus.cc:2243] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.029625 22720 raft_consensus.cc:2272] T 04b8c1e6457b471ea499cd1905f55926 P 169171504d4b466d9a5748e1eb660780 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.031409 22720 tablet_replica.cc:333] stopping tablet replica
I20260709 12:20:10.031857 22720 raft_consensus.cc:2243] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.032267 22720 raft_consensus.cc:2272] T 171e0901a9fd4781abc0e8be58e63d82 P 169171504d4b466d9a5748e1eb660780 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:10.035476 31664 consensus_peers.cc:597] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:10.059978 22720 tablet_server.cc:196] TabletServer@127.22.48.1:43317 shutdown complete.
I20260709 12:20:10.078353 22720 tablet_server.cc:179] TabletServer@127.22.48.2:0 shutting down...
I20260709 12:20:10.101222 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:10.101969 22720 tablet_replica.cc:333] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.102696 22720 raft_consensus.cc:2243] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.103107 22720 raft_consensus.cc:2272] T 171e0901a9fd4781abc0e8be58e63d82 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.105142 22720 tablet_replica.cc:333] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.105662 22720 raft_consensus.cc:2243] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.106009 22720 raft_consensus.cc:2272] T 78eb714c784c42f7a0f990ca4723eca7 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.108232 22720 tablet_replica.cc:333] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.108748 22720 raft_consensus.cc:2243] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.109158 22720 raft_consensus.cc:2272] T 04b8c1e6457b471ea499cd1905f55926 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.111450 22720 tablet_replica.cc:333] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.112003 22720 raft_consensus.cc:2243] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.112783 22720 raft_consensus.cc:2272] T 8ee64b54aa734183bce9b64527425a4b P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:10.113843 31664 consensus_peers.cc:597] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef -> Peer 169171504d4b466d9a5748e1eb660780 (127.22.48.1:43317): Couldn't send request to peer 169171504d4b466d9a5748e1eb660780. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:43317: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:10.115713 22720 tablet_replica.cc:333] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.116238 22720 raft_consensus.cc:2243] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.116593 22720 raft_consensus.cc:2272] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P f0f90650f89842899b446002404b9e9b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.118762 22720 tablet_replica.cc:333] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.119243 22720 raft_consensus.cc:2243] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.119590 22720 raft_consensus.cc:2272] T 62130437a41f440db726b1f8bc017671 P f0f90650f89842899b446002404b9e9b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.121490 22720 tablet_replica.cc:333] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.121960 22720 raft_consensus.cc:2243] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.122701 22720 raft_consensus.cc:2272] T 13e889a1791e4c89b6f3ea6ea97c4b32 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.124507 22720 tablet_replica.cc:333] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.124955 22720 raft_consensus.cc:2243] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.125598 22720 raft_consensus.cc:2272] T 626ce3ca661b4f73a46f6611c3c8708a P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.127535 22720 tablet_replica.cc:333] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.127977 22720 raft_consensus.cc:2243] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.128674 22720 raft_consensus.cc:2272] T f3be5a22de4d490b92ffa8e19f275843 P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.131002 22720 tablet_replica.cc:333] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b: stopping tablet replica
I20260709 12:20:10.131440 22720 raft_consensus.cc:2243] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.131778 22720 raft_consensus.cc:2272] T fb7ad8ae89f6455bba4a2d690869aacb P f0f90650f89842899b446002404b9e9b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.162935 22720 tablet_server.cc:196] TabletServer@127.22.48.2:0 shutdown complete.
I20260709 12:20:10.188503 22720 tablet_server.cc:179] TabletServer@127.22.48.3:0 shutting down...
I20260709 12:20:10.215126 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:10.215886 22720 tablet_replica.cc:333] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.216910 22720 raft_consensus.cc:2243] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.217993 22720 raft_consensus.cc:2272] T fb7ad8ae89f6455bba4a2d690869aacb P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.220369 22720 tablet_replica.cc:333] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.220870 22720 raft_consensus.cc:2243] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.221565 22720 raft_consensus.cc:2272] T 78eb714c784c42f7a0f990ca4723eca7 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.223994 22720 tablet_replica.cc:333] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.224475 22720 raft_consensus.cc:2243] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.224857 22720 raft_consensus.cc:2272] T f3be5a22de4d490b92ffa8e19f275843 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.228062 22720 tablet_replica.cc:333] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.228633 22720 raft_consensus.cc:2243] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.229362 22720 raft_consensus.cc:2272] T 0b870c0a2fbd4eccb1f82a10fd91ecd2 P 65e845fdf8a14fefb33640e0e26febef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.231627 22720 tablet_replica.cc:333] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.232157 22720 raft_consensus.cc:2243] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.232525 22720 raft_consensus.cc:2272] T 13e889a1791e4c89b6f3ea6ea97c4b32 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.234555 22720 tablet_replica.cc:333] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.235050 22720 raft_consensus.cc:2243] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.235402 22720 raft_consensus.cc:2272] T 626ce3ca661b4f73a46f6611c3c8708a P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.237282 22720 tablet_replica.cc:333] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.237802 22720 raft_consensus.cc:2243] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.238622 22720 raft_consensus.cc:2272] T 62130437a41f440db726b1f8bc017671 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.240670 22720 tablet_replica.cc:333] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.241169 22720 raft_consensus.cc:2243] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:10.241570 22720 raft_consensus.cc:2272] T 8ee64b54aa734183bce9b64527425a4b P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.244226 22720 tablet_replica.cc:333] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.245157 22720 raft_consensus.cc:2243] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.246263 22720 raft_consensus.cc:2272] T 04b8c1e6457b471ea499cd1905f55926 P 65e845fdf8a14fefb33640e0e26febef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.248871 22720 tablet_replica.cc:333] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef: stopping tablet replica
I20260709 12:20:10.249366 22720 raft_consensus.cc:2243] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.250098 22720 raft_consensus.cc:2272] T 171e0901a9fd4781abc0e8be58e63d82 P 65e845fdf8a14fefb33640e0e26febef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.281558 22720 tablet_server.cc:196] TabletServer@127.22.48.3:0 shutdown complete.
I20260709 12:20:10.304081 22720 master.cc:562] Master@127.22.48.62:33323 shutting down...
I20260709 12:20:10.329849 22720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:10.330453 22720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:10.330808 22720 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1f3de4f9dbfe413a96db6fce61840b41: stopping tablet replica
I20260709 12:20:10.352111 22720 master.cc:584] Master@127.22.48.62:33323 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12778 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:20:10.396716 22720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.48.62:41923
I20260709 12:20:10.397799 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:10.403375 32034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.403420 32035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.404932 32037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:10.407320 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:10.408217 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:10.408401 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:10.408525 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599610408513 us; error 0 us; skew 500 ppm
I20260709 12:20:10.409061 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:10.411347 22720 webserver.cc:533] Webserver started at http://127.22.48.62:35167/ using document root <none> and password file <none>
I20260709 12:20:10.411825 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:10.411980 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:10.412204 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:10.413287 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/master-0-root/instance:
uuid: "e49ccf4a99d740da81a10b8b35eee9eb"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-044g"
I20260709 12:20:10.418401 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:20:10.422680 32042 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.423590 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:20:10.423931 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/master-0-root
uuid: "e49ccf4a99d740da81a10b8b35eee9eb"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-044g"
I20260709 12:20:10.424252 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:10.453420 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:10.454579 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:10.491959 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.62:41923
I20260709 12:20:10.492098 32093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.62:41923 every 8 connection(s)
I20260709 12:20:10.495903 32094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:10.507853 32094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb: Bootstrap starting.
I20260709 12:20:10.513119 32094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:10.517644 32094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb: No bootstrap required, opened a new log
I20260709 12:20:10.521149 32094 raft_consensus.cc:359] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49ccf4a99d740da81a10b8b35eee9eb" member_type: VOTER }
I20260709 12:20:10.521764 32094 raft_consensus.cc:385] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:10.522091 32094 raft_consensus.cc:740] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e49ccf4a99d740da81a10b8b35eee9eb, State: Initialized, Role: FOLLOWER
I20260709 12:20:10.522892 32094 consensus_queue.cc:260] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49ccf4a99d740da81a10b8b35eee9eb" member_type: VOTER }
I20260709 12:20:10.523595 32094 raft_consensus.cc:399] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:10.523917 32094 raft_consensus.cc:493] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:10.524302 32094 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:10.530032 32094 raft_consensus.cc:515] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49ccf4a99d740da81a10b8b35eee9eb" member_type: VOTER }
I20260709 12:20:10.530622 32094 leader_election.cc:304] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e49ccf4a99d740da81a10b8b35eee9eb; no voters: 
I20260709 12:20:10.531706 32094 leader_election.cc:290] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:10.532147 32097 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:10.533474 32097 raft_consensus.cc:697] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 1 LEADER]: Becoming Leader. State: Replica: e49ccf4a99d740da81a10b8b35eee9eb, State: Running, Role: LEADER
I20260709 12:20:10.534142 32097 consensus_queue.cc:237] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49ccf4a99d740da81a10b8b35eee9eb" member_type: VOTER }
I20260709 12:20:10.534914 32094 sys_catalog.cc:565] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:10.539355 32099 sys_catalog.cc:455] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader e49ccf4a99d740da81a10b8b35eee9eb. Latest consensus state: current_term: 1 leader_uuid: "e49ccf4a99d740da81a10b8b35eee9eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49ccf4a99d740da81a10b8b35eee9eb" member_type: VOTER } }
I20260709 12:20:10.540176 32099 sys_catalog.cc:458] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:10.542095 32098 sys_catalog.cc:455] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e49ccf4a99d740da81a10b8b35eee9eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e49ccf4a99d740da81a10b8b35eee9eb" member_type: VOTER } }
I20260709 12:20:10.542939 32098 sys_catalog.cc:458] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:10.547587 32105 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:10.556094 32105 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:10.557085 22720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:10.565151 32105 catalog_manager.cc:1383] Generated new cluster ID: 772779e3ed214600b19243f59de9bc92
I20260709 12:20:10.565455 32105 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:10.592579 32105 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:10.593864 32105 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:10.610795 32105 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb: Generated new TSK 0
I20260709 12:20:10.611418 32105 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:10.623528 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:10.629704 32115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.630789 32116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.632182 32118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:10.633098 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:10.634124 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:10.634379 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:10.634584 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599610634559 us; error 0 us; skew 500 ppm
I20260709 12:20:10.635138 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:10.637589 22720 webserver.cc:533] Webserver started at http://127.22.48.1:42433/ using document root <none> and password file <none>
I20260709 12:20:10.638105 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:10.638332 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:10.638612 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:10.639685 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-0-root/instance:
uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-044g"
I20260709 12:20:10.644414 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:10.647914 32123 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.648818 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:20:10.649073 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-044g"
I20260709 12:20:10.649319 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:10.660634 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:10.661842 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:10.663527 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:10.665865 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:10.666085 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.666399 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:10.666577 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.710824 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:33273
I20260709 12:20:10.711040 32185 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:33273 every 8 connection(s)
I20260709 12:20:10.717060 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:10.725869 32190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.726840 32191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:10.732578 32186 heartbeater.cc:344] Connected to a master server at 127.22.48.62:41923
I20260709 12:20:10.733174 32186 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:10.734345 32186 heartbeater.cc:507] Master 127.22.48.62:41923 requested a full tablet report, sending...
I20260709 12:20:10.735140 22720 server_base.cc:1061] running on GCE node
W20260709 12:20:10.735203 32193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:10.737134 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:10.737339 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:10.737488 32059 ts_manager.cc:194] Registered new tserver with Master: 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273)
I20260709 12:20:10.737564 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599610737531 us; error 0 us; skew 500 ppm
I20260709 12:20:10.738546 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:10.739708 32059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40190
I20260709 12:20:10.741246 22720 webserver.cc:533] Webserver started at http://127.22.48.2:41667/ using document root <none> and password file <none>
I20260709 12:20:10.741911 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:10.742172 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:10.742515 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:10.743566 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-1-root/instance:
uuid: "7541f676c605400aad64772bcbae4d58"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-044g"
I20260709 12:20:10.748842 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:20:10.753509 32198 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.754689 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:20:10.755060 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-1-root
uuid: "7541f676c605400aad64772bcbae4d58"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-044g"
I20260709 12:20:10.755549 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:10.782085 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:10.783345 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:10.784857 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:10.787124 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:10.787354 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.787600 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:10.787781 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.827940 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.2:35465
I20260709 12:20:10.828053 32260 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.2:35465 every 8 connection(s)
I20260709 12:20:10.832688 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:10.839926 32264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:10.843315 32265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:10.847957 22720 server_base.cc:1061] running on GCE node
W20260709 12:20:10.848210 32267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:10.849109 32261 heartbeater.cc:344] Connected to a master server at 127.22.48.62:41923
I20260709 12:20:10.849274 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:20:10.849506 32261 heartbeater.cc:461] Registering TS with master...
W20260709 12:20:10.849601 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:10.849937 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599610849918 us; error 0 us; skew 500 ppm
I20260709 12:20:10.850507 32261 heartbeater.cc:507] Master 127.22.48.62:41923 requested a full tablet report, sending...
I20260709 12:20:10.850627 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:10.852747 32059 ts_manager.cc:194] Registered new tserver with Master: 7541f676c605400aad64772bcbae4d58 (127.22.48.2:35465)
I20260709 12:20:10.853520 22720 webserver.cc:533] Webserver started at http://127.22.48.3:38469/ using document root <none> and password file <none>
I20260709 12:20:10.854084 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:10.854276 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:10.854166 32059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40200
I20260709 12:20:10.854715 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:10.856094 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-2-root/instance:
uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-044g"
I20260709 12:20:10.860606 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:10.863967 32272 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.864750 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:20:10.865063 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-2-root
uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
format_stamp: "Formatted at 2026-07-09 12:20:10 on dist-test-slave-044g"
I20260709 12:20:10.865329 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599314612061-22720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:10.878865 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:10.880025 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:10.881484 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:10.883733 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:10.883957 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.884193 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:10.884363 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:10.924264 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.3:43825
I20260709 12:20:10.924384 32334 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.3:43825 every 8 connection(s)
I20260709 12:20:10.938988 32335 heartbeater.cc:344] Connected to a master server at 127.22.48.62:41923
I20260709 12:20:10.939416 32335 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:10.940191 32335 heartbeater.cc:507] Master 127.22.48.62:41923 requested a full tablet report, sending...
I20260709 12:20:10.942185 32059 ts_manager.cc:194] Registered new tserver with Master: 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:10.943189 22720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015757011s
I20260709 12:20:10.943728 32059 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:40210
I20260709 12:20:10.970749 32059 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40224:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:10.972870 32059 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:11.016338 32151 tablet_service.cc:1511] Processing CreateTablet for tablet ee7e88cde63240839f584266463b29b4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4859dd910f4d4eb3b51ef68271858fc1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:11.016688 32150 tablet_service.cc:1511] Processing CreateTablet for tablet 42c077fd526446daa00944d40e1bb014 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4859dd910f4d4eb3b51ef68271858fc1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:11.017845 32151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee7e88cde63240839f584266463b29b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.018702 32150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42c077fd526446daa00944d40e1bb014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.023686 32226 tablet_service.cc:1511] Processing CreateTablet for tablet ee7e88cde63240839f584266463b29b4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4859dd910f4d4eb3b51ef68271858fc1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:11.023969 32225 tablet_service.cc:1511] Processing CreateTablet for tablet 42c077fd526446daa00944d40e1bb014 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4859dd910f4d4eb3b51ef68271858fc1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:11.025290 32226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee7e88cde63240839f584266463b29b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.026793 32225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42c077fd526446daa00944d40e1bb014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.030876 32300 tablet_service.cc:1511] Processing CreateTablet for tablet ee7e88cde63240839f584266463b29b4 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4859dd910f4d4eb3b51ef68271858fc1]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:11.031189 32299 tablet_service.cc:1511] Processing CreateTablet for tablet 42c077fd526446daa00944d40e1bb014 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=4859dd910f4d4eb3b51ef68271858fc1]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:11.032265 32300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee7e88cde63240839f584266463b29b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.032835 32299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42c077fd526446daa00944d40e1bb014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.043908 32350 tablet_bootstrap.cc:492] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Bootstrap starting.
I20260709 12:20:11.060722 32351 tablet_bootstrap.cc:492] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58: Bootstrap starting.
I20260709 12:20:11.063706 32352 tablet_bootstrap.cc:492] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Bootstrap starting.
I20260709 12:20:11.064833 32350 tablet_bootstrap.cc:654] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.068380 32351 tablet_bootstrap.cc:654] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.073788 32350 tablet_bootstrap.cc:492] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: No bootstrap required, opened a new log
I20260709 12:20:11.073925 32352 tablet_bootstrap.cc:654] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.073935 32351 tablet_bootstrap.cc:492] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58: No bootstrap required, opened a new log
I20260709 12:20:11.074328 32350 ts_tablet_manager.cc:1403] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.008s
I20260709 12:20:11.074679 32351 ts_tablet_manager.cc:1403] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58: Time spent bootstrapping tablet: real 0.014s	user 0.002s	sys 0.011s
I20260709 12:20:11.077864 32350 raft_consensus.cc:359] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.078920 32350 raft_consensus.cc:385] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.079304 32350 raft_consensus.cc:740] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.079223 32351 raft_consensus.cc:359] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.080078 32351 raft_consensus.cc:385] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.080395 32351 raft_consensus.cc:740] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7541f676c605400aad64772bcbae4d58, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.080459 32350 consensus_queue.cc:260] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.081130 32351 consensus_queue.cc:260] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.083550 32261 heartbeater.cc:499] Master 127.22.48.62:41923 was elected leader, sending a full tablet report...
I20260709 12:20:11.084097 32351 ts_tablet_manager.cc:1434] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 12:20:11.085155 32351 tablet_bootstrap.cc:492] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58: Bootstrap starting.
I20260709 12:20:11.086414 32352 tablet_bootstrap.cc:492] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: No bootstrap required, opened a new log
I20260709 12:20:11.087150 32352 ts_tablet_manager.cc:1403] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.007s
I20260709 12:20:11.091897 32351 tablet_bootstrap.cc:654] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.091531 32352 raft_consensus.cc:359] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.092623 32352 raft_consensus.cc:385] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.093104 32352 raft_consensus.cc:740] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23aac1d65c7a4cfe907b7ba16ecf9a5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.094475 32352 consensus_queue.cc:260] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.104399 32335 heartbeater.cc:499] Master 127.22.48.62:41923 was elected leader, sending a full tablet report...
I20260709 12:20:11.107345 32186 heartbeater.cc:499] Master 127.22.48.62:41923 was elected leader, sending a full tablet report...
I20260709 12:20:11.107446 32352 ts_tablet_manager.cc:1434] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.007s
I20260709 12:20:11.107625 32350 ts_tablet_manager.cc:1434] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.025s
I20260709 12:20:11.108958 32352 tablet_bootstrap.cc:492] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Bootstrap starting.
I20260709 12:20:11.109108 32350 tablet_bootstrap.cc:492] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Bootstrap starting.
I20260709 12:20:11.117018 32352 tablet_bootstrap.cc:654] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.118925 32351 tablet_bootstrap.cc:492] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58: No bootstrap required, opened a new log
I20260709 12:20:11.119518 32351 ts_tablet_manager.cc:1403] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.004s
I20260709 12:20:11.123008 32350 tablet_bootstrap.cc:654] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.123673 32351 raft_consensus.cc:359] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.124801 32351 raft_consensus.cc:385] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.125342 32351 raft_consensus.cc:740] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7541f676c605400aad64772bcbae4d58, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.126789 32351 consensus_queue.cc:260] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.129891 32350 tablet_bootstrap.cc:492] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: No bootstrap required, opened a new log
I20260709 12:20:11.130487 32350 ts_tablet_manager.cc:1403] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.007s
I20260709 12:20:11.131466 32352 tablet_bootstrap.cc:492] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: No bootstrap required, opened a new log
I20260709 12:20:11.132186 32352 ts_tablet_manager.cc:1403] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 12:20:11.132186 32351 ts_tablet_manager.cc:1434] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 12:20:11.133545 32350 raft_consensus.cc:359] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.134330 32350 raft_consensus.cc:385] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.134617 32350 raft_consensus.cc:740] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.135403 32350 consensus_queue.cc:260] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.135514 32352 raft_consensus.cc:359] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.136494 32352 raft_consensus.cc:385] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.136900 32352 raft_consensus.cc:740] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23aac1d65c7a4cfe907b7ba16ecf9a5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.137528 32350 ts_tablet_manager.cc:1434] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:20:11.137668 32352 consensus_queue.cc:260] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.140065 32352 ts_tablet_manager.cc:1434] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:11.163520 32359 raft_consensus.cc:493] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.164104 32359 raft_consensus.cc:515] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.166416 32359 leader_election.cc:290] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 7541f676c605400aad64772bcbae4d58 (127.22.48.2:35465)
I20260709 12:20:11.175992 32236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c077fd526446daa00944d40e1bb014" candidate_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7541f676c605400aad64772bcbae4d58" is_pre_election: true
I20260709 12:20:11.176746 32236 raft_consensus.cc:2468] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23aac1d65c7a4cfe907b7ba16ecf9a5c in term 0.
I20260709 12:20:11.177404 32161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c077fd526446daa00944d40e1bb014" candidate_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" is_pre_election: true
I20260709 12:20:11.178092 32276 leader_election.cc:304] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23aac1d65c7a4cfe907b7ba16ecf9a5c, 7541f676c605400aad64772bcbae4d58; no voters: 
I20260709 12:20:11.178216 32161 raft_consensus.cc:2468] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23aac1d65c7a4cfe907b7ba16ecf9a5c in term 0.
I20260709 12:20:11.179131 32359 raft_consensus.cc:2804] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.179576 32359 raft_consensus.cc:493] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.179888 32359 raft_consensus.cc:3060] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.185133 32359 raft_consensus.cc:515] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.186798 32359 leader_election.cc:290] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [CANDIDATE]: Term 1 election: Requested vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 7541f676c605400aad64772bcbae4d58 (127.22.48.2:35465)
I20260709 12:20:11.187630 32161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c077fd526446daa00944d40e1bb014" candidate_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
I20260709 12:20:11.187757 32236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42c077fd526446daa00944d40e1bb014" candidate_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7541f676c605400aad64772bcbae4d58"
I20260709 12:20:11.188200 32161 raft_consensus.cc:3060] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.188336 32236 raft_consensus.cc:3060] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.193528 32161 raft_consensus.cc:2468] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23aac1d65c7a4cfe907b7ba16ecf9a5c in term 1.
I20260709 12:20:11.193602 32236 raft_consensus.cc:2468] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23aac1d65c7a4cfe907b7ba16ecf9a5c in term 1.
I20260709 12:20:11.194746 32274 leader_election.cc:304] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23aac1d65c7a4cfe907b7ba16ecf9a5c, 2e4e4ba3b83d4dd3b542a7ab6c1ade99; no voters: 
I20260709 12:20:11.195453 32359 raft_consensus.cc:2804] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.196542 32359 raft_consensus.cc:697] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 LEADER]: Becoming Leader. State: Replica: 23aac1d65c7a4cfe907b7ba16ecf9a5c, State: Running, Role: LEADER
I20260709 12:20:11.197232 32359 consensus_queue.cc:237] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.204067 32057 catalog_manager.cc:5697] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c reported cstate change: term changed from 0 to 1, leader changed from <none> to 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3). New cstate: current_term: 1 leader_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:11.296424 32356 raft_consensus.cc:493] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.297041 32356 raft_consensus.cc:515] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.299276 32356 leader_election.cc:290] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:11.308970 32161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee7e88cde63240839f584266463b29b4" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" is_pre_election: true
I20260709 12:20:11.309726 32161 raft_consensus.cc:2468] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 0.
I20260709 12:20:11.310163 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee7e88cde63240839f584266463b29b4" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" is_pre_election: true
I20260709 12:20:11.310813 32200 leader_election.cc:304] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, 7541f676c605400aad64772bcbae4d58; no voters: 
I20260709 12:20:11.310879 32310 raft_consensus.cc:2468] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 0.
I20260709 12:20:11.311729 32356 raft_consensus.cc:2804] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.312109 32356 raft_consensus.cc:493] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.312445 32356 raft_consensus.cc:3060] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.317528 32356 raft_consensus.cc:515] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.319279 32356 leader_election.cc:290] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 election: Requested vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:11.320127 32161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee7e88cde63240839f584266463b29b4" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
I20260709 12:20:11.320399 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee7e88cde63240839f584266463b29b4" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
I20260709 12:20:11.320670 32161 raft_consensus.cc:3060] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.320977 32310 raft_consensus.cc:3060] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.326506 32161 raft_consensus.cc:2468] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 1.
I20260709 12:20:11.327068 32310 raft_consensus.cc:2468] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 1.
I20260709 12:20:11.327620 32200 leader_election.cc:304] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, 7541f676c605400aad64772bcbae4d58; no voters: 
I20260709 12:20:11.328464 32356 raft_consensus.cc:2804] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.329421 32356 raft_consensus.cc:697] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Becoming Leader. State: Replica: 7541f676c605400aad64772bcbae4d58, State: Running, Role: LEADER
I20260709 12:20:11.330076 32356 consensus_queue.cc:237] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.337174 32057 catalog_manager.cc:5697] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7541f676c605400aad64772bcbae4d58 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "7541f676c605400aad64772bcbae4d58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.421190 32057 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40236:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:11.423149 32057 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:11.445188 32151 tablet_service.cc:1511] Processing CreateTablet for tablet 719c7e04d0ce4b71a9ca95141e7daef5 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=89e858fddd334a27bf52c020c26db1e9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:11.446446 32226 tablet_service.cc:1511] Processing CreateTablet for tablet 719c7e04d0ce4b71a9ca95141e7daef5 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=89e858fddd334a27bf52c020c26db1e9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:11.446516 32151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719c7e04d0ce4b71a9ca95141e7daef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.447716 32226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719c7e04d0ce4b71a9ca95141e7daef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.449465 32150 tablet_service.cc:1511] Processing CreateTablet for tablet d4375078572b451c998244d4e706f1ad (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=89e858fddd334a27bf52c020c26db1e9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:11.451308 32300 tablet_service.cc:1511] Processing CreateTablet for tablet 719c7e04d0ce4b71a9ca95141e7daef5 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=89e858fddd334a27bf52c020c26db1e9]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:20:11.452126 32299 tablet_service.cc:1511] Processing CreateTablet for tablet d4375078572b451c998244d4e706f1ad (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=89e858fddd334a27bf52c020c26db1e9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:11.452526 32300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 719c7e04d0ce4b71a9ca95141e7daef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.452396 32225 tablet_service.cc:1511] Processing CreateTablet for tablet d4375078572b451c998244d4e706f1ad (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=89e858fddd334a27bf52c020c26db1e9]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:20:11.453349 32299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4375078572b451c998244d4e706f1ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.453605 32225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4375078572b451c998244d4e706f1ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.456193 32150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4375078572b451c998244d4e706f1ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:11.465121 32350 tablet_bootstrap.cc:492] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Bootstrap starting.
I20260709 12:20:11.469560 32351 tablet_bootstrap.cc:492] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58: Bootstrap starting.
I20260709 12:20:11.471634 32350 tablet_bootstrap.cc:654] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.476706 32351 tablet_bootstrap.cc:654] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.482815 32352 tablet_bootstrap.cc:492] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Bootstrap starting.
I20260709 12:20:11.483723 32350 tablet_bootstrap.cc:492] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: No bootstrap required, opened a new log
I20260709 12:20:11.484215 32350 ts_tablet_manager.cc:1403] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 12:20:11.487162 32350 raft_consensus.cc:359] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.487841 32351 tablet_bootstrap.cc:492] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58: No bootstrap required, opened a new log
I20260709 12:20:11.487901 32350 raft_consensus.cc:385] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.488543 32351 ts_tablet_manager.cc:1403] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.002s
I20260709 12:20:11.489853 32352 tablet_bootstrap.cc:654] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.488511 32350 raft_consensus.cc:740] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.491412 32350 consensus_queue.cc:260] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.491825 32351 raft_consensus.cc:359] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.492636 32351 raft_consensus.cc:385] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.493069 32351 raft_consensus.cc:740] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7541f676c605400aad64772bcbae4d58, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.494234 32351 consensus_queue.cc:260] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.497224 32351 ts_tablet_manager.cc:1434] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:11.498576 32351 tablet_bootstrap.cc:492] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58: Bootstrap starting.
I20260709 12:20:11.500450 32350 ts_tablet_manager.cc:1434] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:20:11.507769 32351 tablet_bootstrap.cc:654] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.512027 32350 tablet_bootstrap.cc:492] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Bootstrap starting.
I20260709 12:20:11.512297 32352 tablet_bootstrap.cc:492] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: No bootstrap required, opened a new log
I20260709 12:20:11.513019 32352 ts_tablet_manager.cc:1403] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.009s
I20260709 12:20:11.517417 32352 raft_consensus.cc:359] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.518082 32352 raft_consensus.cc:385] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.518380 32352 raft_consensus.cc:740] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23aac1d65c7a4cfe907b7ba16ecf9a5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.519119 32352 consensus_queue.cc:260] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.519676 32350 tablet_bootstrap.cc:654] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.519791 32351 tablet_bootstrap.cc:492] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58: No bootstrap required, opened a new log
I20260709 12:20:11.520391 32351 ts_tablet_manager.cc:1403] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:20:11.523480 32352 ts_tablet_manager.cc:1434] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:20:11.523391 32351 raft_consensus.cc:359] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.524183 32351 raft_consensus.cc:385] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.524479 32351 raft_consensus.cc:740] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7541f676c605400aad64772bcbae4d58, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.524605 32352 tablet_bootstrap.cc:492] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Bootstrap starting.
I20260709 12:20:11.525326 32351 consensus_queue.cc:260] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.528105 32351 ts_tablet_manager.cc:1434] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:11.530961 32350 tablet_bootstrap.cc:492] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: No bootstrap required, opened a new log
I20260709 12:20:11.531549 32350 ts_tablet_manager.cc:1403] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.001s
I20260709 12:20:11.532348 32352 tablet_bootstrap.cc:654] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:11.534835 32350 raft_consensus.cc:359] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.535624 32350 raft_consensus.cc:385] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.535967 32350 raft_consensus.cc:740] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.536962 32350 consensus_queue.cc:260] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.539156 32350 ts_tablet_manager.cc:1434] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:11.541620 32352 tablet_bootstrap.cc:492] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c: No bootstrap required, opened a new log
I20260709 12:20:11.542050 32352 ts_tablet_manager.cc:1403] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Time spent bootstrapping tablet: real 0.018s	user 0.004s	sys 0.011s
I20260709 12:20:11.544317 32352 raft_consensus.cc:359] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.544860 32352 raft_consensus.cc:385] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:11.545114 32352 raft_consensus.cc:740] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23aac1d65c7a4cfe907b7ba16ecf9a5c, State: Initialized, Role: FOLLOWER
I20260709 12:20:11.545799 32352 consensus_queue.cc:260] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
W20260709 12:20:11.546739 32107 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:11.547987 32352 ts_tablet_manager.cc:1434] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:11.559706 32356 raft_consensus.cc:493] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.560117 32356 raft_consensus.cc:515] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.561657 32356 leader_election.cc:290] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:11.562489 32161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719c7e04d0ce4b71a9ca95141e7daef5" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" is_pre_election: true
I20260709 12:20:11.562842 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719c7e04d0ce4b71a9ca95141e7daef5" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" is_pre_election: true
I20260709 12:20:11.563061 32161 raft_consensus.cc:2468] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 0.
I20260709 12:20:11.563475 32310 raft_consensus.cc:2468] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 0.
I20260709 12:20:11.564162 32200 leader_election.cc:304] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, 7541f676c605400aad64772bcbae4d58; no voters: 
I20260709 12:20:11.565009 32356 raft_consensus.cc:2804] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.565325 32356 raft_consensus.cc:493] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.565912 32356 raft_consensus.cc:3060] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.570868 32356 raft_consensus.cc:515] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.572368 32356 leader_election.cc:290] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 election: Requested vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:11.573505 32161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719c7e04d0ce4b71a9ca95141e7daef5" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
I20260709 12:20:11.573727 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719c7e04d0ce4b71a9ca95141e7daef5" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
I20260709 12:20:11.574165 32161 raft_consensus.cc:3060] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.574240 32310 raft_consensus.cc:3060] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.581215 32310 raft_consensus.cc:2468] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 1.
I20260709 12:20:11.581203 32161 raft_consensus.cc:2468] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 1.
I20260709 12:20:11.582566 32200 leader_election.cc:304] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, 7541f676c605400aad64772bcbae4d58; no voters: 
I20260709 12:20:11.583292 32356 raft_consensus.cc:2804] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.583742 32356 raft_consensus.cc:697] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Becoming Leader. State: Replica: 7541f676c605400aad64772bcbae4d58, State: Running, Role: LEADER
I20260709 12:20:11.584589 32356 consensus_queue.cc:237] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.592729 32056 catalog_manager.cc:5697] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7541f676c605400aad64772bcbae4d58 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "7541f676c605400aad64772bcbae4d58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:11.611202 32359 consensus_queue.cc:1048] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:11.622803 32382 consensus_queue.cc:1048] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:11.795922 32356 consensus_queue.cc:1048] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:11.807616 32366 consensus_queue.cc:1048] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:11.931424 32366 raft_consensus.cc:493] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.931985 32366 raft_consensus.cc:515] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.932945 32359 raft_consensus.cc:493] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.933426 32359 raft_consensus.cc:515] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.934017 32366 leader_election.cc:290] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:11.934857 32161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" is_pre_election: true
I20260709 12:20:11.935128 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" is_pre_election: true
I20260709 12:20:11.935317 32359 leader_election.cc:290] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 7541f676c605400aad64772bcbae4d58 (127.22.48.2:35465)
I20260709 12:20:11.935986 32310 raft_consensus.cc:2468] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 0.
I20260709 12:20:11.936069 32160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" is_pre_election: true
I20260709 12:20:11.936353 32236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7541f676c605400aad64772bcbae4d58" is_pre_election: true
I20260709 12:20:11.936760 32160 raft_consensus.cc:2468] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23aac1d65c7a4cfe907b7ba16ecf9a5c in term 0.
I20260709 12:20:11.937013 32236 raft_consensus.cc:2468] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23aac1d65c7a4cfe907b7ba16ecf9a5c in term 0.
I20260709 12:20:11.937264 32200 leader_election.cc:304] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23aac1d65c7a4cfe907b7ba16ecf9a5c, 7541f676c605400aad64772bcbae4d58; no voters: 
I20260709 12:20:11.938333 32274 leader_election.cc:304] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23aac1d65c7a4cfe907b7ba16ecf9a5c, 2e4e4ba3b83d4dd3b542a7ab6c1ade99; no voters: 
I20260709 12:20:11.938462 32366 raft_consensus.cc:2804] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.938926 32366 raft_consensus.cc:493] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.939206 32359 raft_consensus.cc:2804] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:11.939314 32366 raft_consensus.cc:3060] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.939654 32359 raft_consensus.cc:493] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.940009 32359 raft_consensus.cc:3060] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.946903 32366 raft_consensus.cc:515] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.946903 32359 raft_consensus.cc:515] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.949209 32359 leader_election.cc:290] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [CANDIDATE]: Term 1 election: Requested vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 7541f676c605400aad64772bcbae4d58 (127.22.48.2:35465)
I20260709 12:20:11.949209 32366 leader_election.cc:290] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 election: Requested vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:11.950043 32161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
I20260709 12:20:11.950134 32160 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
I20260709 12:20:11.950453 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
I20260709 12:20:11.950847 32161 raft_consensus.cc:3060] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:11.951218 32310 raft_consensus.cc:2393] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7541f676c605400aad64772bcbae4d58 in current term 1: Already voted for candidate 23aac1d65c7a4cfe907b7ba16ecf9a5c in this term.
I20260709 12:20:11.951499 32236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7541f676c605400aad64772bcbae4d58"
I20260709 12:20:11.952250 32236 raft_consensus.cc:2393] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 23aac1d65c7a4cfe907b7ba16ecf9a5c in current term 1: Already voted for candidate 7541f676c605400aad64772bcbae4d58 in this term.
I20260709 12:20:11.952288 32200 leader_election.cc:304] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7541f676c605400aad64772bcbae4d58; no voters: 23aac1d65c7a4cfe907b7ba16ecf9a5c, 2e4e4ba3b83d4dd3b542a7ab6c1ade99
I20260709 12:20:11.953284 32366 raft_consensus.cc:2749] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:11.956497 32161 raft_consensus.cc:2468] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23aac1d65c7a4cfe907b7ba16ecf9a5c in term 1.
I20260709 12:20:11.957613 32274 leader_election.cc:304] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23aac1d65c7a4cfe907b7ba16ecf9a5c, 2e4e4ba3b83d4dd3b542a7ab6c1ade99; no voters: 7541f676c605400aad64772bcbae4d58
I20260709 12:20:11.958400 32359 raft_consensus.cc:2804] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:11.958840 32359 raft_consensus.cc:697] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 LEADER]: Becoming Leader. State: Replica: 23aac1d65c7a4cfe907b7ba16ecf9a5c, State: Running, Role: LEADER
I20260709 12:20:11.959637 32359 consensus_queue.cc:237] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:11.966495 32057 catalog_manager.cc:5697] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c reported cstate change: term changed from 0 to 1, leader changed from <none> to 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3). New cstate: current_term: 1 leader_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:12.072824 32236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee7e88cde63240839f584266463b29b4"
dest_uuid: "7541f676c605400aad64772bcbae4d58"
mode: GRACEFUL
new_leader_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
 from {username='slave'} at 127.0.0.1:41582
I20260709 12:20:12.073738 32236 raft_consensus.cc:606] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Received request to transfer leadership to TS 2e4e4ba3b83d4dd3b542a7ab6c1ade99
I20260709 12:20:12.082564 32236 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "719c7e04d0ce4b71a9ca95141e7daef5"
dest_uuid: "7541f676c605400aad64772bcbae4d58"
mode: GRACEFUL
new_leader_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
 from {username='slave'} at 127.0.0.1:41582
I20260709 12:20:12.083235 32236 raft_consensus.cc:606] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Received request to transfer leadership to TS 2e4e4ba3b83d4dd3b542a7ab6c1ade99
I20260709 12:20:12.095446 32366 consensus_queue.cc:1048] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:12.103156 32309 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4375078572b451c998244d4e706f1ad"
dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
mode: GRACEFUL
new_leader_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
 from {username='slave'} at 127.0.0.1:57720
I20260709 12:20:12.104086 32309 raft_consensus.cc:606] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 LEADER]: Received request to transfer leadership to TS 2e4e4ba3b83d4dd3b542a7ab6c1ade99
I20260709 12:20:12.104365 32387 consensus_queue.cc:1048] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:12.126869 32356 raft_consensus.cc:993] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58: : Instructing follower 2e4e4ba3b83d4dd3b542a7ab6c1ade99 to start an election
I20260709 12:20:12.127413 32356 raft_consensus.cc:1081] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Signalling peer 2e4e4ba3b83d4dd3b542a7ab6c1ade99 to start an election
I20260709 12:20:12.129555 32160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "719c7e04d0ce4b71a9ca95141e7daef5"
dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
 from {username='slave'} at 127.0.0.1:46944
I20260709 12:20:12.130254 32160 raft_consensus.cc:493] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:12.130663 32160 raft_consensus.cc:3060] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:12.141158 32160 raft_consensus.cc:515] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:12.142182 32161 raft_consensus.cc:1240] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Rejecting Update request from peer 7541f676c605400aad64772bcbae4d58 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:12.147667 32160 leader_election.cc:290] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [CANDIDATE]: Term 2 election: Requested vote from peers 7541f676c605400aad64772bcbae4d58 (127.22.48.2:35465), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:12.148402 32366 consensus_queue.cc:1059] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:12.149354 32366 raft_consensus.cc:3055] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:12.149760 32366 raft_consensus.cc:740] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7541f676c605400aad64772bcbae4d58, State: Running, Role: LEADER
I20260709 12:20:12.151211 32366 consensus_queue.cc:260] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:12.152921 32366 raft_consensus.cc:3060] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:12.166744 32236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719c7e04d0ce4b71a9ca95141e7daef5" candidate_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7541f676c605400aad64772bcbae4d58"
I20260709 12:20:12.168061 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "719c7e04d0ce4b71a9ca95141e7daef5" candidate_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
I20260709 12:20:12.168677 32310 raft_consensus.cc:3060] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:12.175720 32236 raft_consensus.cc:2468] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e4e4ba3b83d4dd3b542a7ab6c1ade99 in term 2.
I20260709 12:20:12.177131 32127 leader_election.cc:304] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, 7541f676c605400aad64772bcbae4d58; no voters: 
I20260709 12:20:12.177690 32310 raft_consensus.cc:2468] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e4e4ba3b83d4dd3b542a7ab6c1ade99 in term 2.
I20260709 12:20:12.178164 32357 raft_consensus.cc:2804] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:12.179668 32357 raft_consensus.cc:697] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 LEADER]: Becoming Leader. State: Replica: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, State: Running, Role: LEADER
I20260709 12:20:12.181090 32357 consensus_queue.cc:237] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:12.192768 32056 catalog_manager.cc:5697] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 reported cstate change: term changed from 1 to 2, leader changed from 7541f676c605400aad64772bcbae4d58 (127.22.48.2) to 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:12.293134 32356 raft_consensus.cc:993] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58: : Instructing follower 2e4e4ba3b83d4dd3b542a7ab6c1ade99 to start an election
I20260709 12:20:12.293668 32366 raft_consensus.cc:1081] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Signalling peer 2e4e4ba3b83d4dd3b542a7ab6c1ade99 to start an election
I20260709 12:20:12.295490 32160 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee7e88cde63240839f584266463b29b4"
dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
 from {username='slave'} at 127.0.0.1:46944
I20260709 12:20:12.296142 32160 raft_consensus.cc:493] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:12.296569 32160 raft_consensus.cc:3060] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:12.302721 32160 raft_consensus.cc:515] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:12.304708 32160 leader_election.cc:290] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [CANDIDATE]: Term 2 election: Requested vote from peers 7541f676c605400aad64772bcbae4d58 (127.22.48.2:35465), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:12.305436 32236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee7e88cde63240839f584266463b29b4" candidate_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7541f676c605400aad64772bcbae4d58"
I20260709 12:20:12.305886 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee7e88cde63240839f584266463b29b4" candidate_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
I20260709 12:20:12.306033 32236 raft_consensus.cc:3055] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:12.306489 32236 raft_consensus.cc:740] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7541f676c605400aad64772bcbae4d58, State: Running, Role: LEADER
I20260709 12:20:12.306603 32310 raft_consensus.cc:3060] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:12.307475 32236 consensus_queue.cc:260] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:12.308866 32236 raft_consensus.cc:3060] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:12.313117 32310 raft_consensus.cc:2468] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e4e4ba3b83d4dd3b542a7ab6c1ade99 in term 2.
I20260709 12:20:12.314348 32236 raft_consensus.cc:2468] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e4e4ba3b83d4dd3b542a7ab6c1ade99 in term 2.
I20260709 12:20:12.314553 32125 leader_election.cc:304] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23aac1d65c7a4cfe907b7ba16ecf9a5c, 2e4e4ba3b83d4dd3b542a7ab6c1ade99; no voters: 
I20260709 12:20:12.315418 32357 raft_consensus.cc:2804] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:12.315894 32357 raft_consensus.cc:697] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 LEADER]: Becoming Leader. State: Replica: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, State: Running, Role: LEADER
I20260709 12:20:12.316828 32357 consensus_queue.cc:237] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:12.323028 32058 catalog_manager.cc:5697] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 reported cstate change: term changed from 1 to 2, leader changed from 7541f676c605400aad64772bcbae4d58 (127.22.48.2) to 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:12.564536 32399 consensus_queue.cc:1048] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:12.570365 32399 consensus_queue.cc:1048] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:12.588841 32359 raft_consensus.cc:993] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c: : Instructing follower 2e4e4ba3b83d4dd3b542a7ab6c1ade99 to start an election
I20260709 12:20:12.589340 32359 raft_consensus.cc:1081] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 LEADER]: Signalling peer 2e4e4ba3b83d4dd3b542a7ab6c1ade99 to start an election
I20260709 12:20:12.591094 32161 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4375078572b451c998244d4e706f1ad"
dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
 from {username='slave'} at 127.0.0.1:46934
I20260709 12:20:12.594327 32161 raft_consensus.cc:493] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:12.594767 32161 raft_consensus.cc:3060] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:12.602839 32161 raft_consensus.cc:515] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:12.606112 32161 leader_election.cc:290] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [CANDIDATE]: Term 2 election: Requested vote from peers 7541f676c605400aad64772bcbae4d58 (127.22.48.2:35465), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:12.607277 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
I20260709 12:20:12.607308 32236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7541f676c605400aad64772bcbae4d58"
I20260709 12:20:12.608006 32310 raft_consensus.cc:3055] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:12.608096 32236 raft_consensus.cc:3060] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:12.608349 32310 raft_consensus.cc:740] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23aac1d65c7a4cfe907b7ba16ecf9a5c, State: Running, Role: LEADER
I20260709 12:20:12.609359 32310 consensus_queue.cc:260] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:12.610540 32310 raft_consensus.cc:3060] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:12.613826 32236 raft_consensus.cc:2468] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e4e4ba3b83d4dd3b542a7ab6c1ade99 in term 2.
I20260709 12:20:12.615099 32127 leader_election.cc:304] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, 7541f676c605400aad64772bcbae4d58; no voters: 
I20260709 12:20:12.615926 32357 raft_consensus.cc:2804] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:12.616025 32310 raft_consensus.cc:2468] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e4e4ba3b83d4dd3b542a7ab6c1ade99 in term 2.
I20260709 12:20:12.616411 32357 raft_consensus.cc:697] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 LEADER]: Becoming Leader. State: Replica: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, State: Running, Role: LEADER
I20260709 12:20:12.617419 32357 consensus_queue.cc:237] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:12.624219 32058 catalog_manager.cc:5697] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 reported cstate change: term changed from 1 to 2, leader changed from 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3) to 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:12.683599 32310 raft_consensus.cc:1275] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Refusing update from remote peer 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:12.684808 32357 consensus_queue.cc:1048] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:12.693156 32236 raft_consensus.cc:1275] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Refusing update from remote peer 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:12.697359 32403 consensus_queue.cc:1048] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:12.750697 32310 raft_consensus.cc:1275] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Refusing update from remote peer 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:12.752162 32403 consensus_queue.cc:1048] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:12.761024 32236 raft_consensus.cc:1275] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Refusing update from remote peer 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:12.762410 32357 consensus_queue.cc:1048] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:12.874758 22720 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:20:12.876368 22720 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:20:12.876761 22720 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:20:12.890937 32161 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4375078572b451c998244d4e706f1ad"
dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
mode: GRACEFUL
new_leader_uuid: "7541f676c605400aad64772bcbae4d58"
 from {username='slave'} at 127.0.0.1:46946
I20260709 12:20:12.891496 32161 raft_consensus.cc:606] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 LEADER]: Received request to transfer leadership to TS 7541f676c605400aad64772bcbae4d58
I20260709 12:20:12.892881 22720 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:20:13.076994 32236 raft_consensus.cc:1275] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Refusing update from remote peer 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:13.078339 32357 consensus_queue.cc:1048] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:13.083907 32403 raft_consensus.cc:993] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: : Instructing follower 7541f676c605400aad64772bcbae4d58 to start an election
I20260709 12:20:13.084623 32398 raft_consensus.cc:1081] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 LEADER]: Signalling peer 7541f676c605400aad64772bcbae4d58 to start an election
I20260709 12:20:13.086625 32235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4375078572b451c998244d4e706f1ad"
dest_uuid: "7541f676c605400aad64772bcbae4d58"
 from {username='slave'} at 127.0.0.1:41588
I20260709 12:20:13.087858 32235 raft_consensus.cc:493] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:13.088279 32235 raft_consensus.cc:3060] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:13.089471 32310 raft_consensus.cc:1275] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Refusing update from remote peer 2e4e4ba3b83d4dd3b542a7ab6c1ade99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:13.091638 32398 consensus_queue.cc:1048] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:13.098766 32235 raft_consensus.cc:515] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:13.103528 32161 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99"
I20260709 12:20:13.104218 32161 raft_consensus.cc:3055] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:13.104751 32161 raft_consensus.cc:740] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, State: Running, Role: LEADER
I20260709 12:20:13.105803 32235 leader_election.cc:290] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 3 election: Requested vote from peers 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1:33273), 23aac1d65c7a4cfe907b7ba16ecf9a5c (127.22.48.3:43825)
I20260709 12:20:13.105790 32161 consensus_queue.cc:260] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:13.107703 32310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4375078572b451c998244d4e706f1ad" candidate_uuid: "7541f676c605400aad64772bcbae4d58" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c"
I20260709 12:20:13.108266 32310 raft_consensus.cc:3060] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:13.108588 32161 raft_consensus.cc:3060] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:13.115353 32161 raft_consensus.cc:2468] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 3.
I20260709 12:20:13.116003 32310 raft_consensus.cc:2468] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7541f676c605400aad64772bcbae4d58 in term 3.
I20260709 12:20:13.116592 32200 leader_election.cc:304] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e4e4ba3b83d4dd3b542a7ab6c1ade99, 7541f676c605400aad64772bcbae4d58; no voters: 
I20260709 12:20:13.117478 32366 raft_consensus.cc:2804] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:13.118463 32366 raft_consensus.cc:697] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 3 LEADER]: Becoming Leader. State: Replica: 7541f676c605400aad64772bcbae4d58, State: Running, Role: LEADER
I20260709 12:20:13.119304 32366 consensus_queue.cc:237] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } }
I20260709 12:20:13.125607 32056 catalog_manager.cc:5697] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 reported cstate change: term changed from 2 to 3, leader changed from 2e4e4ba3b83d4dd3b542a7ab6c1ade99 (127.22.48.1) to 7541f676c605400aad64772bcbae4d58 (127.22.48.2). New cstate: current_term: 3 leader_uuid: "7541f676c605400aad64772bcbae4d58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e4e4ba3b83d4dd3b542a7ab6c1ade99" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 33273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7541f676c605400aad64772bcbae4d58" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 35465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23aac1d65c7a4cfe907b7ba16ecf9a5c" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 43825 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:13.255779 22720 tablet_server.cc:179] TabletServer@127.22.48.1:0 shutting down...
I20260709 12:20:13.284111 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:13.284880 22720 tablet_replica.cc:333] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: stopping tablet replica
I20260709 12:20:13.285615 22720 raft_consensus.cc:2243] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.286075 22720 raft_consensus.cc:2272] T d4375078572b451c998244d4e706f1ad P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.288807 22720 tablet_replica.cc:333] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: stopping tablet replica
I20260709 12:20:13.289403 22720 raft_consensus.cc:2243] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:13.290192 22720 raft_consensus.cc:2272] T 719c7e04d0ce4b71a9ca95141e7daef5 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.294063 22720 tablet_replica.cc:333] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: stopping tablet replica
I20260709 12:20:13.294989 22720 raft_consensus.cc:2243] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:13.296267 22720 raft_consensus.cc:2272] T ee7e88cde63240839f584266463b29b4 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.299172 22720 tablet_replica.cc:333] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99: stopping tablet replica
I20260709 12:20:13.299731 22720 raft_consensus.cc:2243] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.300189 22720 raft_consensus.cc:2272] T 42c077fd526446daa00944d40e1bb014 P 2e4e4ba3b83d4dd3b542a7ab6c1ade99 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.326710 22720 tablet_server.cc:196] TabletServer@127.22.48.1:0 shutdown complete.
I20260709 12:20:13.344911 22720 tablet_server.cc:179] TabletServer@127.22.48.2:0 shutting down...
I20260709 12:20:13.369838 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:13.370736 22720 tablet_replica.cc:333] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58: stopping tablet replica
I20260709 12:20:13.371486 22720 raft_consensus.cc:2243] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.372023 22720 raft_consensus.cc:2272] T 719c7e04d0ce4b71a9ca95141e7daef5 P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.375558 22720 tablet_replica.cc:333] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58: stopping tablet replica
I20260709 12:20:13.376149 22720 raft_consensus.cc:2243] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:13.376770 22720 pending_rounds.cc:70] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58: Trying to abort 1 pending ops.
I20260709 12:20:13.376971 22720 pending_rounds.cc:77] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305624015344545792 op_type: NO_OP noop_request { }
I20260709 12:20:13.377274 22720 raft_consensus.cc:2889] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:13.377569 22720 raft_consensus.cc:2272] T d4375078572b451c998244d4e706f1ad P 7541f676c605400aad64772bcbae4d58 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.380527 22720 tablet_replica.cc:333] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58: stopping tablet replica
I20260709 12:20:13.381055 22720 raft_consensus.cc:2243] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.381474 22720 raft_consensus.cc:2272] T ee7e88cde63240839f584266463b29b4 P 7541f676c605400aad64772bcbae4d58 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.384112 22720 tablet_replica.cc:333] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58: stopping tablet replica
I20260709 12:20:13.384613 22720 raft_consensus.cc:2243] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.385072 22720 raft_consensus.cc:2272] T 42c077fd526446daa00944d40e1bb014 P 7541f676c605400aad64772bcbae4d58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.410497 22720 tablet_server.cc:196] TabletServer@127.22.48.2:0 shutdown complete.
I20260709 12:20:13.427467 22720 tablet_server.cc:179] TabletServer@127.22.48.3:0 shutting down...
I20260709 12:20:13.449182 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:13.449949 22720 tablet_replica.cc:333] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c: stopping tablet replica
I20260709 12:20:13.450649 22720 raft_consensus.cc:2243] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.451118 22720 raft_consensus.cc:2272] T d4375078572b451c998244d4e706f1ad P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.453692 22720 tablet_replica.cc:333] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: stopping tablet replica
I20260709 12:20:13.454250 22720 raft_consensus.cc:2243] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.454753 22720 raft_consensus.cc:2272] T 719c7e04d0ce4b71a9ca95141e7daef5 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.457458 22720 tablet_replica.cc:333] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: stopping tablet replica
I20260709 12:20:13.458019 22720 raft_consensus.cc:2243] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:13.458521 22720 raft_consensus.cc:2272] T ee7e88cde63240839f584266463b29b4 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.460933 22720 tablet_replica.cc:333] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c: stopping tablet replica
I20260709 12:20:13.461395 22720 raft_consensus.cc:2243] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:13.462213 22720 raft_consensus.cc:2272] T 42c077fd526446daa00944d40e1bb014 P 23aac1d65c7a4cfe907b7ba16ecf9a5c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.486146 22720 tablet_server.cc:196] TabletServer@127.22.48.3:0 shutdown complete.
I20260709 12:20:13.502449 22720 master.cc:562] Master@127.22.48.62:41923 shutting down...
I20260709 12:20:13.522413 22720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:13.522920 22720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:13.523207 22720 tablet_replica.cc:333] T 00000000000000000000000000000000 P e49ccf4a99d740da81a10b8b35eee9eb: stopping tablet replica
I20260709 12:20:13.542486 22720 master.cc:584] Master@127.22.48.62:41923 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (3184 ms)
[----------] 6 tests from LeaderRebalancerTest (298794 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:20:13.581224 22720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.48.62:36333
I20260709 12:20:13.582360 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:13.587718 32409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:13.587744 32410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:13.590518 22720 server_base.cc:1061] running on GCE node
W20260709 12:20:13.590557 32412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:13.591622 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:13.591832 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:13.592023 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599613591984 us; error 0 us; skew 500 ppm
I20260709 12:20:13.592602 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:13.595933 22720 webserver.cc:533] Webserver started at http://127.22.48.62:43323/ using document root <none> and password file <none>
I20260709 12:20:13.596434 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:13.596657 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:13.596915 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:13.598067 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/master-0-root/instance:
uuid: "c96981995b604e6bb457d58b27cac950"
format_stamp: "Formatted at 2026-07-09 12:20:13 on dist-test-slave-044g"
I20260709 12:20:13.603468 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:13.606770 32417 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:13.607604 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:20:13.607908 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/master-0-root
uuid: "c96981995b604e6bb457d58b27cac950"
format_stamp: "Formatted at 2026-07-09 12:20:13 on dist-test-slave-044g"
I20260709 12:20:13.608199 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:13.624823 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:13.626046 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:13.665275 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.62:36333
I20260709 12:20:13.665387 32468 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.62:36333 every 8 connection(s)
I20260709 12:20:13.669216 32469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:13.680370 32469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950: Bootstrap starting.
I20260709 12:20:13.685268 32469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:13.689441 32469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950: No bootstrap required, opened a new log
I20260709 12:20:13.691862 32469 raft_consensus.cc:359] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c96981995b604e6bb457d58b27cac950" member_type: VOTER }
I20260709 12:20:13.692260 32469 raft_consensus.cc:385] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:13.692492 32469 raft_consensus.cc:740] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c96981995b604e6bb457d58b27cac950, State: Initialized, Role: FOLLOWER
I20260709 12:20:13.693216 32469 consensus_queue.cc:260] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c96981995b604e6bb457d58b27cac950" member_type: VOTER }
I20260709 12:20:13.693717 32469 raft_consensus.cc:399] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:13.693958 32469 raft_consensus.cc:493] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:13.694260 32469 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:13.699436 32469 raft_consensus.cc:515] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c96981995b604e6bb457d58b27cac950" member_type: VOTER }
I20260709 12:20:13.700017 32469 leader_election.cc:304] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c96981995b604e6bb457d58b27cac950; no voters: 
I20260709 12:20:13.701191 32469 leader_election.cc:290] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:13.701552 32472 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:13.702924 32472 raft_consensus.cc:697] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 1 LEADER]: Becoming Leader. State: Replica: c96981995b604e6bb457d58b27cac950, State: Running, Role: LEADER
I20260709 12:20:13.703629 32472 consensus_queue.cc:237] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c96981995b604e6bb457d58b27cac950" member_type: VOTER }
I20260709 12:20:13.704499 32469 sys_catalog.cc:565] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:13.706930 32473 sys_catalog.cc:455] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c96981995b604e6bb457d58b27cac950" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c96981995b604e6bb457d58b27cac950" member_type: VOTER } }
I20260709 12:20:13.707024 32474 sys_catalog.cc:455] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c96981995b604e6bb457d58b27cac950. Latest consensus state: current_term: 1 leader_uuid: "c96981995b604e6bb457d58b27cac950" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c96981995b604e6bb457d58b27cac950" member_type: VOTER } }
I20260709 12:20:13.707661 32473 sys_catalog.cc:458] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:13.707845 32474 sys_catalog.cc:458] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:13.714459 32478 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:13.723057 32478 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:13.724114 22720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:13.732053 32478 catalog_manager.cc:1383] Generated new cluster ID: 5b5838c9175947849df6bcf79fd6cee5
I20260709 12:20:13.732496 32478 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:13.748844 32478 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:13.750150 32478 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:13.763186 32478 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950: Generated new TSK 0
I20260709 12:20:13.763825 32478 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:13.791291 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:13.797482 32490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:13.799021 32491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:13.802345 32493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:13.802521 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:13.803606 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:13.803839 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:13.804028 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599613804007 us; error 0 us; skew 500 ppm
I20260709 12:20:13.804558 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:13.807240 22720 webserver.cc:533] Webserver started at http://127.22.48.1:44019/ using document root <none> and password file <none>
I20260709 12:20:13.807753 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:13.807963 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:13.808238 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:13.809415 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-0-root/instance:
uuid: "27e27502ef8e4f22828983a842faab70"
format_stamp: "Formatted at 2026-07-09 12:20:13 on dist-test-slave-044g"
I20260709 12:20:13.814522 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:20:13.818066 32498 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:13.818943 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:13.819247 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "27e27502ef8e4f22828983a842faab70"
format_stamp: "Formatted at 2026-07-09 12:20:13 on dist-test-slave-044g"
I20260709 12:20:13.819546 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:13.832199 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:13.833804 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:13.835697 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:13.837898 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:13.838116 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:13.838394 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:13.838583 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:13.881104 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:46619
I20260709 12:20:13.881222 32560 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:46619 every 8 connection(s)
I20260709 12:20:13.886466 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:13.894902 32565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:13.895783 32566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:13.898761 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:13.900098 32561 heartbeater.cc:344] Connected to a master server at 127.22.48.62:36333
W20260709 12:20:13.900195 32568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:13.900561 32561 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:13.901197 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:13.901432 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:13.901357 32561 heartbeater.cc:507] Master 127.22.48.62:36333 requested a full tablet report, sending...
I20260709 12:20:13.901865 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599613901830 us; error 0 us; skew 500 ppm
I20260709 12:20:13.902580 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:13.903982 32434 ts_manager.cc:194] Registered new tserver with Master: 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619)
I20260709 12:20:13.905221 22720 webserver.cc:533] Webserver started at http://127.22.48.2:42283/ using document root <none> and password file <none>
I20260709 12:20:13.905853 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:13.906087 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:13.906262 32434 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56642
I20260709 12:20:13.906435 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:13.907819 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-1-root/instance:
uuid: "e266205d640345fdacc14a10ad7321f2"
format_stamp: "Formatted at 2026-07-09 12:20:13 on dist-test-slave-044g"
I20260709 12:20:13.912894 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:20:13.917229 32573 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:13.918632 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:20:13.918948 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-1-root
uuid: "e266205d640345fdacc14a10ad7321f2"
format_stamp: "Formatted at 2026-07-09 12:20:13 on dist-test-slave-044g"
I20260709 12:20:13.919248 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:13.932065 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:13.933275 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:13.934839 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:13.937007 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:13.937230 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:13.937482 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:13.937657 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:13.980638 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.2:40289
I20260709 12:20:13.980762 32635 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.2:40289 every 8 connection(s)
I20260709 12:20:13.986611 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:13.993561 32639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:13.994752 32640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:14.000458 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:14.001161 32636 heartbeater.cc:344] Connected to a master server at 127.22.48.62:36333
W20260709 12:20:14.001403 32642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:14.001547 32636 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:14.002559 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:20:14.002683 32636 heartbeater.cc:507] Master 127.22.48.62:36333 requested a full tablet report, sending...
W20260709 12:20:14.002807 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:14.003228 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599614003199 us; error 0 us; skew 500 ppm
I20260709 12:20:14.004050 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:14.005089 32434 ts_manager.cc:194] Registered new tserver with Master: e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:14.006870 32434 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56650
I20260709 12:20:14.007025 22720 webserver.cc:533] Webserver started at http://127.22.48.3:37443/ using document root <none> and password file <none>
I20260709 12:20:14.007687 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:14.007968 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:14.008545 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:14.009794 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-2-root/instance:
uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
format_stamp: "Formatted at 2026-07-09 12:20:14 on dist-test-slave-044g"
I20260709 12:20:14.014331 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:20:14.018224 32647 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:14.019129 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:20:14.019466 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-2-root
uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
format_stamp: "Formatted at 2026-07-09 12:20:14 on dist-test-slave-044g"
I20260709 12:20:14.019819 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599314612061-22720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:14.037385 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:14.038695 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:14.040241 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:14.042587 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:14.042821 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:14.043058 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:14.043259 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:14.088124 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.3:38623
I20260709 12:20:14.088236 32709 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.3:38623 every 8 connection(s)
I20260709 12:20:14.102443 32710 heartbeater.cc:344] Connected to a master server at 127.22.48.62:36333
I20260709 12:20:14.102900 32710 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:14.103623 32710 heartbeater.cc:507] Master 127.22.48.62:36333 requested a full tablet report, sending...
I20260709 12:20:14.105502 32434 ts_manager.cc:194] Registered new tserver with Master: 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.106487 22720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014754481s
I20260709 12:20:14.107079 32434 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56654
I20260709 12:20:14.133044 32434 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56668:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:14.136622 32434 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:14.222092 32526 tablet_service.cc:1511] Processing CreateTablet for tablet 6a21eb0a428640caa18addf7158c5492 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:14.224221 32526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a21eb0a428640caa18addf7158c5492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.227355 32675 tablet_service.cc:1511] Processing CreateTablet for tablet 6a21eb0a428640caa18addf7158c5492 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:14.228832 32675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a21eb0a428640caa18addf7158c5492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.230168 32671 tablet_service.cc:1511] Processing CreateTablet for tablet 619a8ba632134dd99dfc7c3c7f01abd3 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:14.231669 32671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619a8ba632134dd99dfc7c3c7f01abd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.235520 32672 tablet_service.cc:1511] Processing CreateTablet for tablet f3ba3e86b62d4207a7ba2f6b4cff32db (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:14.236951 32672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ba3e86b62d4207a7ba2f6b4cff32db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.238577 32525 tablet_service.cc:1511] Processing CreateTablet for tablet 4729df9887e744f59d3316bd92853bb9 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:14.240000 32525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4729df9887e744f59d3316bd92853bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.240286 32673 tablet_service.cc:1511] Processing CreateTablet for tablet 724cd0a99abe4ce198262517bcec75bd (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:14.241665 32673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724cd0a99abe4ce198262517bcec75bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.244709 32670 tablet_service.cc:1511] Processing CreateTablet for tablet 2a02dd9ae4d6449884969d4431ace84e (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:14.246169 32670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a02dd9ae4d6449884969d4431ace84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.250023 32669 tablet_service.cc:1511] Processing CreateTablet for tablet 901effde80d242899f45135a42b099b5 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:14.238996 32674 tablet_service.cc:1511] Processing CreateTablet for tablet 4729df9887e744f59d3316bd92853bb9 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:14.250195 32524 tablet_service.cc:1511] Processing CreateTablet for tablet 724cd0a99abe4ce198262517bcec75bd (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:14.251314 32523 tablet_service.cc:1511] Processing CreateTablet for tablet f3ba3e86b62d4207a7ba2f6b4cff32db (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:14.260156 32524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724cd0a99abe4ce198262517bcec75bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.263152 32523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ba3e86b62d4207a7ba2f6b4cff32db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.251459 32669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 901effde80d242899f45135a42b099b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.253756 32667 tablet_service.cc:1511] Processing CreateTablet for tablet 475cce04ed814c92b61b24ce9d85a218 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:14.253495 32521 tablet_service.cc:1511] Processing CreateTablet for tablet 2a02dd9ae4d6449884969d4431ace84e (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:14.255550 32519 tablet_service.cc:1511] Processing CreateTablet for tablet c3056eac2c094f41a1f91780bf6b6b15 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:14.252455 32522 tablet_service.cc:1511] Processing CreateTablet for tablet 619a8ba632134dd99dfc7c3c7f01abd3 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:14.273131 32674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4729df9887e744f59d3316bd92853bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.254503 32520 tablet_service.cc:1511] Processing CreateTablet for tablet 901effde80d242899f45135a42b099b5 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:14.274144 32667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475cce04ed814c92b61b24ce9d85a218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.274578 32521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a02dd9ae4d6449884969d4431ace84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.256958 32518 tablet_service.cc:1511] Processing CreateTablet for tablet 475cce04ed814c92b61b24ce9d85a218 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:14.277309 32520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 901effde80d242899f45135a42b099b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.252657 32668 tablet_service.cc:1511] Processing CreateTablet for tablet c3056eac2c094f41a1f91780bf6b6b15 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:14.281356 32668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3056eac2c094f41a1f91780bf6b6b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.282797 32522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619a8ba632134dd99dfc7c3c7f01abd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.284965 32519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3056eac2c094f41a1f91780bf6b6b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.286813 32518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475cce04ed814c92b61b24ce9d85a218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.299860 32601 tablet_service.cc:1511] Processing CreateTablet for tablet 6a21eb0a428640caa18addf7158c5492 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:14.301760 32601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a21eb0a428640caa18addf7158c5492. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.304500 32600 tablet_service.cc:1511] Processing CreateTablet for tablet 4729df9887e744f59d3316bd92853bb9 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:14.306732 32600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4729df9887e744f59d3316bd92853bb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.322901 32599 tablet_service.cc:1511] Processing CreateTablet for tablet 724cd0a99abe4ce198262517bcec75bd (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:14.324772 32599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 724cd0a99abe4ce198262517bcec75bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.329362 32598 tablet_service.cc:1511] Processing CreateTablet for tablet f3ba3e86b62d4207a7ba2f6b4cff32db (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:14.332240 32598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3ba3e86b62d4207a7ba2f6b4cff32db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.336022 32726 tablet_bootstrap.cc:492] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:14.343811 32597 tablet_service.cc:1511] Processing CreateTablet for tablet 619a8ba632134dd99dfc7c3c7f01abd3 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:14.345250 32597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619a8ba632134dd99dfc7c3c7f01abd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.352224 32596 tablet_service.cc:1511] Processing CreateTablet for tablet 2a02dd9ae4d6449884969d4431ace84e (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:14.353946 32596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a02dd9ae4d6449884969d4431ace84e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.357583 32595 tablet_service.cc:1511] Processing CreateTablet for tablet 901effde80d242899f45135a42b099b5 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:14.359598 32595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 901effde80d242899f45135a42b099b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.367086 32594 tablet_service.cc:1511] Processing CreateTablet for tablet c3056eac2c094f41a1f91780bf6b6b15 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:14.368621 32594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3056eac2c094f41a1f91780bf6b6b15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.370194 32726 tablet_bootstrap.cc:654] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.373395 32593 tablet_service.cc:1511] Processing CreateTablet for tablet 475cce04ed814c92b61b24ce9d85a218 (DEFAULT_TABLE table=test-workload [id=306373b02cf14e309bc81baab2d68dbd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:14.374789 32593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475cce04ed814c92b61b24ce9d85a218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:14.379705 32725 tablet_bootstrap.cc:492] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:14.430140 32725 tablet_bootstrap.cc:654] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.431640 32726 tablet_bootstrap.cc:492] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:14.432219 32726 ts_tablet_manager.cc:1403] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.096s	user 0.028s	sys 0.013s
I20260709 12:20:14.437110 32726 raft_consensus.cc:359] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:14.438006 32728 tablet_bootstrap.cc:492] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:14.438396 32726 raft_consensus.cc:385] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.438894 32726 raft_consensus.cc:740] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.439433 32725 tablet_bootstrap.cc:492] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:14.440080 32725 ts_tablet_manager.cc:1403] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.007s
I20260709 12:20:14.439973 32726 consensus_queue.cc:260] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:14.443396 32561 heartbeater.cc:499] Master 127.22.48.62:36333 was elected leader, sending a full tablet report...
I20260709 12:20:14.443974 32726 ts_tablet_manager.cc:1434] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:20:14.443810 32725 raft_consensus.cc:359] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:14.444599 32725 raft_consensus.cc:385] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.444897 32725 raft_consensus.cc:740] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.445052 32726 tablet_bootstrap.cc:492] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:14.446244 32728 tablet_bootstrap.cc:654] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.445787 32725 consensus_queue.cc:260] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:14.452450 32726 tablet_bootstrap.cc:654] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.453351 32710 heartbeater.cc:499] Master 127.22.48.62:36333 was elected leader, sending a full tablet report...
I20260709 12:20:14.453991 32725 ts_tablet_manager.cc:1434] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:20:14.455096 32725 tablet_bootstrap.cc:492] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:14.464123 32725 tablet_bootstrap.cc:654] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.468720 32728 tablet_bootstrap.cc:492] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:14.469301 32728 ts_tablet_manager.cc:1403] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.005s
I20260709 12:20:14.469734 32726 tablet_bootstrap.cc:492] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:14.470269 32726 ts_tablet_manager.cc:1403] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.016s
I20260709 12:20:14.472664 32728 raft_consensus.cc:359] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.473071 32726 raft_consensus.cc:359] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.473819 32726 raft_consensus.cc:385] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.474185 32726 raft_consensus.cc:740] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.474982 32726 consensus_queue.cc:260] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.473455 32728 raft_consensus.cc:385] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.476089 32728 raft_consensus.cc:740] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.477241 32726 ts_tablet_manager.cc:1434] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:14.477079 32728 consensus_queue.cc:260] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.478268 32726 tablet_bootstrap.cc:492] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:14.483734 32725 tablet_bootstrap.cc:492] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:14.484877 32725 ts_tablet_manager.cc:1403] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.001s
I20260709 12:20:14.486474 32726 tablet_bootstrap.cc:654] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.487830 32725 raft_consensus.cc:359] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.488595 32725 raft_consensus.cc:385] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.488900 32725 raft_consensus.cc:740] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.491211 32636 heartbeater.cc:499] Master 127.22.48.62:36333 was elected leader, sending a full tablet report...
I20260709 12:20:14.491851 32728 ts_tablet_manager.cc:1434] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.004s
I20260709 12:20:14.492000 32726 tablet_bootstrap.cc:492] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:14.492491 32726 ts_tablet_manager.cc:1403] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:20:14.492980 32728 tablet_bootstrap.cc:492] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:14.489815 32725 consensus_queue.cc:260] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.495479 32726 raft_consensus.cc:359] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.495913 32725 ts_tablet_manager.cc:1434] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:20:14.496297 32726 raft_consensus.cc:385] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.496691 32726 raft_consensus.cc:740] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.497061 32725 tablet_bootstrap.cc:492] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:14.497521 32726 consensus_queue.cc:260] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.499645 32728 tablet_bootstrap.cc:654] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.502249 32726 ts_tablet_manager.cc:1434] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:20:14.503712 32726 tablet_bootstrap.cc:492] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:14.504189 32725 tablet_bootstrap.cc:654] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.511194 32728 tablet_bootstrap.cc:492] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:14.511668 32726 tablet_bootstrap.cc:654] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.511828 32728 ts_tablet_manager.cc:1403] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:20:14.515928 32728 raft_consensus.cc:359] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.516712 32728 raft_consensus.cc:385] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.517042 32728 raft_consensus.cc:740] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.518180 32728 consensus_queue.cc:260] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.521377 32728 ts_tablet_manager.cc:1434] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:20:14.522502 32728 tablet_bootstrap.cc:492] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:14.525117 32725 tablet_bootstrap.cc:492] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:14.525718 32725 ts_tablet_manager.cc:1403] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.004s
I20260709 12:20:14.528446 32728 tablet_bootstrap.cc:654] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.528625 32726 tablet_bootstrap.cc:492] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:14.529213 32726 ts_tablet_manager.cc:1403] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 12:20:14.529600 32725 raft_consensus.cc:359] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.530475 32725 raft_consensus.cc:385] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.530817 32725 raft_consensus.cc:740] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.532514 32735 raft_consensus.cc:493] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.532450 32726 raft_consensus.cc:359] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.533377 32726 raft_consensus.cc:385] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.533154 32735 raft_consensus.cc:515] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.533674 32726 raft_consensus.cc:740] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.534608 32726 consensus_queue.cc:260] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.537247 32726 ts_tablet_manager.cc:1434] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:20:14.538345 32726 tablet_bootstrap.cc:492] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:14.540113 32728 tablet_bootstrap.cc:492] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:14.540683 32728 ts_tablet_manager.cc:1403] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 12:20:14.543812 32728 raft_consensus.cc:359] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:14.544646 32728 raft_consensus.cc:385] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.544993 32728 raft_consensus.cc:740] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.545594 32735 leader_election.cc:290] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.546808 32726 tablet_bootstrap.cc:654] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.547662 32728 consensus_queue.cc:260] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:14.550216 32728 ts_tablet_manager.cc:1434] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:20:14.531778 32725 consensus_queue.cc:260] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.551280 32728 tablet_bootstrap.cc:492] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:14.557152 32725 ts_tablet_manager.cc:1434] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.003s
I20260709 12:20:14.558211 32725 tablet_bootstrap.cc:492] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:14.558858 32728 tablet_bootstrap.cc:654] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.562112 32732 raft_consensus.cc:493] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.562829 32732 raft_consensus.cc:515] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:14.578045 32732 leader_election.cc:290] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:14.601151 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:14.604611 32725 tablet_bootstrap.cc:654] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.605683 32728 tablet_bootstrap.cc:492] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
W20260709 12:20:14.604328 32574 leader_election.cc:343] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:14.606352 32726 tablet_bootstrap.cc:492] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:14.606577 32728 ts_tablet_manager.cc:1403] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.056s	user 0.025s	sys 0.019s
I20260709 12:20:14.606873 32726 ts_tablet_manager.cc:1403] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.069s	user 0.023s	sys 0.031s
I20260709 12:20:14.610562 32728 raft_consensus.cc:359] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.611440 32728 raft_consensus.cc:385] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.611850 32728 raft_consensus.cc:740] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.612612 32726 raft_consensus.cc:359] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.612811 32728 consensus_queue.cc:260] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.613724 32726 raft_consensus.cc:385] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.615916 32728 ts_tablet_manager.cc:1434] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:14.617069 32728 tablet_bootstrap.cc:492] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:14.614182 32726 raft_consensus.cc:740] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.621286 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a21eb0a428640caa18addf7158c5492" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:14.622189 32536 raft_consensus.cc:2468] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:14.622308 32726 consensus_queue.cc:260] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.625355 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:14.626598 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a21eb0a428640caa18addf7158c5492" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:14.627067 32536 raft_consensus.cc:2468] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:14.627503 32611 raft_consensus.cc:2468] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:14.629282 32651 leader_election.cc:304] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:14.629905 32577 leader_election.cc:304] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:14.630235 32732 raft_consensus.cc:2804] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:14.633159 32732 raft_consensus.cc:493] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.633394 32735 raft_consensus.cc:2804] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:14.633553 32732 raft_consensus.cc:3060] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.633832 32735 raft_consensus.cc:493] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.631246 32726 ts_tablet_manager.cc:1434] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 12:20:14.634181 32735 raft_consensus.cc:3060] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.641703 32732 raft_consensus.cc:515] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:14.644865 32732 leader_election.cc:290] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:14.644866 32726 tablet_bootstrap.cc:492] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:14.646124 32735 raft_consensus.cc:515] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.647805 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a21eb0a428640caa18addf7158c5492" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:14.648530 32536 raft_consensus.cc:3060] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.649860 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:14.650630 32535 raft_consensus.cc:3060] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.654735 32726 tablet_bootstrap.cc:654] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.657886 32536 raft_consensus.cc:2468] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:14.660224 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a21eb0a428640caa18addf7158c5492" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:14.630240 32728 tablet_bootstrap.cc:654] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.661055 32611 raft_consensus.cc:3060] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.667193 32725 tablet_bootstrap.cc:492] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:14.667829 32725 ts_tablet_manager.cc:1403] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.110s	user 0.030s	sys 0.027s
I20260709 12:20:14.667961 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:14.670218 32611 raft_consensus.cc:2468] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
W20260709 12:20:14.670466 32574 leader_election.cc:343] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:14.670997 32725 raft_consensus.cc:359] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.671897 32725 raft_consensus.cc:385] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.672245 32725 raft_consensus.cc:740] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.673058 32725 consensus_queue.cc:260] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.673544 32535 raft_consensus.cc:2468] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 1.
I20260709 12:20:14.675901 32577 leader_election.cc:304] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:14.676723 32726 tablet_bootstrap.cc:492] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:14.677331 32725 ts_tablet_manager.cc:1434] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:20:14.677278 32726 ts_tablet_manager.cc:1403] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.000s
I20260709 12:20:14.678423 32725 tablet_bootstrap.cc:492] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:14.674268 32735 leader_election.cc:290] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.660264 32651 leader_election.cc:304] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:14.680989 32735 raft_consensus.cc:2804] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:14.683125 32732 raft_consensus.cc:2804] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:14.680850 32726 raft_consensus.cc:359] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.684005 32735 raft_consensus.cc:697] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:14.684228 32726 raft_consensus.cc:385] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.684791 32726 raft_consensus.cc:740] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.687633 32732 raft_consensus.cc:697] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:14.687919 32752 raft_consensus.cc:493] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.688417 32752 raft_consensus.cc:515] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.688651 32732 consensus_queue.cc:237] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:14.690593 32752 leader_election.cc:290] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:14.685395 32735 consensus_queue.cc:237] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.691774 32726 consensus_queue.cc:260] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.693697 32728 tablet_bootstrap.cc:492] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:14.698654 32725 tablet_bootstrap.cc:654] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.698853 32728 ts_tablet_manager.cc:1403] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.016s
I20260709 12:20:14.702391 32728 raft_consensus.cc:359] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.693884 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:14.705438 32728 raft_consensus.cc:385] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.706017 32728 raft_consensus.cc:740] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.707630 32726 ts_tablet_manager.cc:1434] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.006s
I20260709 12:20:14.708299 32432 catalog_manager.cc:5697] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.709585 32726 tablet_bootstrap.cc:492] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:14.708119 32728 consensus_queue.cc:260] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.716928 32728 ts_tablet_manager.cc:1434] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
W20260709 12:20:14.717816 32482 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:14.718614 32611 raft_consensus.cc:2468] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:14.693514 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:14.722935 32535 raft_consensus.cc:2468] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:14.724380 32726 tablet_bootstrap.cc:654] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.724347 32651 leader_election.cc:304] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:14.725504 32732 raft_consensus.cc:2804] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:14.725907 32732 raft_consensus.cc:493] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.726226 32732 raft_consensus.cc:3060] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.718825 32728 tablet_bootstrap.cc:492] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:14.735836 32732 raft_consensus.cc:515] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.737414 32726 tablet_bootstrap.cc:492] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:14.738152 32726 ts_tablet_manager.cc:1403] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.005s
I20260709 12:20:14.741384 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:14.742107 32535 raft_consensus.cc:3060] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.742209 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:14.743309 32611 raft_consensus.cc:3060] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.743837 32726 raft_consensus.cc:359] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.744683 32726 raft_consensus.cc:385] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.744988 32726 raft_consensus.cc:740] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.745733 32726 consensus_queue.cc:260] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.748159 32726 ts_tablet_manager.cc:1434] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:14.740285 32750 raft_consensus.cc:493] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.749198 32750 raft_consensus.cc:515] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.751446 32750 leader_election.cc:290] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.751736 32535 raft_consensus.cc:2468] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:14.739946 32732 leader_election.cc:290] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:14.753774 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:14.738137 32725 tablet_bootstrap.cc:492] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:14.754487 32651 leader_election.cc:304] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:14.754873 32725 ts_tablet_manager.cc:1403] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.016s
I20260709 12:20:14.754928 32726 tablet_bootstrap.cc:492] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:14.755299 32732 raft_consensus.cc:2804] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:20:14.755870 32577 leader_election.cc:343] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:14.756093 32732 raft_consensus.cc:697] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:14.752935 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:14.752148 32611 raft_consensus.cc:2468] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:14.756843 32685 raft_consensus.cc:2468] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:14.758065 32725 raft_consensus.cc:359] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.758152 32574 leader_election.cc:304] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 27e27502ef8e4f22828983a842faab70
I20260709 12:20:14.761322 32730 raft_consensus.cc:493] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.765491 32725 raft_consensus.cc:385] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.765879 32725 raft_consensus.cc:740] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.765717 32730 raft_consensus.cc:515] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.766839 32725 consensus_queue.cc:260] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.764623 32732 consensus_queue.cc:237] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.768581 32730 leader_election.cc:290] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.762605 32728 tablet_bootstrap.cc:654] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.767386 32726 tablet_bootstrap.cc:654] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.769798 32750 raft_consensus.cc:2804] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:14.770530 32750 raft_consensus.cc:493] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.771023 32750 raft_consensus.cc:3060] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.771981 32434 catalog_manager.cc:5697] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.786655 32725 ts_tablet_manager.cc:1434] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.005s
I20260709 12:20:14.787832 32725 tablet_bootstrap.cc:492] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:14.796547 32725 tablet_bootstrap.cc:654] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.797091 32750 raft_consensus.cc:515] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.800524 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:14.801688 32735 raft_consensus.cc:493] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.802791 32735 raft_consensus.cc:515] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
W20260709 12:20:14.803788 32502 leader_election.cc:343] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:14.805029 32735 leader_election.cc:290] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.806208 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "901effde80d242899f45135a42b099b5" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:14.806921 32685 raft_consensus.cc:2468] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:14.808174 32574 leader_election.cc:304] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:14.809120 32750 leader_election.cc:290] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.809777 32750 raft_consensus.cc:2804] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:14.810144 32750 raft_consensus.cc:493] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.811470 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "901effde80d242899f45135a42b099b5" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:14.812211 32535 raft_consensus.cc:2468] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:14.811230 32750 raft_consensus.cc:3060] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.812912 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
W20260709 12:20:14.814410 32577 leader_election.cc:343] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:14.814985 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:14.815586 32685 raft_consensus.cc:3060] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.812295 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
W20260709 12:20:14.819932 32499 leader_election.cc:343] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:14.820538 32499 leader_election.cc:304] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27e27502ef8e4f22828983a842faab70; no voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2
I20260709 12:20:14.821596 32730 raft_consensus.cc:2749] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:14.820235 32431 catalog_manager.cc:5697] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.822961 32750 raft_consensus.cc:515] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.824628 32725 tablet_bootstrap.cc:492] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:14.825146 32725 ts_tablet_manager.cc:1403] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.011s
I20260709 12:20:14.825237 32726 tablet_bootstrap.cc:492] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:14.825798 32726 ts_tablet_manager.cc:1403] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.071s	user 0.013s	sys 0.000s
I20260709 12:20:14.826033 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "901effde80d242899f45135a42b099b5" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:14.826682 32536 raft_consensus.cc:3060] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.828579 32726 raft_consensus.cc:359] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.829154 32728 tablet_bootstrap.cc:492] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:14.830950 32750 leader_election.cc:290] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.832022 32728 ts_tablet_manager.cc:1403] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.011s
I20260709 12:20:14.832135 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "901effde80d242899f45135a42b099b5" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:14.832788 32684 raft_consensus.cc:3060] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.833560 32536 raft_consensus.cc:2468] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 1.
I20260709 12:20:14.829301 32726 raft_consensus.cc:385] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.834434 32726 raft_consensus.cc:740] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.828979 32725 raft_consensus.cc:359] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.834697 32577 leader_election.cc:304] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:14.835181 32725 raft_consensus.cc:385] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.835539 32725 raft_consensus.cc:740] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.830399 32685 raft_consensus.cc:2468] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 1.
I20260709 12:20:14.835906 32750 raft_consensus.cc:2804] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:14.837045 32574 leader_election.cc:304] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 27e27502ef8e4f22828983a842faab70
I20260709 12:20:14.837242 32750 raft_consensus.cc:697] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:14.837862 32735 raft_consensus.cc:2804] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:14.838429 32725 consensus_queue.cc:260] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.839553 32726 consensus_queue.cc:260] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.840754 32684 raft_consensus.cc:2468] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 1.
I20260709 12:20:14.841460 32726 ts_tablet_manager.cc:1434] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:20:14.841156 32750 consensus_queue.cc:237] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.842439 32726 tablet_bootstrap.cc:492] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:14.847993 32725 ts_tablet_manager.cc:1434] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:20:14.849100 32725 tablet_bootstrap.cc:492] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:14.851495 32735 raft_consensus.cc:697] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:14.851411 32728 raft_consensus.cc:359] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.852342 32728 raft_consensus.cc:385] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.852607 32728 raft_consensus.cc:740] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.852581 32735 consensus_queue.cc:237] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.853699 32728 consensus_queue.cc:260] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.856376 32728 ts_tablet_manager.cc:1434] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:20:14.857496 32728 tablet_bootstrap.cc:492] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:14.859372 32725 tablet_bootstrap.cc:654] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.862958 32432 catalog_manager.cc:5697] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.864573 32728 tablet_bootstrap.cc:654] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.865034 32726 tablet_bootstrap.cc:654] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.873579 32728 tablet_bootstrap.cc:492] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:14.874367 32728 ts_tablet_manager.cc:1403] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 12:20:14.877753 32726 tablet_bootstrap.cc:492] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:14.877460 32728 raft_consensus.cc:359] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.883942 32726 ts_tablet_manager.cc:1403] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.004s
I20260709 12:20:14.883783 32728 raft_consensus.cc:385] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.884613 32728 raft_consensus.cc:740] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.881412 32431 catalog_manager.cc:5697] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:14.885347 32728 consensus_queue.cc:260] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.887071 32726 raft_consensus.cc:359] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.887524 32728 ts_tablet_manager.cc:1434] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:20:14.887867 32726 raft_consensus.cc:385] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.888273 32726 raft_consensus.cc:740] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.888586 32725 tablet_bootstrap.cc:492] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:14.889171 32725 ts_tablet_manager.cc:1403] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.012s
I20260709 12:20:14.889549 32728 tablet_bootstrap.cc:492] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:14.889103 32726 consensus_queue.cc:260] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.891959 32726 ts_tablet_manager.cc:1434] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:20:14.892333 32725 raft_consensus.cc:359] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.893119 32725 raft_consensus.cc:385] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.893457 32725 raft_consensus.cc:740] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.894408 32725 consensus_queue.cc:260] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.896381 32728 tablet_bootstrap.cc:654] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.903751 32725 ts_tablet_manager.cc:1434] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:20:14.905346 32725 tablet_bootstrap.cc:492] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:14.909523 32732 raft_consensus.cc:493] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.910143 32732 raft_consensus.cc:515] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.913386 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724cd0a99abe4ce198262517bcec75bd" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:14.913712 32725 tablet_bootstrap.cc:654] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.914031 32728 tablet_bootstrap.cc:492] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:14.914585 32728 ts_tablet_manager.cc:1403] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.007s
I20260709 12:20:14.915292 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724cd0a99abe4ce198262517bcec75bd" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:14.914070 32732 leader_election.cc:290] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:14.914070 32536 raft_consensus.cc:2468] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:14.917359 32651 leader_election.cc:304] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:14.917827 32728 raft_consensus.cc:359] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.916000 32611 raft_consensus.cc:2468] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:14.918625 32728 raft_consensus.cc:385] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.918128 32732 raft_consensus.cc:2804] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:14.918939 32725 tablet_bootstrap.cc:492] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:14.919269 32732 raft_consensus.cc:493] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.919555 32725 ts_tablet_manager.cc:1403] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.007s
I20260709 12:20:14.919745 32732 raft_consensus.cc:3060] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.918941 32728 raft_consensus.cc:740] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.920994 32728 consensus_queue.cc:260] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.923220 32728 ts_tablet_manager.cc:1434] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:14.923977 32730 raft_consensus.cc:493] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.924196 32728 tablet_bootstrap.cc:492] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:14.924511 32730 raft_consensus.cc:515] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.925931 32752 raft_consensus.cc:493] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.926440 32752 raft_consensus.cc:515] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.926765 32730 leader_election.cc:290] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.927999 32732 raft_consensus.cc:515] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.928488 32752 leader_election.cc:290] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:14.929159 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619a8ba632134dd99dfc7c3c7f01abd3" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:14.929294 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619a8ba632134dd99dfc7c3c7f01abd3" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:14.929819 32611 raft_consensus.cc:2468] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:14.929968 32732 leader_election.cc:290] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
W20260709 12:20:14.931397 32499 leader_election.cc:343] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:14.931886 32725 raft_consensus.cc:359] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.932543 32725 raft_consensus.cc:385] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.932667 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a02dd9ae4d6449884969d4431ace84e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:14.932862 32725 raft_consensus.cc:740] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.932971 32610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a02dd9ae4d6449884969d4431ace84e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:14.933370 32536 raft_consensus.cc:2468] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:14.933717 32610 raft_consensus.cc:2468] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:14.933768 32725 consensus_queue.cc:260] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.934760 32651 leader_election.cc:304] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:14.934842 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724cd0a99abe4ce198262517bcec75bd" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:14.935770 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724cd0a99abe4ce198262517bcec75bd" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:14.936066 32535 raft_consensus.cc:3060] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.936251 32725 ts_tablet_manager.cc:1434] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:20:14.936421 32609 raft_consensus.cc:3060] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.937247 32725 tablet_bootstrap.cc:492] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:14.939689 32732 raft_consensus.cc:2804] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:14.940088 32732 raft_consensus.cc:493] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.940440 32732 raft_consensus.cc:3060] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.936287 32502 leader_election.cc:304] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:14.943661 32730 raft_consensus.cc:2804] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:14.944015 32730 raft_consensus.cc:493] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.944360 32730 raft_consensus.cc:3060] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.947376 32725 tablet_bootstrap.cc:654] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.947781 32732 raft_consensus.cc:515] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.949962 32535 raft_consensus.cc:2468] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:14.935782 32728 tablet_bootstrap.cc:654] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:14.951371 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a02dd9ae4d6449884969d4431ace84e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:14.952004 32609 raft_consensus.cc:2468] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:14.952162 32536 raft_consensus.cc:3060] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.954784 32730 raft_consensus.cc:515] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.957836 32730 leader_election.cc:290] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:14.958413 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619a8ba632134dd99dfc7c3c7f01abd3" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:14.959231 32684 raft_consensus.cc:3060] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.960378 32651 leader_election.cc:304] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:14.960961 32725 tablet_bootstrap.cc:492] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:14.961606 32725 ts_tablet_manager.cc:1403] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.004s
I20260709 12:20:14.964931 32732 leader_election.cc:290] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:14.966019 32536 raft_consensus.cc:2468] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:14.966646 32732 raft_consensus.cc:2804] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:14.967696 32651 leader_election.cc:304] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:14.968609 32751 raft_consensus.cc:2804] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:14.968684 32725 raft_consensus.cc:359] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.969121 32751 raft_consensus.cc:697] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:14.969395 32725 raft_consensus.cc:385] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.969659 32725 raft_consensus.cc:740] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.969987 32751 consensus_queue.cc:237] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.970384 32725 consensus_queue.cc:260] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.971181 32732 raft_consensus.cc:697] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:14.972339 32732 consensus_queue.cc:237] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.972628 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a02dd9ae4d6449884969d4431ace84e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:14.973603 32611 raft_consensus.cc:3060] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.976982 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619a8ba632134dd99dfc7c3c7f01abd3" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:14.977640 32609 raft_consensus.cc:3060] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:14.979528 32728 tablet_bootstrap.cc:492] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:14.980212 32728 ts_tablet_manager.cc:1403] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.006s
I20260709 12:20:14.982592 32611 raft_consensus.cc:2468] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:14.983089 32684 raft_consensus.cc:2468] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:14.984439 32499 leader_election.cc:304] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:14.985356 32730 raft_consensus.cc:2804] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:14.986796 32730 raft_consensus.cc:697] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:14.989485 32732 raft_consensus.cc:493] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.990135 32730 consensus_queue.cc:237] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.991609 32728 raft_consensus.cc:359] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.992313 32728 raft_consensus.cc:385] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:14.992564 32728 raft_consensus.cc:740] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:14.992806 32725 ts_tablet_manager.cc:1434] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 12:20:14.993208 32728 consensus_queue.cc:260] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.994853 32728 ts_tablet_manager.cc:1434] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 12:20:14.990003 32732 raft_consensus.cc:515] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:14.994998 32434 catalog_manager.cc:5697] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:14.997298 32732 leader_election.cc:290] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:14.999819 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:15.000737 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:15.001648 32536 raft_consensus.cc:2393] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in current term 1: Already voted for candidate e266205d640345fdacc14a10ad7321f2 in this term.
I20260709 12:20:15.005898 32651 leader_election.cc:304] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2
I20260709 12:20:15.007599 32609 raft_consensus.cc:2468] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:15.008316 32751 raft_consensus.cc:3060] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:15.018605 32751 raft_consensus.cc:2749] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:15.020869 32432 catalog_manager.cc:5697] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.026324 32434 catalog_manager.cc:5697] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:15.155181 32730 raft_consensus.cc:493] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.155817 32730 raft_consensus.cc:515] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.156785 32751 raft_consensus.cc:493] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.157224 32751 raft_consensus.cc:515] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.157600 32730 leader_election.cc:290] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:15.158628 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:15.158771 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:15.159483 32684 raft_consensus.cc:2393] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27e27502ef8e4f22828983a842faab70 in current term 1: Already voted for candidate e266205d640345fdacc14a10ad7321f2 in this term.
I20260709 12:20:15.159601 32751 leader_election.cc:290] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:15.160604 32499 leader_election.cc:304] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27e27502ef8e4f22828983a842faab70; no voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2
I20260709 12:20:15.161391 32730 raft_consensus.cc:3060] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:15.161422 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:15.162321 32609 raft_consensus.cc:2468] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:15.162297 32751 consensus_queue.cc:1048] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:15.162551 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:15.163492 32536 raft_consensus.cc:2468] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:15.163589 32651 leader_election.cc:304] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:15.164455 32751 raft_consensus.cc:2804] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:15.164894 32751 raft_consensus.cc:493] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.165263 32751 raft_consensus.cc:3060] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:15.170068 32730 raft_consensus.cc:2749] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:15.175551 32752 consensus_queue.cc:1048] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:15.188370 32751 raft_consensus.cc:515] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.191004 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:15.191607 32536 raft_consensus.cc:3060] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:15.193480 32751 leader_election.cc:290] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:15.194563 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:15.195168 32609 raft_consensus.cc:3060] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:15.198949 32536 raft_consensus.cc:2468] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:15.200037 32651 leader_election.cc:304] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:15.200700 32751 raft_consensus.cc:2804] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:15.201172 32751 raft_consensus.cc:697] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:15.201988 32609 raft_consensus.cc:2468] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:15.201977 32751 consensus_queue.cc:237] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.209607 32434 catalog_manager.cc:5697] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:15.231364 32735 consensus_queue.cc:1048] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.242784 32735 consensus_queue.cc:1048] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.276244 32751 consensus_queue.cc:1048] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.287215 32752 consensus_queue.cc:1048] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.306989 32735 consensus_queue.cc:1048] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.317783 32750 consensus_queue.cc:1048] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.364265 32684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a21eb0a428640caa18addf7158c5492"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
mode: GRACEFUL
new_leader_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:43974
I20260709 12:20:15.364818 32684 raft_consensus.cc:606] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Received request to transfer leadership to TS 27e27502ef8e4f22828983a842faab70
I20260709 12:20:15.367198 32752 consensus_queue.cc:1048] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.382743 32751 consensus_queue.cc:1048] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.382781 32609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
mode: GRACEFUL
new_leader_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:20:15.387082 32609 raft_consensus.cc:606] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Received request to transfer leadership to TS 27e27502ef8e4f22828983a842faab70
I20260709 12:20:15.388264 32750 consensus_queue.cc:1048] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.398221 32684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "724cd0a99abe4ce198262517bcec75bd"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
mode: GRACEFUL
new_leader_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:43974
I20260709 12:20:15.399068 32684 raft_consensus.cc:606] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Received request to transfer leadership to TS 27e27502ef8e4f22828983a842faab70
I20260709 12:20:15.406936 32684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
mode: GRACEFUL
new_leader_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:43974
I20260709 12:20:15.407547 32684 raft_consensus.cc:606] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Received request to transfer leadership to TS 27e27502ef8e4f22828983a842faab70
I20260709 12:20:15.410821 32750 consensus_queue.cc:1048] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:15.431366 32732 consensus_queue.cc:1048] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.439251 32730 consensus_queue.cc:1048] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.442485 32535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "619a8ba632134dd99dfc7c3c7f01abd3"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
mode: GRACEFUL
new_leader_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:48428
I20260709 12:20:15.443091 32535 raft_consensus.cc:606] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Received request to transfer leadership to TS e266205d640345fdacc14a10ad7321f2
I20260709 12:20:15.448607 32752 raft_consensus.cc:993] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3: : Instructing follower 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:15.449051 32752 raft_consensus.cc:1081] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Signalling peer 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:15.451015 32685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a02dd9ae4d6449884969d4431ace84e"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
mode: GRACEFUL
new_leader_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:43974
I20260709 12:20:15.453671 32685 raft_consensus.cc:606] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Received request to transfer leadership to TS e266205d640345fdacc14a10ad7321f2
I20260709 12:20:15.453758 32535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "724cd0a99abe4ce198262517bcec75bd"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:48426
I20260709 12:20:15.454437 32535 raft_consensus.cc:493] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.454807 32535 raft_consensus.cc:3060] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.454753 32752 consensus_queue.cc:1048] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:15.457762 32730 raft_consensus.cc:993] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70: : Instructing follower e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:15.458246 32730 raft_consensus.cc:1081] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Signalling peer e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:15.459954 32610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "619a8ba632134dd99dfc7c3c7f01abd3"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:20:15.460498 32610 raft_consensus.cc:493] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.460850 32610 raft_consensus.cc:3060] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.462215 32535 raft_consensus.cc:515] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.466120   311 consensus_queue.cc:1048] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.466636 32608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724cd0a99abe4ce198262517bcec75bd" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:15.467629 32535 leader_election.cc:290] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:15.468825 32610 raft_consensus.cc:515] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.469734 32611 raft_consensus.cc:1240] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Rejecting Update request from peer 27e27502ef8e4f22828983a842faab70 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:15.470242 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "724cd0a99abe4ce198262517bcec75bd" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:15.470925 32685 raft_consensus.cc:3055] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.471292 32685 raft_consensus.cc:740] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:15.471589 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619a8ba632134dd99dfc7c3c7f01abd3" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:15.472203 32535 raft_consensus.cc:3055] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.472147 32685 consensus_queue.cc:260] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.472769 32535 raft_consensus.cc:740] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:15.472707 32683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619a8ba632134dd99dfc7c3c7f01abd3" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:15.473294 32685 raft_consensus.cc:3060] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.473778 32535 consensus_queue.cc:260] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.474818 32535 raft_consensus.cc:3060] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.480611 32685 raft_consensus.cc:2468] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:15.473322 32610 leader_election.cc:290] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:15.481760 32499 leader_election.cc:304] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: e266205d640345fdacc14a10ad7321f2
I20260709 12:20:15.482681   311 raft_consensus.cc:2804] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.483150   311 raft_consensus.cc:697] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:15.483951   311 consensus_queue.cc:237] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.487749 32535 raft_consensus.cc:2468] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:15.489106 32577 leader_election.cc:304] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:15.489936 32750 raft_consensus.cc:2804] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.490478 32750 raft_consensus.cc:697] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:15.491281 32750 consensus_queue.cc:237] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.491583 32685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
mode: GRACEFUL
new_leader_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:43974
I20260709 12:20:15.492213 32685 raft_consensus.cc:606] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Received request to transfer leadership to TS e266205d640345fdacc14a10ad7321f2
I20260709 12:20:15.499135 32611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
mode: GRACEFUL
new_leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:20:15.499765 32611 raft_consensus.cc:606] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Received request to transfer leadership to TS 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:15.499215 32433 catalog_manager.cc:5697] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 1 to 2, leader changed from 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3) to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.507948 32434 catalog_manager.cc:5697] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 1 to 2, leader changed from 27e27502ef8e4f22828983a842faab70 (127.22.48.1) to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.645372 32752 consensus_queue.cc:1048] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.651903 32751 raft_consensus.cc:993] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3: : Instructing follower e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:15.652495 32732 raft_consensus.cc:1081] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Signalling peer e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:15.656881 32610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:56992
I20260709 12:20:15.657526 32610 raft_consensus.cc:493] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.657930 32610 raft_consensus.cc:3060] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.658883 32751 consensus_queue.cc:1048] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:15.666715 32610 raft_consensus.cc:515] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.669782 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:15.670152 32610 leader_election.cc:290] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:15.670483 32536 raft_consensus.cc:3060] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.670817 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3056eac2c094f41a1f91780bf6b6b15" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:15.671413 32685 raft_consensus.cc:3055] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.671720 32685 raft_consensus.cc:740] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:15.672539 32685 consensus_queue.cc:260] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.673821 32685 raft_consensus.cc:3060] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.678084 32536 raft_consensus.cc:2468] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:15.681052 32685 raft_consensus.cc:2468] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:15.681357 32577 leader_election.cc:304] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:15.682279 32750 raft_consensus.cc:2804] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.682812 32750 raft_consensus.cc:697] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:15.683557 32750 consensus_queue.cc:237] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.690266 32433 catalog_manager.cc:5697] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 1 to 2, leader changed from 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3) to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.696786 32752 raft_consensus.cc:993] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3: : Instructing follower 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:15.697360 32751 raft_consensus.cc:1081] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Signalling peer 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:15.698876 32536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a21eb0a428640caa18addf7158c5492"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:48426
I20260709 12:20:15.699378 32536 raft_consensus.cc:493] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.699683 32536 raft_consensus.cc:3060] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.704492 32536 raft_consensus.cc:515] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:15.706168 32536 leader_election.cc:290] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Requested vote from peers 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:15.706916 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a21eb0a428640caa18addf7158c5492" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:15.707341 32610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a21eb0a428640caa18addf7158c5492" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:15.707504 32685 raft_consensus.cc:3055] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.708010 32685 raft_consensus.cc:740] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:15.708009 32610 raft_consensus.cc:3060] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.709304 32685 consensus_queue.cc:260] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:15.710731 32685 raft_consensus.cc:3060] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.711841 32767 raft_consensus.cc:993] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2: : Instructing follower 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:15.712337 32750 raft_consensus.cc:1081] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Signalling peer 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:15.714138 32536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:20:15.714766 32536 raft_consensus.cc:493] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.715173 32536 raft_consensus.cc:3060] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.716517 32610 raft_consensus.cc:2468] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:15.717623 32502 leader_election.cc:304] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:15.718150 32685 raft_consensus.cc:2468] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:15.718353   311 raft_consensus.cc:2804] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.718945   311 raft_consensus.cc:697] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:15.719777   311 consensus_queue.cc:237] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } }
I20260709 12:20:15.721886 32536 raft_consensus.cc:515] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.724042 32536 leader_election.cc:290] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:15.726024 32610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:15.726673 32610 raft_consensus.cc:3055] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.726676 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4729df9887e744f59d3316bd92853bb9" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:15.727195 32610 raft_consensus.cc:740] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:15.727421 32685 raft_consensus.cc:3060] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.727834 32433 catalog_manager.cc:5697] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 1 to 2, leader changed from 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3) to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.728333 32610 consensus_queue.cc:260] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.729804 32610 raft_consensus.cc:3060] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.737432 32685 raft_consensus.cc:2468] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:15.737612 32610 raft_consensus.cc:2468] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:15.738729 32499 leader_election.cc:304] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:15.739583   311 raft_consensus.cc:2804] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.740096   311 raft_consensus.cc:697] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:15.740803   311 consensus_queue.cc:237] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.747164 32433 catalog_manager.cc:5697] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 1 to 2, leader changed from e266205d640345fdacc14a10ad7321f2 (127.22.48.2) to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.761125 32752 raft_consensus.cc:993] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3: : Instructing follower 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:15.761682 32751 raft_consensus.cc:1081] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Signalling peer 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:15.763365 32536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:48426
I20260709 12:20:15.763877 32536 raft_consensus.cc:493] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.764201 32536 raft_consensus.cc:3060] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.769431 32536 raft_consensus.cc:515] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.771216 32536 leader_election.cc:290] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:15.772055 32610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:15.772269 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:15.772778 32610 raft_consensus.cc:3060] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.772852 32685 raft_consensus.cc:3055] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.773300 32685 raft_consensus.cc:740] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:15.774219 32685 consensus_queue.cc:260] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.775619 32685 raft_consensus.cc:3060] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.780648 32610 raft_consensus.cc:2468] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:15.782007 32502 leader_election.cc:304] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:15.782760   311 raft_consensus.cc:2804] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.782866 32685 raft_consensus.cc:2468] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:15.783205   311 raft_consensus.cc:697] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:15.784113   311 consensus_queue.cc:237] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.790428 32433 catalog_manager.cc:5697] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 1 to 2, leader changed from 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3) to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.915490 32685 raft_consensus.cc:3060] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.921237 32685 raft_consensus.cc:1275] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:15.922873 32750 consensus_queue.cc:1048] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:15.927716 32735 raft_consensus.cc:993] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2: : Instructing follower 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:15.928184 32735 raft_consensus.cc:1081] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Signalling peer 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:15.934728 32536 raft_consensus.cc:1275] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:15.930131 32685 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:43950
I20260709 12:20:15.936424 32685 raft_consensus.cc:493] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.936897 32685 raft_consensus.cc:3060] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.937043   339 consensus_queue.cc:1048] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:15.940690 32752 raft_consensus.cc:993] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3: : Instructing follower e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:15.941217 32751 raft_consensus.cc:1081] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Signalling peer e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:15.943773 32611 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a02dd9ae4d6449884969d4431ace84e"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:56992
I20260709 12:20:15.944329 32611 raft_consensus.cc:493] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:15.944691 32611 raft_consensus.cc:3060] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.947256 32685 raft_consensus.cc:515] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.951004 32610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:15.951596 32610 raft_consensus.cc:3055] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.951931 32610 raft_consensus.cc:740] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:15.952332 32611 raft_consensus.cc:515] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.953359 32610 consensus_queue.cc:260] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.954638 32610 raft_consensus.cc:3060] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.962829 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475cce04ed814c92b61b24ce9d85a218" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:15.955602 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a02dd9ae4d6449884969d4431ace84e" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:15.955222 32685 leader_election.cc:290] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 2 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:15.966714 32536 raft_consensus.cc:3060] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.966850 32535 raft_consensus.cc:3060] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.974438 32610 raft_consensus.cc:2468] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 2.
I20260709 12:20:15.955629 32611 leader_election.cc:290] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:15.955521 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a02dd9ae4d6449884969d4431ace84e" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:15.974992 32535 raft_consensus.cc:2468] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:15.982239 32651 leader_election.cc:304] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:15.982111 32684 raft_consensus.cc:3055] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:15.982492 32685 raft_consensus.cc:1275] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:15.977339 32536 raft_consensus.cc:2468] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 2.
I20260709 12:20:15.983253 32577 leader_election.cc:304] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:15.983611 32732 raft_consensus.cc:2804] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.984143 32732 raft_consensus.cc:697] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:15.984163   339 raft_consensus.cc:2804] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:15.984261   311 consensus_queue.cc:1048] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:15.985003   339 raft_consensus.cc:697] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:15.985122 32732 consensus_queue.cc:237] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.985951   339 consensus_queue.cc:237] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.983613 32684 raft_consensus.cc:740] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:15.988417 32684 consensus_queue.cc:260] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:15.989876 32684 raft_consensus.cc:3060] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.994060 32434 catalog_manager.cc:5697] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 1 to 2, leader changed from e266205d640345fdacc14a10ad7321f2 (127.22.48.2) to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:15.995915 32432 catalog_manager.cc:5697] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 1 to 2, leader changed from 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3) to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.997385 32611 raft_consensus.cc:3060] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:15.998104 32684 raft_consensus.cc:2468] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:16.008891 32611 raft_consensus.cc:1275] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.011093   340 consensus_queue.cc:1048] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:16.069334 32536 raft_consensus.cc:1275] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.070606   339 consensus_queue.cc:1048] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.078446 32684 raft_consensus.cc:1275] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.079931   339 consensus_queue.cc:1048] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.189848 32611 raft_consensus.cc:1275] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.191310   340 consensus_queue.cc:1048] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.198874 32684 raft_consensus.cc:1275] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.200516   311 consensus_queue.cc:1048] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.273658 32611 raft_consensus.cc:1275] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.275082   311 consensus_queue.cc:1048] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.279213 32610 raft_consensus.cc:1275] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.280476 32730 consensus_queue.cc:1048] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.285876 32684 raft_consensus.cc:1275] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.287595   311 consensus_queue.cc:1048] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.291540 32685 raft_consensus.cc:1275] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.293196   311 consensus_queue.cc:1048] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.367573 32611 raft_consensus.cc:1275] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.368790 32732 consensus_queue.cc:1048] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.376992 32536 raft_consensus.cc:1275] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.378931 32751 consensus_queue.cc:1048] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.472671 32536 raft_consensus.cc:1275] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.474077   339 consensus_queue.cc:1048] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:16.482640 32684 raft_consensus.cc:1275] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:16.484382 32735 consensus_queue.cc:1048] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:18.525545 32434 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40184:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:18.527609 32434 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:18.579574 32524 tablet_service.cc:1511] Processing CreateTablet for tablet 66cb17cbb1e840f98a56d0c2a1ced715 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:18.580902 32524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cb17cbb1e840f98a56d0c2a1ced715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.580577 32594 tablet_service.cc:1511] Processing CreateTablet for tablet 66cb17cbb1e840f98a56d0c2a1ced715 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:18.581887 32594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cb17cbb1e840f98a56d0c2a1ced715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.581918 32674 tablet_service.cc:1511] Processing CreateTablet for tablet 66cb17cbb1e840f98a56d0c2a1ced715 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:18.583274 32674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66cb17cbb1e840f98a56d0c2a1ced715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.583576 32518 tablet_service.cc:1511] Processing CreateTablet for tablet e240cd7966dc46fc8f900cc0548786aa (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:18.584807 32518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e240cd7966dc46fc8f900cc0548786aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.602222 32596 tablet_service.cc:1511] Processing CreateTablet for tablet e240cd7966dc46fc8f900cc0548786aa (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:18.603660 32596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e240cd7966dc46fc8f900cc0548786aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.607646   363 tablet_bootstrap.cc:492] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:18.607355 32521 tablet_service.cc:1511] Processing CreateTablet for tablet 3d799e4cc18641988761aa8a41bd0643 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:18.609117 32521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d799e4cc18641988761aa8a41bd0643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.609225 32600 tablet_service.cc:1511] Processing CreateTablet for tablet 3d799e4cc18641988761aa8a41bd0643 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:18.610728 32600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d799e4cc18641988761aa8a41bd0643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.610569 32671 tablet_service.cc:1511] Processing CreateTablet for tablet e240cd7966dc46fc8f900cc0548786aa (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:18.611793 32671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e240cd7966dc46fc8f900cc0548786aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.612912 32673 tablet_service.cc:1511] Processing CreateTablet for tablet 3d799e4cc18641988761aa8a41bd0643 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:18.614153 32673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d799e4cc18641988761aa8a41bd0643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.615383 32520 tablet_service.cc:1511] Processing CreateTablet for tablet d2f1df79384e4f5cacee888edc1ee170 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:18.616607 32520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f1df79384e4f5cacee888edc1ee170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.635092 32675 tablet_service.cc:1511] Processing CreateTablet for tablet d2f1df79384e4f5cacee888edc1ee170 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:18.636642 32675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f1df79384e4f5cacee888edc1ee170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.636669 32597 tablet_service.cc:1511] Processing CreateTablet for tablet d2f1df79384e4f5cacee888edc1ee170 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:18.638069 32597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f1df79384e4f5cacee888edc1ee170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.639443 32518 tablet_service.cc:1511] Processing CreateTablet for tablet c576040c5a7a4ee295fca399dced0e17 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:18.640914 32518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c576040c5a7a4ee295fca399dced0e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.649917 32599 tablet_service.cc:1511] Processing CreateTablet for tablet c576040c5a7a4ee295fca399dced0e17 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:18.651304 32599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c576040c5a7a4ee295fca399dced0e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.652582 32668 tablet_service.cc:1511] Processing CreateTablet for tablet c576040c5a7a4ee295fca399dced0e17 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:18.654100 32668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c576040c5a7a4ee295fca399dced0e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.655967 32519 tablet_service.cc:1511] Processing CreateTablet for tablet a633b05b54344db5974cadb530575816 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:18.659610 32594 tablet_service.cc:1511] Processing CreateTablet for tablet a633b05b54344db5974cadb530575816 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:18.660872 32594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a633b05b54344db5974cadb530575816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.670969 32519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a633b05b54344db5974cadb530575816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.675304 32669 tablet_service.cc:1511] Processing CreateTablet for tablet a633b05b54344db5974cadb530575816 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:18.676651 32669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a633b05b54344db5974cadb530575816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.677641 32524 tablet_service.cc:1511] Processing CreateTablet for tablet 7de01da730504c2da056361e5c14058a (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:18.677930 32598 tablet_service.cc:1511] Processing CreateTablet for tablet 7de01da730504c2da056361e5c14058a (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:18.678951 32524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de01da730504c2da056361e5c14058a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.679272 32598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de01da730504c2da056361e5c14058a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.679107 32667 tablet_service.cc:1511] Processing CreateTablet for tablet 7de01da730504c2da056361e5c14058a (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:18.680367 32667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de01da730504c2da056361e5c14058a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.667505   364 tablet_bootstrap.cc:492] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:18.706887 32521 tablet_service.cc:1511] Processing CreateTablet for tablet 906fe0149dc446eaa5cfe6252e47447e (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:18.708259 32521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906fe0149dc446eaa5cfe6252e47447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.710091 32596 tablet_service.cc:1511] Processing CreateTablet for tablet 906fe0149dc446eaa5cfe6252e47447e (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:18.713004 32596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906fe0149dc446eaa5cfe6252e47447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.728466 32674 tablet_service.cc:1511] Processing CreateTablet for tablet 906fe0149dc446eaa5cfe6252e47447e (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:18.731443   365 tablet_bootstrap.cc:492] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:18.734460 32524 tablet_service.cc:1511] Processing CreateTablet for tablet ebfc6699bf214884bc52dd6f077a08f3 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:18.716688   363 tablet_bootstrap.cc:654] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.723055   364 tablet_bootstrap.cc:654] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.740633 32524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfc6699bf214884bc52dd6f077a08f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.738735 32599 tablet_service.cc:1511] Processing CreateTablet for tablet ebfc6699bf214884bc52dd6f077a08f3 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:18.745226 32599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfc6699bf214884bc52dd6f077a08f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.748040   365 tablet_bootstrap.cc:654] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.739187 32673 tablet_service.cc:1511] Processing CreateTablet for tablet ebfc6699bf214884bc52dd6f077a08f3 (DEFAULT_TABLE table=soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:18.749045 32674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 906fe0149dc446eaa5cfe6252e47447e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:18.752672 32673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebfc6699bf214884bc52dd6f077a08f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:18.763352 32482 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:18.767822   364 tablet_bootstrap.cc:492] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:18.768358   364 ts_tablet_manager.cc:1403] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.101s	user 0.007s	sys 0.005s
I20260709 12:20:18.775923   365 tablet_bootstrap.cc:492] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:18.776083   364 raft_consensus.cc:359] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.776677   365 ts_tablet_manager.cc:1403] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.006s
I20260709 12:20:18.776925   364 raft_consensus.cc:385] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.777258   364 raft_consensus.cc:740] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.779999   364 consensus_queue.cc:260] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.780224   365 raft_consensus.cc:359] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.781240   365 raft_consensus.cc:385] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.781587   365 raft_consensus.cc:740] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.783454   365 consensus_queue.cc:260] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.784096   363 tablet_bootstrap.cc:492] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:18.784675   363 ts_tablet_manager.cc:1403] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.177s	user 0.018s	sys 0.027s
I20260709 12:20:18.787658   363 raft_consensus.cc:359] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.788388   363 raft_consensus.cc:385] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.788666   363 raft_consensus.cc:740] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.789580   365 ts_tablet_manager.cc:1434] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:20:18.789300   363 consensus_queue.cc:260] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.791702   363 ts_tablet_manager.cc:1434] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:18.792214   364 ts_tablet_manager.cc:1434] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:20:18.792637   363 tablet_bootstrap.cc:492] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:18.793242   364 tablet_bootstrap.cc:492] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:18.795154   365 tablet_bootstrap.cc:492] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:18.799896   363 tablet_bootstrap.cc:654] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.799994   364 tablet_bootstrap.cc:654] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.802361   365 tablet_bootstrap.cc:654] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.814706 32730 raft_consensus.cc:493] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.815480 32730 raft_consensus.cc:515] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.820111 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cb17cbb1e840f98a56d0c2a1ced715" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:18.823909 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cb17cbb1e840f98a56d0c2a1ced715" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:18.824823 32611 raft_consensus.cc:2468] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:18.821578 32684 raft_consensus.cc:2468] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:18.829679 32502 leader_election.cc:304] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:18.820686 32730 leader_election.cc:290] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:18.846686 32730 raft_consensus.cc:2804] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:18.847285 32730 raft_consensus.cc:493] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.847786 32730 raft_consensus.cc:3060] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:18.892194 32502 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.48.2:40289, user_credentials={real_user=slave}} blocked reactor thread for 62639us
I20260709 12:20:18.924515 32730 raft_consensus.cc:515] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.928669   364 tablet_bootstrap.cc:492] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:18.928998   365 tablet_bootstrap.cc:492] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:18.929183   363 tablet_bootstrap.cc:492] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:18.929342   364 ts_tablet_manager.cc:1403] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.136s	user 0.034s	sys 0.089s
I20260709 12:20:18.929559   365 ts_tablet_manager.cc:1403] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.135s	user 0.050s	sys 0.079s
I20260709 12:20:18.929736   363 ts_tablet_manager.cc:1403] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.137s	user 0.048s	sys 0.081s
I20260709 12:20:18.929495 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cb17cbb1e840f98a56d0c2a1ced715" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:18.930419 32611 raft_consensus.cc:3060] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.932945   364 raft_consensus.cc:359] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.933324   363 raft_consensus.cc:359] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.933584 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66cb17cbb1e840f98a56d0c2a1ced715" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:18.933749   364 raft_consensus.cc:385] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.934041   363 raft_consensus.cc:385] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.934223 32684 raft_consensus.cc:3060] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:18.934466   363 raft_consensus.cc:740] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.934681 32730 leader_election.cc:290] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:18.934237   364 raft_consensus.cc:740] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.935326   363 consensus_queue.cc:260] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.937745   363 ts_tablet_manager.cc:1434] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:20:18.938130 32611 raft_consensus.cc:2468] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:18.940510   365 raft_consensus.cc:359] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.938921   363 tablet_bootstrap.cc:492] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:18.939743   364 consensus_queue.cc:260] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.941252   365 raft_consensus.cc:385] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.942219   365 raft_consensus.cc:740] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.943426   364 ts_tablet_manager.cc:1434] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.006s
I20260709 12:20:18.943128   365 consensus_queue.cc:260] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.944455   364 tablet_bootstrap.cc:492] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:18.945384   365 ts_tablet_manager.cc:1434] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:20:18.941649 32684 raft_consensus.cc:2468] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:18.941850 32502 leader_election.cc:304] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:18.947652 32730 raft_consensus.cc:2804] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:18.948294 32730 raft_consensus.cc:697] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:18.949095 32730 consensus_queue.cc:237] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.946424   365 tablet_bootstrap.cc:492] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:18.953577   364 tablet_bootstrap.cc:654] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.958079   365 tablet_bootstrap.cc:654] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.961755   363 tablet_bootstrap.cc:654] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.965680   364 tablet_bootstrap.cc:492] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:18.966336   364 ts_tablet_manager.cc:1403] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 12:20:18.970652   364 raft_consensus.cc:359] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.971490   364 raft_consensus.cc:385] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.971796   364 raft_consensus.cc:740] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.972566   364 consensus_queue.cc:260] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.974299   364 ts_tablet_manager.cc:1434] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:20:18.974498   363 tablet_bootstrap.cc:492] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:18.975132   363 ts_tablet_manager.cc:1403] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.003s
I20260709 12:20:18.975291   364 tablet_bootstrap.cc:492] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:18.978714   363 raft_consensus.cc:359] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.979661   363 raft_consensus.cc:385] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:18.980022   363 raft_consensus.cc:740] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:18.981387   363 consensus_queue.cc:260] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:18.983323   364 tablet_bootstrap.cc:654] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:18.988876   363 ts_tablet_manager.cc:1434] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:20:18.990347   363 tablet_bootstrap.cc:492] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:18.995751   364 tablet_bootstrap.cc:492] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:18.996326   364 ts_tablet_manager.cc:1403] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.012s
I20260709 12:20:18.999044 32730 raft_consensus.cc:493] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.999518 32730 raft_consensus.cc:515] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.002369 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e240cd7966dc46fc8f900cc0548786aa" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:19.002550 32730 leader_election.cc:290] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.002743 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e240cd7966dc46fc8f900cc0548786aa" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:19.003042 32611 raft_consensus.cc:2468] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:19.003268   365 tablet_bootstrap.cc:492] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:19.003448 32684 raft_consensus.cc:2468] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:19.003772   365 ts_tablet_manager.cc:1403] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.023s
I20260709 12:20:19.002516   364 raft_consensus.cc:359] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.004493 32502 leader_election.cc:304] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.004725   364 raft_consensus.cc:385] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.005214   364 raft_consensus.cc:740] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.005383 32730 raft_consensus.cc:2804] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.001855   363 tablet_bootstrap.cc:654] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.005780 32730 raft_consensus.cc:493] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.006454 32730 raft_consensus.cc:3060] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.006027   364 consensus_queue.cc:260] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.007189   365 raft_consensus.cc:359] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.008005   365 raft_consensus.cc:385] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.008313   365 raft_consensus.cc:740] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.008463   364 ts_tablet_manager.cc:1434] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:20:19.009649   364 tablet_bootstrap.cc:492] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:19.009255   365 consensus_queue.cc:260] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.011960   365 ts_tablet_manager.cc:1434] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:20:19.012866   365 tablet_bootstrap.cc:492] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:19.016206 32434 catalog_manager.cc:5697] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.019726   364 tablet_bootstrap.cc:654] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.021047   365 tablet_bootstrap.cc:654] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.030891   363 tablet_bootstrap.cc:492] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:19.031438   363 ts_tablet_manager.cc:1403] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.002s
I20260709 12:20:19.033937 32730 raft_consensus.cc:515] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.034442   363 raft_consensus.cc:359] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.035175   363 raft_consensus.cc:385] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.035488   363 raft_consensus.cc:740] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.036219   363 consensus_queue.cc:260] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.037428 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e240cd7966dc46fc8f900cc0548786aa" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:19.038050 32611 raft_consensus.cc:3060] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.031454   365 tablet_bootstrap.cc:492] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:19.038794   365 ts_tablet_manager.cc:1403] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.010s
I20260709 12:20:19.041831   365 raft_consensus.cc:359] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.042521   365 raft_consensus.cc:385] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.042791   365 raft_consensus.cc:740] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.043617   365 consensus_queue.cc:260] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.044798   363 ts_tablet_manager.cc:1434] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:20:19.045851   363 tablet_bootstrap.cc:492] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:19.052516   363 tablet_bootstrap.cc:654] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.054620   365 ts_tablet_manager.cc:1434] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:20:19.055704   365 tablet_bootstrap.cc:492] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:19.062079   365 tablet_bootstrap.cc:654] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.074882 32730 leader_election.cc:290] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.077731   363 tablet_bootstrap.cc:492] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:19.077888 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e240cd7966dc46fc8f900cc0548786aa" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.078372   363 ts_tablet_manager.cc:1403] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.005s
I20260709 12:20:19.078600 32684 raft_consensus.cc:3060] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.079520   364 tablet_bootstrap.cc:492] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:19.080049   364 ts_tablet_manager.cc:1403] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.071s	user 0.027s	sys 0.030s
I20260709 12:20:19.081753   363 raft_consensus.cc:359] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.082571   363 raft_consensus.cc:385] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.082873   363 raft_consensus.cc:740] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.083035   364 raft_consensus.cc:359] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.083813   364 raft_consensus.cc:385] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.084192   364 raft_consensus.cc:740] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.083689   363 consensus_queue.cc:260] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.084947   364 consensus_queue.cc:260] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.086499 32684 raft_consensus.cc:2468] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:19.087745   364 ts_tablet_manager.cc:1434] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:19.087831 32499 leader_election.cc:304] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:19.088802 32730 raft_consensus.cc:2804] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.089126 32611 raft_consensus.cc:2468] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:19.089270 32730 raft_consensus.cc:697] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:19.090128 32730 consensus_queue.cc:237] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.091199   364 tablet_bootstrap.cc:492] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:19.092233   365 tablet_bootstrap.cc:492] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:19.092725   365 ts_tablet_manager.cc:1403] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.011s
I20260709 12:20:19.095840   363 ts_tablet_manager.cc:1434] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:20:19.098300   364 tablet_bootstrap.cc:654] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.097705   365 raft_consensus.cc:359] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.099793   365 raft_consensus.cc:385] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.100096   365 raft_consensus.cc:740] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.101002   363 tablet_bootstrap.cc:492] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:19.100848   365 consensus_queue.cc:260] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.112399   365 ts_tablet_manager.cc:1434] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.005s
I20260709 12:20:19.113512   365 tablet_bootstrap.cc:492] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:19.113672 32433 catalog_manager.cc:5697] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.115581   364 tablet_bootstrap.cc:492] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:19.116194   364 ts_tablet_manager.cc:1403] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.025s	user 0.024s	sys 0.000s
I20260709 12:20:19.120577   365 tablet_bootstrap.cc:654] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.124536   363 tablet_bootstrap.cc:654] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.124701   364 raft_consensus.cc:359] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.125941   364 raft_consensus.cc:385] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.126411   364 raft_consensus.cc:740] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.128726   364 consensus_queue.cc:260] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.130888   364 ts_tablet_manager.cc:1434] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 12:20:19.131863   364 tablet_bootstrap.cc:492] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:19.136543   365 tablet_bootstrap.cc:492] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:19.136726   363 tablet_bootstrap.cc:492] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:19.137094   365 ts_tablet_manager.cc:1403] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.003s
I20260709 12:20:19.138048   363 ts_tablet_manager.cc:1403] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.006s
I20260709 12:20:19.137552   364 tablet_bootstrap.cc:654] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.140748   363 raft_consensus.cc:359] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.141498   363 raft_consensus.cc:385] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.141814   363 raft_consensus.cc:740] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.142634   365 raft_consensus.cc:359] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.142598   363 consensus_queue.cc:260] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.143638   365 raft_consensus.cc:385] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.144096   365 raft_consensus.cc:740] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.144150   364 tablet_bootstrap.cc:492] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:19.145038   364 ts_tablet_manager.cc:1403] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:20:19.144941   365 consensus_queue.cc:260] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.147208   365 ts_tablet_manager.cc:1434] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:20:19.148197   365 tablet_bootstrap.cc:492] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:19.148639   364 raft_consensus.cc:359] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.149420   364 raft_consensus.cc:385] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.149718   364 raft_consensus.cc:740] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.151805   364 consensus_queue.cc:260] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.153514   363 ts_tablet_manager.cc:1434] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:20:19.156596   364 ts_tablet_manager.cc:1434] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 12:20:19.157675   364 tablet_bootstrap.cc:492] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:19.161201   365 tablet_bootstrap.cc:654] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.161695   363 tablet_bootstrap.cc:492] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:19.164661   364 tablet_bootstrap.cc:654] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.172791   363 tablet_bootstrap.cc:654] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.180610   364 tablet_bootstrap.cc:492] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:19.181097   364 ts_tablet_manager.cc:1403] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.011s
I20260709 12:20:19.181216   363 tablet_bootstrap.cc:492] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:19.181744   363 ts_tablet_manager.cc:1403] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.006s
I20260709 12:20:19.184265   364 raft_consensus.cc:359] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.185065   364 raft_consensus.cc:385] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.185349   364 raft_consensus.cc:740] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.184755   363 raft_consensus.cc:359] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.186033   363 raft_consensus.cc:385] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.186506   363 raft_consensus.cc:740] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.186066   364 consensus_queue.cc:260] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.188118   365 tablet_bootstrap.cc:492] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:19.188362   364 ts_tablet_manager.cc:1434] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:19.188596   365 ts_tablet_manager.cc:1403] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.018s
I20260709 12:20:19.188864   363 consensus_queue.cc:260] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.191407   363 ts_tablet_manager.cc:1434] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:20:19.191578   365 raft_consensus.cc:359] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.189554   364 tablet_bootstrap.cc:492] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70: Bootstrap starting.
I20260709 12:20:19.192332   365 raft_consensus.cc:385] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.192507   363 tablet_bootstrap.cc:492] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:19.192687   365 raft_consensus.cc:740] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.193500   365 consensus_queue.cc:260] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.195772   365 ts_tablet_manager.cc:1434] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:19.196883   365 tablet_bootstrap.cc:492] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:19.200147   363 tablet_bootstrap.cc:654] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.203114   365 tablet_bootstrap.cc:654] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.214336   365 tablet_bootstrap.cc:492] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:19.214840   365 ts_tablet_manager.cc:1403] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:20:19.217031   366 raft_consensus.cc:493] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.217458   365 raft_consensus.cc:359] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.217893   364 tablet_bootstrap.cc:654] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.218240   365 raft_consensus.cc:385] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.217825   366 raft_consensus.cc:515] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.218669   365 raft_consensus.cc:740] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.219463   365 consensus_queue.cc:260] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.221536   365 ts_tablet_manager.cc:1434] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:20:19.222143 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de01da730504c2da056361e5c14058a" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:19.222879   365 tablet_bootstrap.cc:492] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3: Bootstrap starting.
I20260709 12:20:19.222887 32535 raft_consensus.cc:2468] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:19.223796 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de01da730504c2da056361e5c14058a" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:19.224648 32684 raft_consensus.cc:2468] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:19.226431 32574 leader_election.cc:304] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.227907   367 raft_consensus.cc:2804] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.228470   367 raft_consensus.cc:493] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.228950   367 raft_consensus.cc:3060] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.229539   365 tablet_bootstrap.cc:654] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.238505   366 leader_election.cc:290] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.243049   365 tablet_bootstrap.cc:492] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3: No bootstrap required, opened a new log
I20260709 12:20:19.243567   365 ts_tablet_manager.cc:1403] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.010s
I20260709 12:20:19.245823   365 raft_consensus.cc:359] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.246418   365 raft_consensus.cc:385] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.246675   365 raft_consensus.cc:740] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.247328   365 consensus_queue.cc:260] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.249044   365 ts_tablet_manager.cc:1434] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:20:19.253237 32730 raft_consensus.cc:493] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.253717 32730 raft_consensus.cc:515] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.252708   367 raft_consensus.cc:515] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.254897   364 tablet_bootstrap.cc:492] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70: No bootstrap required, opened a new log
I20260709 12:20:19.255270   363 tablet_bootstrap.cc:492] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:19.255362   364 ts_tablet_manager.cc:1403] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70: Time spent bootstrapping tablet: real 0.066s	user 0.011s	sys 0.001s
I20260709 12:20:19.255807 32730 leader_election.cc:290] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.255838   363 ts_tablet_manager.cc:1403] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.064s	user 0.040s	sys 0.016s
I20260709 12:20:19.257480 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de01da730504c2da056361e5c14058a" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:19.258108 32535 raft_consensus.cc:3060] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.258322 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633b05b54344db5974cadb530575816" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:19.258260   364 raft_consensus.cc:359] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.259153   364 raft_consensus.cc:385] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.259042   363 raft_consensus.cc:359] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.259196 32611 raft_consensus.cc:2468] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:19.259629   364 raft_consensus.cc:740] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.259809   363 raft_consensus.cc:385] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.260129   363 raft_consensus.cc:740] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.260401   364 consensus_queue.cc:260] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.260727   363 consensus_queue.cc:260] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.262705 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de01da730504c2da056361e5c14058a" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.263072   364 ts_tablet_manager.cc:1434] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:19.263370 32684 raft_consensus.cc:3060] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.263741   363 ts_tablet_manager.cc:1434] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:19.264777   363 tablet_bootstrap.cc:492] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2: Bootstrap starting.
I20260709 12:20:19.264648 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633b05b54344db5974cadb530575816" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:19.265599 32685 raft_consensus.cc:2468] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:19.270635 32502 leader_election.cc:304] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.271802   375 raft_consensus.cc:2804] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.272150   375 raft_consensus.cc:493] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.272464   375 raft_consensus.cc:3060] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.272900 32730 raft_consensus.cc:493] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.273459 32730 raft_consensus.cc:515] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.275543 32730 leader_election.cc:290] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.275876   363 tablet_bootstrap.cc:654] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:19.277716 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c576040c5a7a4ee295fca399dced0e17" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:19.279860   367 leader_election.cc:290] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.280157 32611 raft_consensus.cc:2468] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:19.282946 32502 leader_election.cc:304] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.283164 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c576040c5a7a4ee295fca399dced0e17" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:19.284129 32535 raft_consensus.cc:2468] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 1.
I20260709 12:20:19.286352 32730 raft_consensus.cc:2804] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.286756 32730 raft_consensus.cc:493] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.287110 32730 raft_consensus.cc:3060] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.285178 32684 raft_consensus.cc:2468] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 1.
I20260709 12:20:19.288152 32577 leader_election.cc:304] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.282526   398 raft_consensus.cc:493] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.289070   363 tablet_bootstrap.cc:492] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2: No bootstrap required, opened a new log
I20260709 12:20:19.289228   367 raft_consensus.cc:2804] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.289600   363 ts_tablet_manager.cc:1403] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 12:20:19.289323   398 raft_consensus.cc:515] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.290010   350 raft_consensus.cc:493] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.290524   350 raft_consensus.cc:515] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.291595   398 leader_election.cc:290] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.292541   350 leader_election.cc:290] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:19.292464   363 raft_consensus.cc:359] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.293247   363 raft_consensus.cc:385] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:19.293210 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:19.293767   363 raft_consensus.cc:740] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Initialized, Role: FOLLOWER
I20260709 12:20:19.294019 32684 raft_consensus.cc:2468] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:19.289785   367 raft_consensus.cc:697] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:19.294488   363 consensus_queue.cc:260] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.295113 32574 leader_election.cc:304] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.295567   367 consensus_queue.cc:237] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.296136 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:19.296531   363 ts_tablet_manager.cc:1434] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:20:19.296850 32611 raft_consensus.cc:2468] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:19.297053 32730 raft_consensus.cc:515] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.298079 32651 leader_election.cc:304] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.299331   350 raft_consensus.cc:2804] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.299681   350 raft_consensus.cc:493] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.299729 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c576040c5a7a4ee295fca399dced0e17" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:19.299914 32730 leader_election.cc:290] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.299868 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:19.300376 32611 raft_consensus.cc:3060] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.300659 32535 raft_consensus.cc:2468] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:19.301712 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:19.300993   350 raft_consensus.cc:3060] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.302453 32536 raft_consensus.cc:2468] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 0.
I20260709 12:20:19.305013 32683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c576040c5a7a4ee295fca399dced0e17" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.296159   398 raft_consensus.cc:2804] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.308005   398 raft_consensus.cc:493] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.302574 32685 raft_consensus.cc:2468] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:19.308302 32611 raft_consensus.cc:2468] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:19.308313   398 raft_consensus.cc:3060] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.309643 32502 leader_election.cc:304] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:19.310874 32730 raft_consensus.cc:2804] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.311573 32730 raft_consensus.cc:697] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:19.312427 32730 consensus_queue.cc:237] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.284909   375 raft_consensus.cc:515] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.316362   398 raft_consensus.cc:515] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.318099   375 leader_election.cc:290] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.318411 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633b05b54344db5974cadb530575816" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:19.319124 32611 raft_consensus.cc:3060] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.320056 32432 catalog_manager.cc:5697] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.325430 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633b05b54344db5974cadb530575816" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.326185 32685 raft_consensus.cc:3060] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.327360   375 raft_consensus.cc:493] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.327844   375 raft_consensus.cc:515] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.330009 32611 raft_consensus.cc:2468] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:19.332603 32502 leader_election.cc:304] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.333489   374 raft_consensus.cc:2804] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.325453   350 raft_consensus.cc:515] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.335127 32685 raft_consensus.cc:2468] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:19.337651   374 raft_consensus.cc:697] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:19.339103   350 leader_election.cc:290] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:19.338732   374 consensus_queue.cc:237] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.341794 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:19.342308 32611 raft_consensus.cc:3060] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.341419 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:19.344691 32536 raft_consensus.cc:3060] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.346553   375 leader_election.cc:290] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.350327 32611 raft_consensus.cc:2468] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:19.348492 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:19.351861 32685 raft_consensus.cc:2468] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:19.352046   398 leader_election.cc:290] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.353613 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:19.353892 32499 leader_election.cc:304] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:19.354226 32535 raft_consensus.cc:3060] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.354715 32651 leader_election.cc:304] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.354967 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.355592 32685 raft_consensus.cc:3060] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.356001   398 raft_consensus.cc:493] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.356490   398 raft_consensus.cc:515] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.358626   350 raft_consensus.cc:2804] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.359398 32534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70" is_pre_election: true
I20260709 12:20:19.360301 32534 raft_consensus.cc:2468] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:19.360320 32683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:19.359094   398 leader_election.cc:290] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.360983 32683 raft_consensus.cc:2468] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 0.
I20260709 12:20:19.362154 32577 leader_election.cc:304] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.362869   375 raft_consensus.cc:2804] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.363070   398 raft_consensus.cc:2804] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.363988   398 raft_consensus.cc:493] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.353225 32432 catalog_manager.cc:5697] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.364424   398 raft_consensus.cc:3060] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.364976 32536 raft_consensus.cc:2468] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 1.
I20260709 12:20:19.361445   350 raft_consensus.cc:697] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:19.365592 32685 raft_consensus.cc:2468] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 1.
I20260709 12:20:19.363276   375 raft_consensus.cc:493] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.366830 32574 leader_election.cc:304] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.367223   375 raft_consensus.cc:3060] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.367769   367 raft_consensus.cc:2804] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.368269   367 raft_consensus.cc:697] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:19.367156 32535 raft_consensus.cc:2468] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 1.
I20260709 12:20:19.369139   367 consensus_queue.cc:237] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.372092   398 raft_consensus.cc:515] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.375042   398 leader_election.cc:290] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.374974 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:19.365991   350 consensus_queue.cc:237] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.376022 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.376662 32685 raft_consensus.cc:3060] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.379501 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:19.380241 32611 raft_consensus.cc:2393] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 27e27502ef8e4f22828983a842faab70 in current term 1: Already voted for candidate e266205d640345fdacc14a10ad7321f2 in this term.
I20260709 12:20:19.383111   375 raft_consensus.cc:515] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.384244 32535 raft_consensus.cc:2393] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e266205d640345fdacc14a10ad7321f2 in current term 1: Already voted for candidate 27e27502ef8e4f22828983a842faab70 in this term.
I20260709 12:20:19.384650 32685 raft_consensus.cc:2468] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 1.
I20260709 12:20:19.385988 32574 leader_election.cc:304] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.387070   398 raft_consensus.cc:2804] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.387544   398 raft_consensus.cc:697] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:19.388413   398 consensus_queue.cc:237] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.390018 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:19.392010   375 leader_election.cc:290] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.394665 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.395298 32685 raft_consensus.cc:2393] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 27e27502ef8e4f22828983a842faab70 in current term 1: Already voted for candidate e266205d640345fdacc14a10ad7321f2 in this term.
I20260709 12:20:19.396179 32499 leader_election.cc:304] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 27e27502ef8e4f22828983a842faab70; no voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2
I20260709 12:20:19.396839   375 raft_consensus.cc:2749] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:19.397640 32434 catalog_manager.cc:5697] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 1 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:19.393354 32432 catalog_manager.cc:5697] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.409169 32433 catalog_manager.cc:5697] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.411713   375 raft_consensus.cc:493] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.412284   375 raft_consensus.cc:515] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.415067 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfc6699bf214884bc52dd6f077a08f3" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2" is_pre_election: true
I20260709 12:20:19.415373   375 leader_election.cc:290] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.415664 32611 raft_consensus.cc:2468] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:19.416675 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfc6699bf214884bc52dd6f077a08f3" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" is_pre_election: true
I20260709 12:20:19.416873 32502 leader_election.cc:304] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.417385 32685 raft_consensus.cc:2468] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 0.
I20260709 12:20:19.417743   375 raft_consensus.cc:2804] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:19.418136   375 raft_consensus.cc:493] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.418499   375 raft_consensus.cc:3060] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.425987 32432 catalog_manager.cc:5697] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.426575   375 raft_consensus.cc:515] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.428895   375 leader_election.cc:290] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.429878 32685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfc6699bf214884bc52dd6f077a08f3" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.429937 32611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfc6699bf214884bc52dd6f077a08f3" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:19.430503 32685 raft_consensus.cc:3060] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.430578 32611 raft_consensus.cc:3060] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.436215 32611 raft_consensus.cc:2468] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:19.437084 32502 leader_election.cc:304] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.437690   375 raft_consensus.cc:2804] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:19.437645 32685 raft_consensus.cc:2468] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 1.
I20260709 12:20:19.438480   375 raft_consensus.cc:697] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:19.439324   375 consensus_queue.cc:237] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.441727   374 consensus_queue.cc:1048] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.448200 32432 catalog_manager.cc:5697] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 0 to 1, leader changed from <none> to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 1 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.461719   374 consensus_queue.cc:1048] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.485631   374 consensus_queue.cc:1048] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.499994   374 consensus_queue.cc:1048] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.515420 32610 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
mode: GRACEFUL
new_leader_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:20:19.516069 32610 raft_consensus.cc:606] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Received request to transfer leadership to TS 27e27502ef8e4f22828983a842faab70
I20260709 12:20:19.522493 32611 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
mode: GRACEFUL
new_leader_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:57008
I20260709 12:20:19.523044 32611 raft_consensus.cc:606] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Received request to transfer leadership to TS 27e27502ef8e4f22828983a842faab70
I20260709 12:20:19.528482 32535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c576040c5a7a4ee295fca399dced0e17"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
mode: GRACEFUL
new_leader_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:48428
I20260709 12:20:19.529104 32535 raft_consensus.cc:606] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Received request to transfer leadership to TS e266205d640345fdacc14a10ad7321f2
I20260709 12:20:19.534017 32535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a633b05b54344db5974cadb530575816"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
mode: GRACEFUL
new_leader_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:48428
I20260709 12:20:19.534592 32535 raft_consensus.cc:606] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Received request to transfer leadership to TS e266205d640345fdacc14a10ad7321f2
I20260709 12:20:19.541522 32685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
mode: GRACEFUL
new_leader_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:43974
I20260709 12:20:19.541996 32685 raft_consensus.cc:606] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Received request to transfer leadership to TS e266205d640345fdacc14a10ad7321f2
I20260709 12:20:19.546541 32535 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebfc6699bf214884bc52dd6f077a08f3"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
mode: GRACEFUL
new_leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:48428
I20260709 12:20:19.547079 32535 raft_consensus.cc:606] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Received request to transfer leadership to TS 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:19.694396   398 consensus_queue.cc:1048] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.709257   419 consensus_queue.cc:1048] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.741443   375 consensus_queue.cc:1048] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.748104   374 raft_consensus.cc:993] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70: : Instructing follower e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:19.748862   404 raft_consensus.cc:1081] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Signalling peer e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:19.751003 32610 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c576040c5a7a4ee295fca399dced0e17"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:20:19.751636 32610 raft_consensus.cc:493] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.752022 32610 raft_consensus.cc:3060] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.753922 32685 raft_consensus.cc:3060] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:19.754915   419 consensus_queue.cc:1048] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.761191 32610 raft_consensus.cc:515] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.762801 32611 raft_consensus.cc:1240] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Rejecting Update request from peer 27e27502ef8e4f22828983a842faab70 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:19.764330   375 consensus_queue.cc:1048] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.767472 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c576040c5a7a4ee295fca399dced0e17" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:19.768014 32536 raft_consensus.cc:3055] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.768311 32536 raft_consensus.cc:740] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:19.769001 32536 consensus_queue.cc:260] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.769843 32536 raft_consensus.cc:3060] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.771142 32684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c576040c5a7a4ee295fca399dced0e17" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.779523 32536 raft_consensus.cc:2468] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:19.780787 32577 leader_election.cc:304] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:19.781072   419 consensus_queue.cc:1048] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.781702   367 raft_consensus.cc:2804] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.782244   367 raft_consensus.cc:697] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:19.783196   367 consensus_queue.cc:237] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.790869 32610 leader_election.cc:290] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.794147 32433 catalog_manager.cc:5697] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 1 to 2, leader changed from 27e27502ef8e4f22828983a842faab70 (127.22.48.1) to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.794507   419 consensus_queue.cc:1048] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:20:19.809422   367 consensus_queue.cc:1048] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.823542   374 consensus_queue.cc:1048] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.831823   367 raft_consensus.cc:993] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2: : Instructing follower 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:19.832728   375 consensus_queue.cc:1048] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.836006   374 consensus_queue.cc:1048] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.844832   367 raft_consensus.cc:1081] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Signalling peer 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:19.853646 32536 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:20:19.854214 32536 raft_consensus.cc:493] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.854591 32536 raft_consensus.cc:3060] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.853622   398 raft_consensus.cc:993] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2: : Instructing follower 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:19.855530   398 raft_consensus.cc:1081] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Signalling peer 27e27502ef8e4f22828983a842faab70 to start an election
I20260709 12:20:19.856668   403 raft_consensus.cc:993] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70: : Instructing follower e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:19.857141   403 raft_consensus.cc:1081] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Signalling peer e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:19.860020 32609 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a633b05b54344db5974cadb530575816"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:56998
I20260709 12:20:19.861744 32609 raft_consensus.cc:493] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.862187 32609 raft_consensus.cc:3060] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.866197 32536 raft_consensus.cc:515] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.867273 32535 raft_consensus.cc:1240] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Rejecting Update request from peer e266205d640345fdacc14a10ad7321f2 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:19.870582 32536 leader_election.cc:290] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.872905 32610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:19.874627 32610 raft_consensus.cc:3055] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.875037 32610 raft_consensus.cc:740] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:19.875979 32610 consensus_queue.cc:260] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.877075 32610 raft_consensus.cc:3060] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.880404   350 consensus_queue.cc:1048] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.881223   374 raft_consensus.cc:993] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70: : Instructing follower 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:19.881136 32682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.881772   374 raft_consensus.cc:1081] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Signalling peer 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:19.881961 32682 raft_consensus.cc:3060] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.888916 32609 raft_consensus.cc:515] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.889930   374 consensus_queue.cc:1048] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:19.892711 32610 raft_consensus.cc:2468] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:19.893556 32535 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
 from {username='slave'} at 127.0.0.1:48418
I20260709 12:20:19.898829 32535 raft_consensus.cc:493] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.894611 32683 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebfc6699bf214884bc52dd6f077a08f3"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:43962
I20260709 12:20:19.899288 32535 raft_consensus.cc:3060] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.899475 32683 raft_consensus.cc:493] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.899943 32683 raft_consensus.cc:3060] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.906781 32502 leader_election.cc:304] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.907650 32682 raft_consensus.cc:2468] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:19.908627 32683 raft_consensus.cc:515] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.911098 32683 leader_election.cc:290] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 2 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:19.912140 32610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfc6699bf214884bc52dd6f077a08f3" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:19.913295   402 raft_consensus.cc:993] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3: : Instructing follower e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:19.913745   402 raft_consensus.cc:1081] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Signalling peer e266205d640345fdacc14a10ad7321f2 to start an election
I20260709 12:20:19.914772 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebfc6699bf214884bc52dd6f077a08f3" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:19.915352 32536 raft_consensus.cc:3055] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.915566   374 raft_consensus.cc:2804] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.915642 32536 raft_consensus.cc:740] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:19.916406   374 raft_consensus.cc:697] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:19.916635 32536 consensus_queue.cc:260] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.917605 32536 raft_consensus.cc:3060] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.917295   374 consensus_queue.cc:237] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.917343 32608 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
 from {username='slave'} at 127.0.0.1:56992
I20260709 12:20:19.918679 32608 raft_consensus.cc:493] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:19.919066 32608 raft_consensus.cc:3060] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.921085 32609 leader_election.cc:290] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.922703 32683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633b05b54344db5974cadb530575816" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.923606 32683 raft_consensus.cc:3060] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.933352 32683 raft_consensus.cc:2468] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:19.933518 32535 raft_consensus.cc:515] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.934676 32574 leader_election.cc:304] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.934731 32534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a633b05b54344db5974cadb530575816" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:19.939348 32534 raft_consensus.cc:3055] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.939533   398 raft_consensus.cc:2804] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.939698 32534 raft_consensus.cc:740] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:19.940203   398 raft_consensus.cc:697] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:19.940651 32534 consensus_queue.cc:260] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.941114   398 consensus_queue.cc:237] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.942075 32534 raft_consensus.cc:3060] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.946382 32535 leader_election.cc:290] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Requested vote from peers e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.947141 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:19.937796 32608 raft_consensus.cc:515] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.948024 32609 raft_consensus.cc:3055] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.948359 32610 raft_consensus.cc:1240] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Rejecting Update request from peer 8aa8a27a9003452bb4c1cfe8b7c156c3 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:19.948519 32609 raft_consensus.cc:740] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:19.951735 32609 consensus_queue.cc:260] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.953317 32609 raft_consensus.cc:3060] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.953896 32683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d799e4cc18641988761aa8a41bd0643" candidate_uuid: "27e27502ef8e4f22828983a842faab70" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.954530 32683 raft_consensus.cc:3060] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.955149 32536 raft_consensus.cc:2468] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 2.
I20260709 12:20:19.958698 32682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
I20260709 12:20:19.959297 32682 raft_consensus.cc:3055] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:19.959614 32682 raft_consensus.cc:740] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:19.956924 32534 raft_consensus.cc:2468] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:19.960363 32682 consensus_queue.cc:260] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.958076 32608 leader_election.cc:290] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3:38623)
I20260709 12:20:19.966354 32683 raft_consensus.cc:2468] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:19.967335   433 consensus_queue.cc:1048] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:19.973825 32651 leader_election.cc:304] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: e266205d640345fdacc14a10ad7321f2
I20260709 12:20:19.974643 32534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e" candidate_uuid: "e266205d640345fdacc14a10ad7321f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:19.975509   402 raft_consensus.cc:2804] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.974999 32433 catalog_manager.cc:5697] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 1 to 2, leader changed from e266205d640345fdacc14a10ad7321f2 (127.22.48.2) to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.976063 32534 raft_consensus.cc:3060] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.976089   402 raft_consensus.cc:697] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:19.977706 32682 raft_consensus.cc:3060] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:19.977401   402 consensus_queue.cc:237] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.978853 32499 leader_election.cc:304] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:19.979475 32609 raft_consensus.cc:2468] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 27e27502ef8e4f22828983a842faab70 in term 2.
I20260709 12:20:19.984588   375 raft_consensus.cc:2804] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.985083   375 raft_consensus.cc:697] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Becoming Leader. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:19.985723   375 consensus_queue.cc:237] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:19.986066 32434 catalog_manager.cc:5697] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 1 to 2, leader changed from 27e27502ef8e4f22828983a842faab70 (127.22.48.1) to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:19.992018 32534 raft_consensus.cc:2468] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:19.993603 32577 leader_election.cc:304] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:19.994468   398 raft_consensus.cc:2804] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:19.994920   398 raft_consensus.cc:697] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Becoming Leader. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:19.995703   398 consensus_queue.cc:237] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:20.002851 32682 raft_consensus.cc:2468] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e266205d640345fdacc14a10ad7321f2 in term 2.
I20260709 12:20:20.014390 32432 catalog_manager.cc:5697] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 reported cstate change: term changed from 1 to 2, leader changed from e266205d640345fdacc14a10ad7321f2 (127.22.48.2) to 27e27502ef8e4f22828983a842faab70 (127.22.48.1). New cstate: current_term: 2 leader_uuid: "27e27502ef8e4f22828983a842faab70" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.019361 32434 catalog_manager.cc:5697] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 1 to 2, leader changed from 27e27502ef8e4f22828983a842faab70 (127.22.48.1) to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:20.022435 32433 catalog_manager.cc:5697] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 reported cstate change: term changed from 1 to 2, leader changed from 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3) to e266205d640345fdacc14a10ad7321f2 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "e266205d640345fdacc14a10ad7321f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:20.275419 32682 raft_consensus.cc:3060] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.281226 32682 raft_consensus.cc:1275] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.282457   398 consensus_queue.cc:1048] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.290453 32534 raft_consensus.cc:1275] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.292135   367 consensus_queue.cc:1048] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.367472 32682 raft_consensus.cc:1275] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.368966   375 consensus_queue.cc:1048] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.377779 32609 raft_consensus.cc:1275] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.378135 32608 raft_consensus.cc:1275] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.379945   375 consensus_queue.cc:1048] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.380427   404 consensus_queue.cc:1048] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.393359 32685 raft_consensus.cc:1275] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer 27e27502ef8e4f22828983a842faab70: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.395505   375 consensus_queue.cc:1048] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.474637 32682 raft_consensus.cc:1275] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.476063   436 consensus_queue.cc:1048] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.483594 32534 raft_consensus.cc:1275] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.487054   366 consensus_queue.cc:1048] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.512055 32609 raft_consensus.cc:3060] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:20.517535 32609 raft_consensus.cc:1275] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.518850   402 consensus_queue.cc:1048] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.518926 32534 raft_consensus.cc:1275] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.521157   402 consensus_queue.cc:1048] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.533252 32682 raft_consensus.cc:1275] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.534747   366 consensus_queue.cc:1048] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:20.550734 32534 raft_consensus.cc:1275] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Refusing update from remote peer e266205d640345fdacc14a10ad7321f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:20.552150   436 consensus_queue.cc:1048] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:22.551491 32433 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40184:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:20:22.579996 32433 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:40184:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:20:22.641557 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:20:22.716784 32502 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:40289, user_credentials={real_user=slave}} blocked reactor thread for 60009.2us
W20260709 12:20:22.723812 32577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.1:46619, user_credentials={real_user=slave}} blocked reactor thread for 59878.2us
I20260709 12:20:22.881345   491 tablet.cc:1724] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:22.903716   499 tablet.cc:1724] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:22.904680   498 tablet.cc:1724] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:22.920594   479 log.cc:927] Time spent T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:22.934155   504 tablet.cc:1724] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:22.935889 32637 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:a633b05b54344db5974cadb530575816)
W20260709 12:20:22.944732   474 log.cc:927] Time spent T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260709 12:20:22.943697 32637 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:a633b05b54344db5974cadb530575816)
W20260709 12:20:22.951400 32637 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:a633b05b54344db5974cadb530575816)
I20260709 12:20:22.959312   505 tablet.cc:1724] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:22.960691   503 tablet.cc:1724] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:22.970270   497 tablet.cc:1724] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:22.998476   486 log.cc:927] Time spent T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:20:23.011363 32609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
mode: GRACEFUL
new_leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:40980
I20260709 12:20:23.012244 32609 raft_consensus.cc:606] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Received request to transfer leadership to TS 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:23.028576   500 tablet.cc:1724] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:23.045193 32502 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.48.2:40289, user_credentials={real_user=slave}} blocked reactor thread for 73107.6us
I20260709 12:20:23.006357   489 tablet.cc:1724] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.050377   513 tablet.cc:1724] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.066455   498 tablet.cc:1724] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.101698   477 raft_consensus.cc:993] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2: : Instructing follower 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:23.102336   477 raft_consensus.cc:1081] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Signalling peer 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:23.109040   505 tablet.cc:1724] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.110983 32679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:43950
I20260709 12:20:23.110530   499 tablet.cc:1724] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.111734 32679 raft_consensus.cc:493] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.112238 32679 raft_consensus.cc:3060] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.116971   497 tablet.cc:1724] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.121119   504 tablet.cc:1724] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.125176   505 tablet.cc:1724] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.126391 32679 raft_consensus.cc:515] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.123242   515 tablet.cc:1724] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.140268   499 tablet.cc:1724] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.138038   500 tablet.cc:1724] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.154814   491 tablet.cc:1724] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.168780   513 tablet.cc:1724] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.152887   514 tablet.cc:1724] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.175303 32679 leader_election.cc:290] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 3 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:23.176296 32534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:23.177138 32534 raft_consensus.cc:3060] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.151672   498 tablet.cc:1724] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.182758 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "906fe0149dc446eaa5cfe6252e47447e" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:23.183470 32609 raft_consensus.cc:3055] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:23.183821 32609 raft_consensus.cc:740] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:23.184823 32609 consensus_queue.cc:260] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.188170 32609 raft_consensus.cc:3060] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.205621   514 tablet.cc:1724] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.211882   503 tablet.cc:1724] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.215785   515 tablet.cc:1724] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.229137   503 tablet.cc:1724] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:23.233400 32534 raft_consensus.cc:2468] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 3.
I20260709 12:20:23.244107 32532 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
mode: GRACEFUL
new_leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:45722
I20260709 12:20:23.244843 32532 raft_consensus.cc:606] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Received request to transfer leadership to TS 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:23.246500 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:20:23.250214 32651 leader_election.cc:304] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:23.250783 32609 raft_consensus.cc:2468] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 3.
I20260709 12:20:23.250887 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:23.251384   438 raft_consensus.cc:2804] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:23.251931   438 raft_consensus.cc:697] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:23.252875   438 consensus_queue.cc:237] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.261651 32609 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "901effde80d242899f45135a42b099b5"
dest_uuid: "e266205d640345fdacc14a10ad7321f2"
mode: GRACEFUL
new_leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:40980
I20260709 12:20:23.262187 32609 raft_consensus.cc:606] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Received request to transfer leadership to TS 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:23.265393 32534 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db"
dest_uuid: "27e27502ef8e4f22828983a842faab70"
mode: GRACEFUL
new_leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:45722
I20260709 12:20:23.265043 32433 catalog_manager.cc:5697] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 2 to 3, leader changed from e266205d640345fdacc14a10ad7321f2 (127.22.48.2) to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 3 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.266014 32534 raft_consensus.cc:606] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Received request to transfer leadership to TS 8aa8a27a9003452bb4c1cfe8b7c156c3
I20260709 12:20:23.267588 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:23.268234 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:23.269503 32431 catalog_manager.cc:6242] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950: soft_deleted_table [id=7297d8ccb6924b188320323b02b1e7e8] alter complete (version 1)
I20260709 12:20:23.298103   441 raft_consensus.cc:993] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70: : Instructing follower 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:23.298722   512 raft_consensus.cc:1081] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Signalling peer 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:23.300210 32679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:43962
I20260709 12:20:23.300722 32679 raft_consensus.cc:493] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.301535 32679 raft_consensus.cc:3060] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.307257 32679 raft_consensus.cc:515] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.308877 32679 leader_election.cc:290] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 3 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:23.309660 32534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:23.309903 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3ba3e86b62d4207a7ba2f6b4cff32db" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:23.310333 32534 raft_consensus.cc:3055] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:23.310678 32609 raft_consensus.cc:3060] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.310721 32534 raft_consensus.cc:740] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:23.311640 32534 consensus_queue.cc:260] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.312642 32534 raft_consensus.cc:3060] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.316107 32609 raft_consensus.cc:2468] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 3.
I20260709 12:20:23.317337 32651 leader_election.cc:304] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:23.317889 32534 raft_consensus.cc:2468] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 3.
I20260709 12:20:23.318001   438 raft_consensus.cc:2804] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:23.318629   438 raft_consensus.cc:697] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:23.319587   438 consensus_queue.cc:237] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.326566 32433 catalog_manager.cc:5697] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 2 to 3, leader changed from 27e27502ef8e4f22828983a842faab70 (127.22.48.1) to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 3 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.332482   477 raft_consensus.cc:993] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2: : Instructing follower 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:23.333290   475 raft_consensus.cc:1081] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Signalling peer 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:23.335184 32679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "901effde80d242899f45135a42b099b5"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:43950
I20260709 12:20:23.336090 32679 raft_consensus.cc:493] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.336405 32679 raft_consensus.cc:3060] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.342962 32679 raft_consensus.cc:515] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.344581 32679 leader_election.cc:290] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 2 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:23.345242 32534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "901effde80d242899f45135a42b099b5" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:23.345579 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "901effde80d242899f45135a42b099b5" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:23.345984 32534 raft_consensus.cc:3060] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.346163 32609 raft_consensus.cc:3055] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:23.346555 32609 raft_consensus.cc:740] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e266205d640345fdacc14a10ad7321f2, State: Running, Role: LEADER
I20260709 12:20:23.347396 32609 consensus_queue.cc:260] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.348714 32609 raft_consensus.cc:3060] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:23.353344 32534 raft_consensus.cc:2468] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 2.
I20260709 12:20:23.354487 32651 leader_election.cc:304] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 27e27502ef8e4f22828983a842faab70, 8aa8a27a9003452bb4c1cfe8b7c156c3; no voters: 
I20260709 12:20:23.355291   438 raft_consensus.cc:2804] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:23.355688   438 raft_consensus.cc:697] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:23.355806 32609 raft_consensus.cc:2468] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 2.
I20260709 12:20:23.356659   438 consensus_queue.cc:237] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.366765 32433 catalog_manager.cc:5697] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 1 to 2, leader changed from e266205d640345fdacc14a10ad7321f2 (127.22.48.2) to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 2 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.408084   441 raft_consensus.cc:993] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70: : Instructing follower 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:23.408584   512 raft_consensus.cc:1081] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Signalling peer 8aa8a27a9003452bb4c1cfe8b7c156c3 to start an election
I20260709 12:20:23.410115 32679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170"
dest_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3"
 from {username='slave'} at 127.0.0.1:43962
I20260709 12:20:23.410768 32679 raft_consensus.cc:493] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:23.411131 32679 raft_consensus.cc:3060] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.416744 32679 raft_consensus.cc:515] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.418453 32679 leader_election.cc:290] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 3 election: Requested vote from peers 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619), e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289)
I20260709 12:20:23.418988 32534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "27e27502ef8e4f22828983a842faab70"
I20260709 12:20:23.419404 32609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f1df79384e4f5cacee888edc1ee170" candidate_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "e266205d640345fdacc14a10ad7321f2"
I20260709 12:20:23.419788 32534 raft_consensus.cc:3055] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:23.420097 32609 raft_consensus.cc:3060] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.420147 32534 raft_consensus.cc:740] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 27e27502ef8e4f22828983a842faab70, State: Running, Role: LEADER
I20260709 12:20:23.421095 32534 consensus_queue.cc:260] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.422435 32534 raft_consensus.cc:3060] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:23.427249 32609 raft_consensus.cc:2468] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 3.
I20260709 12:20:23.428475 32651 leader_election.cc:304] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8aa8a27a9003452bb4c1cfe8b7c156c3, e266205d640345fdacc14a10ad7321f2; no voters: 
I20260709 12:20:23.429181   438 raft_consensus.cc:2804] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:23.429145 32534 raft_consensus.cc:2468] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aa8a27a9003452bb4c1cfe8b7c156c3 in term 3.
I20260709 12:20:23.429896   438 raft_consensus.cc:697] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 LEADER]: Becoming Leader. State: Replica: 8aa8a27a9003452bb4c1cfe8b7c156c3, State: Running, Role: LEADER
I20260709 12:20:23.431273   438 consensus_queue.cc:237] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } }
I20260709 12:20:23.438476 32433 catalog_manager.cc:5697] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 reported cstate change: term changed from 2 to 3, leader changed from 27e27502ef8e4f22828983a842faab70 (127.22.48.1) to 8aa8a27a9003452bb4c1cfe8b7c156c3 (127.22.48.3). New cstate: current_term: 3 leader_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8aa8a27a9003452bb4c1cfe8b7c156c3" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 38623 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:23.643215 32534 raft_consensus.cc:1275] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:23.644405   438 consensus_queue.cc:1048] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:23.653541 32609 raft_consensus.cc:1275] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:23.656503   523 consensus_queue.cc:1048] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:20:23.733644 32534 raft_consensus.cc:1275] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:23.735023   523 consensus_queue.cc:1048] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:23.744599 32609 raft_consensus.cc:1275] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:23.746326   488 consensus_queue.cc:1048] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:23.784658 32534 raft_consensus.cc:1275] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:23.786005   488 consensus_queue.cc:1048] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:23.797885 32609 raft_consensus.cc:1275] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:23.799254   529 consensus_queue.cc:1048] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:23.835453 32609 raft_consensus.cc:1275] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:23.836696   529 consensus_queue.cc:1048] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e266205d640345fdacc14a10ad7321f2" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 40289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:23.844560 32534 raft_consensus.cc:1275] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Refusing update from remote peer 8aa8a27a9003452bb4c1cfe8b7c156c3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:20:23.845894   523 consensus_queue.cc:1048] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "27e27502ef8e4f22828983a842faab70" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 46619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:20:24.269405 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:24.275161 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:24.275573 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:24.280136 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:24.280530 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:25.281695 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:25.286590 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:25.286957 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:25.291365 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:25.291671 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:26.292542 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:26.297847 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:26.298368 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:26.303082 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:26.303462 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:27.304625 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:27.310141 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:27.310596 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:27.315227 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:27.315582 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:28.316646 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:28.323770 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:28.324213 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:28.329242 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:28.329594 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:29.330727 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:29.337236 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:29.338411 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:29.345312 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:29.345738 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:30.346709 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:30.351819 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:30.352316 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:30.358031 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:30.358489 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:31.359905 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:31.364974 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:31.365444 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:31.369983 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:31.370407 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:32.371879 22720 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:20:32.380946 22720 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:20:32.381678 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:32.386366 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:32.386740 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:33.448845 22720 tablet_server.cc:179] TabletServer@127.22.48.1:0 shutting down...
I20260709 12:20:33.489459 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:33.490700 22720 tablet_replica.cc:333] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.491945 22720 raft_consensus.cc:2243] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.493651 22720 raft_consensus.cc:2272] T 906fe0149dc446eaa5cfe6252e47447e P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.497236 22720 tablet_replica.cc:333] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.497839 22720 raft_consensus.cc:2243] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.498453 22720 raft_consensus.cc:2272] T a633b05b54344db5974cadb530575816 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.500862 22720 tablet_replica.cc:333] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.501510 22720 raft_consensus.cc:2243] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.502010 22720 raft_consensus.cc:2272] T d2f1df79384e4f5cacee888edc1ee170 P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.504598 22720 tablet_replica.cc:333] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.505221 22720 raft_consensus.cc:2243] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.505795 22720 raft_consensus.cc:2272] T c576040c5a7a4ee295fca399dced0e17 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.508543 22720 tablet_replica.cc:333] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.509202 22720 raft_consensus.cc:2243] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.509706 22720 raft_consensus.cc:2272] T 475cce04ed814c92b61b24ce9d85a218 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.512135 22720 tablet_replica.cc:333] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.512671 22720 raft_consensus.cc:2243] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.513546 22720 raft_consensus.cc:2272] T 724cd0a99abe4ce198262517bcec75bd P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.515841 22720 tablet_replica.cc:333] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.516405 22720 raft_consensus.cc:2243] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.516851 22720 raft_consensus.cc:2272] T 2a02dd9ae4d6449884969d4431ace84e P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.519927 22720 tablet_replica.cc:333] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.521106 22720 raft_consensus.cc:2243] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.522598 22720 raft_consensus.cc:2272] T 66cb17cbb1e840f98a56d0c2a1ced715 P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.526844 22720 tablet_replica.cc:333] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.527491 22720 raft_consensus.cc:2243] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.528523 22720 raft_consensus.cc:2272] T e240cd7966dc46fc8f900cc0548786aa P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.531286 22720 tablet_replica.cc:333] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.531914 22720 raft_consensus.cc:2243] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.532835 22720 raft_consensus.cc:2272] T 3d799e4cc18641988761aa8a41bd0643 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.535275 22720 tablet_replica.cc:333] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.535771 22720 raft_consensus.cc:2243] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.536624 22720 raft_consensus.cc:2272] T 4729df9887e744f59d3316bd92853bb9 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.539016 22720 tablet_replica.cc:333] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.539577 22720 raft_consensus.cc:2243] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.540091 22720 raft_consensus.cc:2272] T 7de01da730504c2da056361e5c14058a P 27e27502ef8e4f22828983a842faab70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.542331 22720 tablet_replica.cc:333] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.542894 22720 raft_consensus.cc:2243] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.543386 22720 raft_consensus.cc:2272] T f3ba3e86b62d4207a7ba2f6b4cff32db P 27e27502ef8e4f22828983a842faab70 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.545758 22720 tablet_replica.cc:333] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.546325 22720 raft_consensus.cc:2243] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.546903 22720 raft_consensus.cc:2272] T ebfc6699bf214884bc52dd6f077a08f3 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.549178 22720 tablet_replica.cc:333] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.549732 22720 raft_consensus.cc:2243] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.550262 22720 raft_consensus.cc:2272] T 619a8ba632134dd99dfc7c3c7f01abd3 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.552452 22720 tablet_replica.cc:333] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.552949 22720 raft_consensus.cc:2243] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.553447 22720 raft_consensus.cc:2272] T 901effde80d242899f45135a42b099b5 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.555649 22720 tablet_replica.cc:333] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.556136 22720 raft_consensus.cc:2243] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.556623 22720 raft_consensus.cc:2272] T c3056eac2c094f41a1f91780bf6b6b15 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.558858 22720 tablet_replica.cc:333] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70: stopping tablet replica
I20260709 12:20:33.559334 22720 raft_consensus.cc:2243] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.560226 22720 raft_consensus.cc:2272] T 6a21eb0a428640caa18addf7158c5492 P 27e27502ef8e4f22828983a842faab70 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:33.569190 32651 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:20:33.573041 32651 consensus_peers.cc:597] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 -> Peer 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619): Couldn't send request to peer 27e27502ef8e4f22828983a842faab70. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:33.603353 32577 consensus_peers.cc:597] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 -> Peer 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619): Couldn't send request to peer 27e27502ef8e4f22828983a842faab70. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:46619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.603672 22720 tablet_server.cc:196] TabletServer@127.22.48.1:0 shutdown complete.
I20260709 12:20:33.650944 22720 tablet_server.cc:179] TabletServer@127.22.48.2:0 shutting down...
W20260709 12:20:33.665063 32651 consensus_peers.cc:597] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 -> Peer e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289): Couldn't send request to peer e266205d640345fdacc14a10ad7321f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:33.675101 32651 consensus_peers.cc:597] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 -> Peer e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289): Couldn't send request to peer e266205d640345fdacc14a10ad7321f2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.686019 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:33.687227 22720 tablet_replica.cc:333] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.688092 22720 raft_consensus.cc:2243] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.688848 22720 raft_consensus.cc:2272] T 906fe0149dc446eaa5cfe6252e47447e P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.691282 22720 tablet_replica.cc:333] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.691926 22720 raft_consensus.cc:2243] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.692487 22720 raft_consensus.cc:2272] T d2f1df79384e4f5cacee888edc1ee170 P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.694615 22720 tablet_replica.cc:333] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.695137 22720 raft_consensus.cc:2243] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.696045 22720 raft_consensus.cc:2272] T a633b05b54344db5974cadb530575816 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.698226 22720 tablet_replica.cc:333] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.698836 22720 raft_consensus.cc:2243] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.699741 22720 raft_consensus.cc:2272] T 2a02dd9ae4d6449884969d4431ace84e P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.702015 22720 tablet_replica.cc:333] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.702628 22720 raft_consensus.cc:2243] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.703504 22720 raft_consensus.cc:2272] T c576040c5a7a4ee295fca399dced0e17 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.706008 22720 tablet_replica.cc:333] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.706794 22720 raft_consensus.cc:2243] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.707396 22720 raft_consensus.cc:2272] T 475cce04ed814c92b61b24ce9d85a218 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.711273 22720 tablet_replica.cc:333] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
W20260709 12:20:33.711853 32577 consensus_peers.cc:597] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 -> Peer 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619): Couldn't send request to peer 27e27502ef8e4f22828983a842faab70. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:46619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.712146 22720 raft_consensus.cc:2243] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.712843 22720 raft_consensus.cc:2272] T 724cd0a99abe4ce198262517bcec75bd P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:33.713928 32651 consensus_peers.cc:597] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 -> Peer 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619): Couldn't send request to peer 27e27502ef8e4f22828983a842faab70. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:46619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.715951 22720 tablet_replica.cc:333] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
W20260709 12:20:33.716009 32651 consensus_peers.cc:597] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 -> Peer 27e27502ef8e4f22828983a842faab70 (127.22.48.1:46619): Couldn't send request to peer 27e27502ef8e4f22828983a842faab70. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:46619: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.716878 22720 raft_consensus.cc:2243] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.717386 22720 raft_consensus.cc:2272] T e240cd7966dc46fc8f900cc0548786aa P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.719731 22720 tablet_replica.cc:333] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.720249 22720 raft_consensus.cc:2243] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.720816 22720 raft_consensus.cc:2272] T 66cb17cbb1e840f98a56d0c2a1ced715 P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.723286 22720 tablet_replica.cc:333] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.723793 22720 raft_consensus.cc:2243] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.724215 22720 raft_consensus.cc:2272] T 6a21eb0a428640caa18addf7158c5492 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.726514 22720 tablet_replica.cc:333] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.727170 22720 raft_consensus.cc:2243] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.727955 22720 raft_consensus.cc:2272] T c3056eac2c094f41a1f91780bf6b6b15 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.730005 22720 tablet_replica.cc:333] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.730581 22720 raft_consensus.cc:2243] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.731047 22720 raft_consensus.cc:2272] T 901effde80d242899f45135a42b099b5 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.732892 22720 tablet_replica.cc:333] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.733364 22720 raft_consensus.cc:2243] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.733819 22720 raft_consensus.cc:2272] T ebfc6699bf214884bc52dd6f077a08f3 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.735877 22720 tablet_replica.cc:333] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.736356 22720 raft_consensus.cc:2243] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.737210 22720 raft_consensus.cc:2272] T 619a8ba632134dd99dfc7c3c7f01abd3 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.739400 22720 tablet_replica.cc:333] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.739923 22720 raft_consensus.cc:2243] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.740442 22720 raft_consensus.cc:2272] T 3d799e4cc18641988761aa8a41bd0643 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.742580 22720 tablet_replica.cc:333] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.743088 22720 raft_consensus.cc:2243] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.743541 22720 raft_consensus.cc:2272] T 4729df9887e744f59d3316bd92853bb9 P e266205d640345fdacc14a10ad7321f2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.745769 22720 tablet_replica.cc:333] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.746261 22720 raft_consensus.cc:2243] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.747103 22720 raft_consensus.cc:2272] T 7de01da730504c2da056361e5c14058a P e266205d640345fdacc14a10ad7321f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.749222 22720 tablet_replica.cc:333] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2: stopping tablet replica
I20260709 12:20:33.749693 22720 raft_consensus.cc:2243] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.750185 22720 raft_consensus.cc:2272] T f3ba3e86b62d4207a7ba2f6b4cff32db P e266205d640345fdacc14a10ad7321f2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.792631 22720 tablet_server.cc:196] TabletServer@127.22.48.2:0 shutdown complete.
I20260709 12:20:33.834028 22720 tablet_server.cc:179] TabletServer@127.22.48.3:0 shutting down...
W20260709 12:20:33.834652 32651 consensus_peers.cc:597] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 -> Peer e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289): Couldn't send request to peer e266205d640345fdacc14a10ad7321f2. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:40289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.865375 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:33.866223 22720 tablet_replica.cc:333] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.867411 22720 raft_consensus.cc:2243] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.868404 22720 raft_consensus.cc:2272] T 906fe0149dc446eaa5cfe6252e47447e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.870756 22720 tablet_replica.cc:333] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.871337 22720 raft_consensus.cc:2243] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.871876 22720 raft_consensus.cc:2272] T a633b05b54344db5974cadb530575816 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.874029 22720 tablet_replica.cc:333] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.874658 22720 raft_consensus.cc:2243] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.875523 22720 raft_consensus.cc:2272] T d2f1df79384e4f5cacee888edc1ee170 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.877619 22720 tablet_replica.cc:333] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.878160 22720 raft_consensus.cc:2243] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.878675 22720 raft_consensus.cc:2272] T c576040c5a7a4ee295fca399dced0e17 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.880734 22720 tablet_replica.cc:333] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.881325 22720 raft_consensus.cc:2243] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.882167 22720 raft_consensus.cc:2272] T 475cce04ed814c92b61b24ce9d85a218 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.884325 22720 tablet_replica.cc:333] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.884963 22720 raft_consensus.cc:2243] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.885401 22720 raft_consensus.cc:2272] T 724cd0a99abe4ce198262517bcec75bd P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.887436 22720 tablet_replica.cc:333] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.887959 22720 raft_consensus.cc:2243] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.888415 22720 raft_consensus.cc:2272] T e240cd7966dc46fc8f900cc0548786aa P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.890337 22720 tablet_replica.cc:333] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.890892 22720 raft_consensus.cc:2243] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.891336 22720 raft_consensus.cc:2272] T 66cb17cbb1e840f98a56d0c2a1ced715 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.893177 22720 tablet_replica.cc:333] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.893844 22720 raft_consensus.cc:2243] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.894502 22720 raft_consensus.cc:2272] T 6a21eb0a428640caa18addf7158c5492 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.897110 22720 tablet_replica.cc:333] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.897660 22720 raft_consensus.cc:2243] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.898180 22720 raft_consensus.cc:2272] T c3056eac2c094f41a1f91780bf6b6b15 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:33.898422 32651 consensus_peers.cc:597] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 -> Peer e266205d640345fdacc14a10ad7321f2 (127.22.48.2:40289): Couldn't send request to peer e266205d640345fdacc14a10ad7321f2. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:40289: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:33.900445 22720 tablet_replica.cc:333] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.901057 22720 raft_consensus.cc:2243] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.901911 22720 raft_consensus.cc:2272] T 901effde80d242899f45135a42b099b5 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.904059 22720 tablet_replica.cc:333] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.904608 22720 raft_consensus.cc:2243] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.905059 22720 raft_consensus.cc:2272] T 2a02dd9ae4d6449884969d4431ace84e P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.907198 22720 tablet_replica.cc:333] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.907714 22720 raft_consensus.cc:2243] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.908200 22720 raft_consensus.cc:2272] T 3d799e4cc18641988761aa8a41bd0643 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.910254 22720 tablet_replica.cc:333] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.910826 22720 raft_consensus.cc:2243] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.911284 22720 raft_consensus.cc:2272] T 4729df9887e744f59d3316bd92853bb9 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.913425 22720 tablet_replica.cc:333] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.913980 22720 raft_consensus.cc:2243] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.914951 22720 raft_consensus.cc:2272] T ebfc6699bf214884bc52dd6f077a08f3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.917146 22720 tablet_replica.cc:333] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.917663 22720 raft_consensus.cc:2243] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.918143 22720 raft_consensus.cc:2272] T 619a8ba632134dd99dfc7c3c7f01abd3 P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.920224 22720 tablet_replica.cc:333] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.920717 22720 raft_consensus.cc:2243] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.921233 22720 raft_consensus.cc:2272] T 7de01da730504c2da056361e5c14058a P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.923656 22720 tablet_replica.cc:333] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3: stopping tablet replica
I20260709 12:20:33.924120 22720 raft_consensus.cc:2243] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.924958 22720 raft_consensus.cc:2272] T f3ba3e86b62d4207a7ba2f6b4cff32db P 8aa8a27a9003452bb4c1cfe8b7c156c3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.966048 22720 tablet_server.cc:196] TabletServer@127.22.48.3:0 shutdown complete.
I20260709 12:20:34.002432 22720 master.cc:562] Master@127.22.48.62:36333 shutting down...
I20260709 12:20:34.027033 22720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:34.027602 22720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:34.027896 22720 tablet_replica.cc:333] T 00000000000000000000000000000000 P c96981995b604e6bb457d58b27cac950: stopping tablet replica
I20260709 12:20:34.048391 22720 master.cc:584] Master@127.22.48.62:36333 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (20522 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:20:34.103511 22720 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.48.62:41249
I20260709 12:20:34.104625 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:34.110265   552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.110399   553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.111857   555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:34.112736 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:34.113662 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:34.113870 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:34.114056 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599634114028 us; error 0 us; skew 500 ppm
I20260709 12:20:34.115020 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:34.117277 22720 webserver.cc:533] Webserver started at http://127.22.48.62:45055/ using document root <none> and password file <none>
I20260709 12:20:34.117759 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:34.117940 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:34.118227 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:34.119429 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/master-0-root/instance:
uuid: "479c8a0b3c8f480bb04f19ce86e1227a"
format_stamp: "Formatted at 2026-07-09 12:20:34 on dist-test-slave-044g"
I20260709 12:20:34.123817 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:34.127106   560 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.127856 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:34.128139 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/master-0-root
uuid: "479c8a0b3c8f480bb04f19ce86e1227a"
format_stamp: "Formatted at 2026-07-09 12:20:34 on dist-test-slave-044g"
I20260709 12:20:34.128417 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:34.159152 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:34.160365 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:34.199309 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.62:41249
I20260709 12:20:34.199455   611 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.62:41249 every 8 connection(s)
I20260709 12:20:34.203413   612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.215677   612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a: Bootstrap starting.
I20260709 12:20:34.221017   612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.225610   612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a: No bootstrap required, opened a new log
I20260709 12:20:34.228394   612 raft_consensus.cc:359] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479c8a0b3c8f480bb04f19ce86e1227a" member_type: VOTER }
I20260709 12:20:34.228861   612 raft_consensus.cc:385] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.229090   612 raft_consensus.cc:740] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 479c8a0b3c8f480bb04f19ce86e1227a, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.229689   612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479c8a0b3c8f480bb04f19ce86e1227a" member_type: VOTER }
I20260709 12:20:34.230234   612 raft_consensus.cc:399] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:34.230504   612 raft_consensus.cc:493] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:34.230778   612 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:34.235734   612 raft_consensus.cc:515] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479c8a0b3c8f480bb04f19ce86e1227a" member_type: VOTER }
I20260709 12:20:34.236289   612 leader_election.cc:304] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 479c8a0b3c8f480bb04f19ce86e1227a; no voters: 
I20260709 12:20:34.237686   612 leader_election.cc:290] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:34.238441   615 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:34.239727   615 raft_consensus.cc:697] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 1 LEADER]: Becoming Leader. State: Replica: 479c8a0b3c8f480bb04f19ce86e1227a, State: Running, Role: LEADER
I20260709 12:20:34.240394   615 consensus_queue.cc:237] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479c8a0b3c8f480bb04f19ce86e1227a" member_type: VOTER }
I20260709 12:20:34.240657   612 sys_catalog.cc:565] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:34.244994   617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 479c8a0b3c8f480bb04f19ce86e1227a. Latest consensus state: current_term: 1 leader_uuid: "479c8a0b3c8f480bb04f19ce86e1227a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479c8a0b3c8f480bb04f19ce86e1227a" member_type: VOTER } }
I20260709 12:20:34.244997   616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "479c8a0b3c8f480bb04f19ce86e1227a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "479c8a0b3c8f480bb04f19ce86e1227a" member_type: VOTER } }
I20260709 12:20:34.245766   617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:34.245818   616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:34.251256   622 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:34.258878   622 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:34.259851 22720 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:34.268375   622 catalog_manager.cc:1383] Generated new cluster ID: 7300986445c74f61bc67927205a0abbd
I20260709 12:20:34.268620   622 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:34.280851   622 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:34.282382   622 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:34.299530   622 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a: Generated new TSK 0
I20260709 12:20:34.300132   622 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:34.326366 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:34.332952   633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.334408   634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.335242   636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:34.335804 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:34.336668 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:34.336892 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:34.337064 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599634337044 us; error 0 us; skew 500 ppm
I20260709 12:20:34.337582 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:34.339787 22720 webserver.cc:533] Webserver started at http://127.22.48.1:43321/ using document root <none> and password file <none>
I20260709 12:20:34.340250 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:34.340406 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:34.340680 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:34.341800 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-0-root/instance:
uuid: "5e36102ff7c240679f201426474eb1bb"
format_stamp: "Formatted at 2026-07-09 12:20:34 on dist-test-slave-044g"
I20260709 12:20:34.346397 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:20:34.350093   641 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.350934 22720 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:20:34.351222 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-0-root
uuid: "5e36102ff7c240679f201426474eb1bb"
format_stamp: "Formatted at 2026-07-09 12:20:34 on dist-test-slave-044g"
I20260709 12:20:34.351505 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:34.360384 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:34.361541 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:34.362959 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:34.365145 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:34.365355 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.365586 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:34.365767 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.407802 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.1:41667
I20260709 12:20:34.407902   703 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.1:41667 every 8 connection(s)
I20260709 12:20:34.413049 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:34.420794   708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.421104   709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.423605   711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:34.423949 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:34.425266 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:34.425535 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:34.425725 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599634425708 us; error 0 us; skew 500 ppm
I20260709 12:20:34.426249 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:34.428531 22720 webserver.cc:533] Webserver started at http://127.22.48.2:36719/ using document root <none> and password file <none>
I20260709 12:20:34.429035 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:34.429236 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:34.429526 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:34.431123 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-1-root/instance:
uuid: "f76e6f821f0a4006851a42b049e524e3"
format_stamp: "Formatted at 2026-07-09 12:20:34 on dist-test-slave-044g"
I20260709 12:20:34.431406   704 heartbeater.cc:344] Connected to a master server at 127.22.48.62:41249
I20260709 12:20:34.431826   704 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:34.432492   704 heartbeater.cc:507] Master 127.22.48.62:41249 requested a full tablet report, sending...
I20260709 12:20:34.434486   577 ts_manager.cc:194] Registered new tserver with Master: 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667)
I20260709 12:20:34.436142 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:20:34.436611   577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52234
I20260709 12:20:34.439810   716 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.440687 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:20:34.440970 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-1-root
uuid: "f76e6f821f0a4006851a42b049e524e3"
format_stamp: "Formatted at 2026-07-09 12:20:34 on dist-test-slave-044g"
I20260709 12:20:34.441259 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:34.462045 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:34.464061 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:34.466027 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:34.468585 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:34.468853 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.469126 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:34.469308 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.510525 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.2:44369
I20260709 12:20:34.510633   778 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.2:44369 every 8 connection(s)
I20260709 12:20:34.515373 22720 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:34.522624   782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.525341   783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:34.528410   785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:34.528842   779 heartbeater.cc:344] Connected to a master server at 127.22.48.62:41249
I20260709 12:20:34.529161 22720 server_base.cc:1061] running on GCE node
I20260709 12:20:34.529350   779 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:34.530330 22720 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:20:34.530448   779 heartbeater.cc:507] Master 127.22.48.62:41249 requested a full tablet report, sending...
W20260709 12:20:34.530612 22720 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:34.530864 22720 hybrid_clock.cc:648] HybridClock initialized: now 1783599634530845 us; error 0 us; skew 500 ppm
I20260709 12:20:34.531466 22720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:34.532552   577 ts_manager.cc:194] Registered new tserver with Master: f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:34.533985 22720 webserver.cc:533] Webserver started at http://127.22.48.3:44895/ using document root <none> and password file <none>
I20260709 12:20:34.534302   577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52248
I20260709 12:20:34.534652 22720 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:34.534940 22720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:34.535235 22720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:34.536402 22720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-2-root/instance:
uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
format_stamp: "Formatted at 2026-07-09 12:20:34 on dist-test-slave-044g"
I20260709 12:20:34.540778 22720 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:20:34.544348   790 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.545076 22720 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:34.545375 22720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-2-root
uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
format_stamp: "Formatted at 2026-07-09 12:20:34 on dist-test-slave-044g"
I20260709 12:20:34.545650 22720 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskigKFjC/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599314612061-22720-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:34.581957 22720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:34.583222 22720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:34.584648 22720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:34.586784 22720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:34.586979 22720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.587227 22720 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:34.587385 22720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:34.630218 22720 rpc_server.cc:307] RPC server started. Bound to: 127.22.48.3:33605
I20260709 12:20:34.630378   852 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.48.3:33605 every 8 connection(s)
I20260709 12:20:34.643716   853 heartbeater.cc:344] Connected to a master server at 127.22.48.62:41249
I20260709 12:20:34.644152   853 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:34.644841   853 heartbeater.cc:507] Master 127.22.48.62:41249 requested a full tablet report, sending...
I20260709 12:20:34.646692   577 ts_manager.cc:194] Registered new tserver with Master: abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:34.646855 22720 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013450234s
I20260709 12:20:34.648102   577 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52250
I20260709 12:20:34.672144   577 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52262:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:34.674921   577 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:34.741158   669 tablet_service.cc:1511] Processing CreateTablet for tablet aac6ec73a137479b9d5f14a053623dc9 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:34.743842   668 tablet_service.cc:1511] Processing CreateTablet for tablet 7eae1dca1c4648a3b18ef3fcdc425088 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:34.746186   667 tablet_service.cc:1511] Processing CreateTablet for tablet 52dbd030c34142f6b9df9e58a053c5c5 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:34.749106   669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac6ec73a137479b9d5f14a053623dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.748764   666 tablet_service.cc:1511] Processing CreateTablet for tablet 76704895e0014456af584dbc19a2e56c (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:34.749336   665 tablet_service.cc:1511] Processing CreateTablet for tablet afd64dd461c24c6c8fad679e1b948f65 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:34.749818   667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52dbd030c34142f6b9df9e58a053c5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.750996   665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd64dd461c24c6c8fad679e1b948f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.751780   668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eae1dca1c4648a3b18ef3fcdc425088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.758167   817 tablet_service.cc:1511] Processing CreateTablet for tablet 7eae1dca1c4648a3b18ef3fcdc425088 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:34.761545   818 tablet_service.cc:1511] Processing CreateTablet for tablet aac6ec73a137479b9d5f14a053623dc9 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:34.765549   666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76704895e0014456af584dbc19a2e56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.768589   817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eae1dca1c4648a3b18ef3fcdc425088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.769984   818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac6ec73a137479b9d5f14a053623dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.792537   741 tablet_service.cc:1511] Processing CreateTablet for tablet 76704895e0014456af584dbc19a2e56c (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:34.794226   741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76704895e0014456af584dbc19a2e56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.795433   743 tablet_service.cc:1511] Processing CreateTablet for tablet 7eae1dca1c4648a3b18ef3fcdc425088 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:34.796777   743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7eae1dca1c4648a3b18ef3fcdc425088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.799739   663 tablet_service.cc:1511] Processing CreateTablet for tablet 84aeb1b9ddd94f5892571efe1b32fbd6 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:34.800176   816 tablet_service.cc:1511] Processing CreateTablet for tablet 52dbd030c34142f6b9df9e58a053c5c5 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:34.801586   663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84aeb1b9ddd94f5892571efe1b32fbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.801746   816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52dbd030c34142f6b9df9e58a053c5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.804339   742 tablet_service.cc:1511] Processing CreateTablet for tablet 52dbd030c34142f6b9df9e58a053c5c5 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:34.806067   742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52dbd030c34142f6b9df9e58a053c5c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.805718   740 tablet_service.cc:1511] Processing CreateTablet for tablet afd64dd461c24c6c8fad679e1b948f65 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:34.805740   744 tablet_service.cc:1511] Processing CreateTablet for tablet aac6ec73a137479b9d5f14a053623dc9 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:34.807106   740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd64dd461c24c6c8fad679e1b948f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.793970   664 tablet_service.cc:1511] Processing CreateTablet for tablet 74b53844068f46e59529347c65d0dd34 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:34.810596   744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aac6ec73a137479b9d5f14a053623dc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.811375   664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b53844068f46e59529347c65d0dd34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.816820   739 tablet_service.cc:1511] Processing CreateTablet for tablet 74b53844068f46e59529347c65d0dd34 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:34.818212   739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b53844068f46e59529347c65d0dd34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.821135   738 tablet_service.cc:1511] Processing CreateTablet for tablet 84aeb1b9ddd94f5892571efe1b32fbd6 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:34.822614   738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84aeb1b9ddd94f5892571efe1b32fbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.828704   814 tablet_service.cc:1511] Processing CreateTablet for tablet afd64dd461c24c6c8fad679e1b948f65 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:34.830132   814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afd64dd461c24c6c8fad679e1b948f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.835090   815 tablet_service.cc:1511] Processing CreateTablet for tablet 76704895e0014456af584dbc19a2e56c (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:34.836570   815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76704895e0014456af584dbc19a2e56c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.839465   813 tablet_service.cc:1511] Processing CreateTablet for tablet 74b53844068f46e59529347c65d0dd34 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:34.840806   813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74b53844068f46e59529347c65d0dd34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.843490   812 tablet_service.cc:1511] Processing CreateTablet for tablet 84aeb1b9ddd94f5892571efe1b32fbd6 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:34.844837   812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84aeb1b9ddd94f5892571efe1b32fbd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.890638   868 tablet_bootstrap.cc:492] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:34.901507   665 tablet_service.cc:1511] Processing CreateTablet for tablet d71a0f64b1dc4dda90150708045fc6c2 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:34.902966   869 tablet_bootstrap.cc:492] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:34.903424   665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d71a0f64b1dc4dda90150708045fc6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.905215   743 tablet_service.cc:1511] Processing CreateTablet for tablet d71a0f64b1dc4dda90150708045fc6c2 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:34.908686   743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d71a0f64b1dc4dda90150708045fc6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.912231   811 tablet_service.cc:1511] Processing CreateTablet for tablet d71a0f64b1dc4dda90150708045fc6c2 (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:34.913836   811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d71a0f64b1dc4dda90150708045fc6c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.921940   868 tablet_bootstrap.cc:654] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.934029   739 tablet_service.cc:1511] Processing CreateTablet for tablet 1a200b2aab6c4b8bbb60cc5a960e746e (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:34.935702   739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a200b2aab6c4b8bbb60cc5a960e746e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.929953   669 tablet_service.cc:1511] Processing CreateTablet for tablet 1a200b2aab6c4b8bbb60cc5a960e746e (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:34.941725   669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a200b2aab6c4b8bbb60cc5a960e746e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.947727   818 tablet_service.cc:1511] Processing CreateTablet for tablet 1a200b2aab6c4b8bbb60cc5a960e746e (DEFAULT_TABLE table=test-workload [id=1e625fb3a9b0473b851c623d85d8db5e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:34.948429   870 tablet_bootstrap.cc:492] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:34.949136   818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a200b2aab6c4b8bbb60cc5a960e746e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:34.968181   870 tablet_bootstrap.cc:654] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.971555   869 tablet_bootstrap.cc:654] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:34.981688   868 tablet_bootstrap.cc:492] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:34.982450   868 ts_tablet_manager.cc:1403] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.092s	user 0.015s	sys 0.000s
I20260709 12:20:34.991238   868 raft_consensus.cc:359] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:34.992349   868 raft_consensus.cc:385] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:34.992769   868 raft_consensus.cc:740] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:34.993853   868 consensus_queue.cc:260] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:34.996521   868 ts_tablet_manager.cc:1434] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:20:34.996610   869 tablet_bootstrap.cc:492] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:34.997264   869 ts_tablet_manager.cc:1403] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.095s	user 0.007s	sys 0.006s
I20260709 12:20:34.997375   704 heartbeater.cc:499] Master 127.22.48.62:41249 was elected leader, sending a full tablet report...
I20260709 12:20:34.998423   868 tablet_bootstrap.cc:492] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:34.999045   870 tablet_bootstrap.cc:492] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:34.999542   870 ts_tablet_manager.cc:1403] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.051s	user 0.006s	sys 0.019s
I20260709 12:20:35.000344   869 raft_consensus.cc:359] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.001081   869 raft_consensus.cc:385] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.001382   869 raft_consensus.cc:740] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.002305   869 consensus_queue.cc:260] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.002493   870 raft_consensus.cc:359] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.003212   870 raft_consensus.cc:385] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.003568   870 raft_consensus.cc:740] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.004701   870 consensus_queue.cc:260] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.006486   868 tablet_bootstrap.cc:654] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.011915   869 ts_tablet_manager.cc:1434] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.014s	user 0.013s	sys 0.001s
I20260709 12:20:35.012141   870 ts_tablet_manager.cc:1434] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.012s	user 0.012s	sys 0.000s
I20260709 12:20:35.012682   779 heartbeater.cc:499] Master 127.22.48.62:41249 was elected leader, sending a full tablet report...
I20260709 12:20:35.014911   869 tablet_bootstrap.cc:492] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
W20260709 12:20:35.016320   780 tablet.cc:2406] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:35.018986   853 heartbeater.cc:499] Master 127.22.48.62:41249 was elected leader, sending a full tablet report...
I20260709 12:20:35.021744   869 tablet_bootstrap.cc:654] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.022969   868 tablet_bootstrap.cc:492] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:35.023561   868 ts_tablet_manager.cc:1403] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 12:20:35.024322   870 tablet_bootstrap.cc:492] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:35.026870   868 raft_consensus.cc:359] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.027715   868 raft_consensus.cc:385] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.028065   868 raft_consensus.cc:740] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.029247   868 consensus_queue.cc:260] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.032110   868 ts_tablet_manager.cc:1434] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:35.032226   870 tablet_bootstrap.cc:654] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.033179   868 tablet_bootstrap.cc:492] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:35.042641   868 tablet_bootstrap.cc:654] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.051110   870 tablet_bootstrap.cc:492] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:35.051275   868 tablet_bootstrap.cc:492] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:35.051816   868 ts_tablet_manager.cc:1403] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
I20260709 12:20:35.051777   870 ts_tablet_manager.cc:1403] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.028s	user 0.018s	sys 0.007s
I20260709 12:20:35.055195   868 raft_consensus.cc:359] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.056015   868 raft_consensus.cc:385] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.056478   868 raft_consensus.cc:740] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.056052   870 raft_consensus.cc:359] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.056980   870 raft_consensus.cc:385] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.057476   870 raft_consensus.cc:740] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.057333   868 consensus_queue.cc:260] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.058740   874 raft_consensus.cc:493] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.058797   870 consensus_queue.cc:260] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.059442   874 raft_consensus.cc:515] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.061344   870 ts_tablet_manager.cc:1434] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:20:35.062233   874 leader_election.cc:290] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.062474   870 tablet_bootstrap.cc:492] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:35.074410   870 tablet_bootstrap.cc:654] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.078334   868 ts_tablet_manager.cc:1434] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.000s
I20260709 12:20:35.079726   868 tablet_bootstrap.cc:492] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:35.085561   869 tablet_bootstrap.cc:492] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:35.086171   869 ts_tablet_manager.cc:1403] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.071s	user 0.035s	sys 0.030s
I20260709 12:20:35.089176   869 raft_consensus.cc:359] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.089933   869 raft_consensus.cc:385] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.090206   869 raft_consensus.cc:740] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.091049   869 consensus_queue.cc:260] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.095988   868 tablet_bootstrap.cc:654] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.097759   870 tablet_bootstrap.cc:492] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:35.098294   870 ts_tablet_manager.cc:1403] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.002s
I20260709 12:20:35.101927   870 raft_consensus.cc:359] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.102847   869 ts_tablet_manager.cc:1434] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:20:35.103053   870 raft_consensus.cc:385] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.103583   870 raft_consensus.cc:740] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.104771   870 consensus_queue.cc:260] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.104910   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:35.108687   869 tablet_bootstrap.cc:492] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
W20260709 12:20:35.111358   645 leader_election.cc:343] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.109792   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:35.114082   870 ts_tablet_manager.cc:1434] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
W20260709 12:20:35.114450   645 leader_election.cc:343] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.114980   645 leader_election.cc:304] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb; no voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.115291   870 tablet_bootstrap.cc:492] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:35.116348   874 raft_consensus.cc:2749] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.120837   868 tablet_bootstrap.cc:492] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:35.121521   868 ts_tablet_manager.cc:1403] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.042s	user 0.010s	sys 0.006s
I20260709 12:20:35.123833   870 tablet_bootstrap.cc:654] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.125236   868 raft_consensus.cc:359] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.126183   869 tablet_bootstrap.cc:654] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.126147   868 raft_consensus.cc:385] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.126788   868 raft_consensus.cc:740] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.127745   868 consensus_queue.cc:260] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.130745   868 ts_tablet_manager.cc:1434] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 12:20:35.132000   868 tablet_bootstrap.cc:492] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:35.132889   874 raft_consensus.cc:493] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.133450   874 raft_consensus.cc:515] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.136059   874 leader_election.cc:290] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.137207   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:35.137678   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:35.137930   754 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 0.
I20260709 12:20:35.138557   828 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 0.
I20260709 12:20:35.143469   645 leader_election.cc:304] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:35.144254   874 raft_consensus.cc:2804] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.144670   874 raft_consensus.cc:493] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.145087   874 raft_consensus.cc:3060] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.150707   868 tablet_bootstrap.cc:654] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.150605   870 tablet_bootstrap.cc:492] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:35.151970   870 ts_tablet_manager.cc:1403] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.037s	user 0.020s	sys 0.000s
I20260709 12:20:35.155277   874 raft_consensus.cc:515] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.156519   870 raft_consensus.cc:359] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.157428   870 raft_consensus.cc:385] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.157792   870 raft_consensus.cc:740] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.158838   870 consensus_queue.cc:260] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.159497   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:35.160413   754 raft_consensus.cc:3060] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.173942   870 ts_tablet_manager.cc:1434] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:20:35.176513   869 tablet_bootstrap.cc:492] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:35.177089   869 ts_tablet_manager.cc:1403] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.069s	user 0.012s	sys 0.015s
I20260709 12:20:35.180270   869 raft_consensus.cc:359] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.181010   869 raft_consensus.cc:385] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.181303   869 raft_consensus.cc:740] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.182631   870 tablet_bootstrap.cc:492] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:35.182533   869 consensus_queue.cc:260] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.183468   888 raft_consensus.cc:493] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.184201   888 raft_consensus.cc:515] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.187084   754 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 1.
I20260709 12:20:35.181409   874 leader_election.cc:290] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.189210   874 raft_consensus.cc:493] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.189764   874 raft_consensus.cc:515] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.192519   874 leader_election.cc:290] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.193249   869 ts_tablet_manager.cc:1434] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:20:35.198544   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:35.199154   828 raft_consensus.cc:3060] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.199441   827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:35.201678   869 tablet_bootstrap.cc:492] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:35.199497   645 leader_election.cc:304] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
W20260709 12:20:35.203778   645 leader_election.cc:343] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.204790   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76704895e0014456af584dbc19a2e56c" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:35.204705   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:35.207314   889 raft_consensus.cc:2804] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.208026   870 tablet_bootstrap.cc:654] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.208247   828 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 1.
I20260709 12:20:35.209051   888 leader_election.cc:290] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
W20260709 12:20:35.208698   645 leader_election.cc:343] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:35.212241   645 leader_election.cc:343] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.212477   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76704895e0014456af584dbc19a2e56c" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:35.212740   645 leader_election.cc:304] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb; no voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.214018   888 raft_consensus.cc:2749] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:35.214982   645 leader_election.cc:343] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.212942   868 tablet_bootstrap.cc:492] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:35.215487   645 leader_election.cc:304] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb; no voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.215854   868 ts_tablet_manager.cc:1403] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.084s	user 0.024s	sys 0.042s
I20260709 12:20:35.216356   888 raft_consensus.cc:2749] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.217311   870 tablet_bootstrap.cc:492] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:35.208082   889 raft_consensus.cc:697] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:35.217903   870 ts_tablet_manager.cc:1403] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.001s
I20260709 12:20:35.218621   889 consensus_queue.cc:237] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.219247   868 raft_consensus.cc:359] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.220109   868 raft_consensus.cc:385] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.220388   869 tablet_bootstrap.cc:654] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.220432   868 raft_consensus.cc:740] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.221662   868 consensus_queue.cc:260] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.221992   870 raft_consensus.cc:359] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.222867   870 raft_consensus.cc:385] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.223353   870 raft_consensus.cc:740] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.224236   868 ts_tablet_manager.cc:1434] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:35.224278   870 consensus_queue.cc:260] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.225500   868 tablet_bootstrap.cc:492] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:35.230149   870 ts_tablet_manager.cc:1434] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:20:35.231796   870 tablet_bootstrap.cc:492] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:35.234023   868 tablet_bootstrap.cc:654] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.236231   574 catalog_manager.cc:5697] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e36102ff7c240679f201426474eb1bb (127.22.48.1). New cstate: current_term: 1 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.241189   870 tablet_bootstrap.cc:654] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.246169   869 tablet_bootstrap.cc:492] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:35.246452   868 tablet_bootstrap.cc:492] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:35.246953   869 ts_tablet_manager.cc:1403] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.007s
I20260709 12:20:35.246986   868 ts_tablet_manager.cc:1403] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 12:20:35.251799   869 raft_consensus.cc:359] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.252910   869 raft_consensus.cc:385] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.253180   869 raft_consensus.cc:740] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.251672   868 raft_consensus.cc:359] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.253974   868 raft_consensus.cc:385] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.253918   869 consensus_queue.cc:260] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.254459   868 raft_consensus.cc:740] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.255757   868 consensus_queue.cc:260] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.257964   868 ts_tablet_manager.cc:1434] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
W20260709 12:20:35.257993   625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:35.260490   868 tablet_bootstrap.cc:492] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:35.261302   869 ts_tablet_manager.cc:1434] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:20:35.262362   869 tablet_bootstrap.cc:492] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:35.266548   870 tablet_bootstrap.cc:492] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:35.267198   870 ts_tablet_manager.cc:1403] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.007s
I20260709 12:20:35.269699   868 tablet_bootstrap.cc:654] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.270645   869 tablet_bootstrap.cc:654] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.277799   876 raft_consensus.cc:493] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.278558   876 raft_consensus.cc:515] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.281267   868 tablet_bootstrap.cc:492] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:35.281858   868 ts_tablet_manager.cc:1403] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:20:35.284933   876 leader_election.cc:290] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.292745   870 raft_consensus.cc:359] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.298256   870 raft_consensus.cc:385] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.298645   870 raft_consensus.cc:740] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.299561   870 consensus_queue.cc:260] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.296120   868 raft_consensus.cc:359] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.300904   868 raft_consensus.cc:385] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.301254   868 raft_consensus.cc:740] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.302114   868 consensus_queue.cc:260] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.305370   868 ts_tablet_manager.cc:1434] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 12:20:35.306527   868 tablet_bootstrap.cc:492] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:35.312143   870 ts_tablet_manager.cc:1434] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.005s
I20260709 12:20:35.313387   870 tablet_bootstrap.cc:492] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:35.321172   869 tablet_bootstrap.cc:492] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:35.321777   869 ts_tablet_manager.cc:1403] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.037s
I20260709 12:20:35.323051   868 tablet_bootstrap.cc:654] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.325021   869 raft_consensus.cc:359] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.325642   875 raft_consensus.cc:493] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.325855   869 raft_consensus.cc:385] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.326192   869 raft_consensus.cc:740] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.326188   875 raft_consensus.cc:515] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.327183   869 consensus_queue.cc:260] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.329298   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dbd030c34142f6b9df9e58a053c5c5" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:35.330215   754 raft_consensus.cc:2468] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:35.330230   876 raft_consensus.cc:493] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.331897   876 raft_consensus.cc:515] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.333449   870 tablet_bootstrap.cc:654] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.334236   876 leader_election.cc:290] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.334914   679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dbd030c34142f6b9df9e58a053c5c5" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.340647   679 raft_consensus.cc:2468] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:35.335651   794 leader_election.cc:304] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:35.336807   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.342859   678 raft_consensus.cc:2468] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:35.337249   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:35.345889   870 tablet_bootstrap.cc:492] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:35.347072   870 ts_tablet_manager.cc:1403] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.006s
I20260709 12:20:35.345667   876 raft_consensus.cc:2804] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.348361   876 raft_consensus.cc:493] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.349213   876 raft_consensus.cc:3060] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:35.346655   794 leader_election.cc:343] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.351238   870 raft_consensus.cc:359] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.352221   870 raft_consensus.cc:385] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.352586   870 raft_consensus.cc:740] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.352891   875 leader_election.cc:290] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.353960   870 consensus_queue.cc:260] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.381003   792 leader_election.cc:304] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.386384   876 raft_consensus.cc:515] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.390767   868 tablet_bootstrap.cc:492] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:35.388813   870 ts_tablet_manager.cc:1434] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.041s	user 0.014s	sys 0.020s
I20260709 12:20:35.400197   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:35.394891   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.402288   868 ts_tablet_manager.cc:1403] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.096s	user 0.037s	sys 0.032s
I20260709 12:20:35.402696   678 raft_consensus.cc:2468] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 0.
I20260709 12:20:35.402940   870 tablet_bootstrap.cc:492] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:35.393713   869 ts_tablet_manager.cc:1434] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.022s
I20260709 12:20:35.388155   909 raft_consensus.cc:2804] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.407688   909 raft_consensus.cc:493] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.408095   909 raft_consensus.cc:3060] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.402379   828 raft_consensus.cc:2468] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 0.
I20260709 12:20:35.410511   720 leader_election.cc:304] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:35.412132   904 raft_consensus.cc:2804] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.412570   904 raft_consensus.cc:493] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.412910   904 raft_consensus.cc:3060] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.406546   876 leader_election.cc:290] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.406457   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dbd030c34142f6b9df9e58a053c5c5" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:35.414548   754 raft_consensus.cc:3060] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.414666   910 raft_consensus.cc:493] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.415226   910 raft_consensus.cc:515] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.417796   910 leader_election.cc:290] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.420955   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:35.420897   904 raft_consensus.cc:515] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.405699   868 raft_consensus.cc:359] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.421774   679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.422104   868 raft_consensus.cc:385] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.422444   868 raft_consensus.cc:740] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.422551   679 raft_consensus.cc:2468] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:35.410907   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dbd030c34142f6b9df9e58a053c5c5" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:35.423595   678 raft_consensus.cc:3060] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.423238   868 consensus_queue.cc:260] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.424345   870 tablet_bootstrap.cc:654] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.425583   868 ts_tablet_manager.cc:1434] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260709 12:20:35.426690   868 tablet_bootstrap.cc:492] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:35.428504   904 leader_election.cc:290] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.430737   870 tablet_bootstrap.cc:492] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
W20260709 12:20:35.430764   794 leader_election.cc:343] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.431258   870 ts_tablet_manager.cc:1403] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.029s	user 0.007s	sys 0.005s
I20260709 12:20:35.431840   792 leader_election.cc:304] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.432960   868 tablet_bootstrap.cc:654] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.433084   876 raft_consensus.cc:2804] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.433530   876 raft_consensus.cc:493] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.433900   876 raft_consensus.cc:3060] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.434142   870 raft_consensus.cc:359] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.434878   870 raft_consensus.cc:385] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.435165   870 raft_consensus.cc:740] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.435971   870 consensus_queue.cc:260] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.437904   870 ts_tablet_manager.cc:1434] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:35.438827   679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:35.439759   679 raft_consensus.cc:3060] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.444377   754 raft_consensus.cc:2468] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:35.445672   870 tablet_bootstrap.cc:492] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:35.443022   869 tablet_bootstrap.cc:492] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:35.448758   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:35.449613   828 raft_consensus.cc:3060] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.454771   870 tablet_bootstrap.cc:654] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.459400   909 raft_consensus.cc:515] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.460235   828 raft_consensus.cc:2468] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 1.
I20260709 12:20:35.462527   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:35.463201   677 raft_consensus.cc:3060] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.463297   720 leader_election.cc:304] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:35.464545   904 raft_consensus.cc:2804] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.465027   904 raft_consensus.cc:697] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:35.465829   904 consensus_queue.cc:237] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.467631   678 raft_consensus.cc:2468] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:35.470798   794 leader_election.cc:304] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:35.471917   910 raft_consensus.cc:2804] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.471325   876 raft_consensus.cc:515] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.475620   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
W20260709 12:20:35.477172   794 leader_election.cc:343] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.472085   869 tablet_bootstrap.cc:654] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.478802   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:35.482337   677 raft_consensus.cc:2468] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:35.486603   876 leader_election.cc:290] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.480494   678 raft_consensus.cc:3060] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.483392   910 raft_consensus.cc:697] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:35.487432   679 raft_consensus.cc:2468] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 1.
I20260709 12:20:35.489085   792 leader_election.cc:304] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.489153   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:35.490202   910 consensus_queue.cc:237] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
W20260709 12:20:35.492100   794 leader_election.cc:343] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.487562   909 leader_election.cc:290] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.498111   876 raft_consensus.cc:2804] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.500753   876 raft_consensus.cc:697] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:35.501705   876 consensus_queue.cc:237] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.502866   868 tablet_bootstrap.cc:492] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:35.503674   868 ts_tablet_manager.cc:1403] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.077s	user 0.038s	sys 0.024s
I20260709 12:20:35.506625   575 catalog_manager.cc:5697] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.510043   678 raft_consensus.cc:2468] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:35.511065   870 tablet_bootstrap.cc:492] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:35.511427   870 ts_tablet_manager.cc:1403] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.000s
I20260709 12:20:35.513146   792 leader_election.cc:304] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.514243   868 raft_consensus.cc:359] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.515058   868 raft_consensus.cc:385] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.515345   868 raft_consensus.cc:740] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.516057   868 consensus_queue.cc:260] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.518055   868 ts_tablet_manager.cc:1434] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.001s
I20260709 12:20:35.518615   910 raft_consensus.cc:2804] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.519218   910 raft_consensus.cc:697] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:35.520773   910 consensus_queue.cc:237] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.523008   869 tablet_bootstrap.cc:492] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:35.523586   869 ts_tablet_manager.cc:1403] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.081s	user 0.013s	sys 0.005s
I20260709 12:20:35.519328   870 raft_consensus.cc:359] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.525959   870 raft_consensus.cc:385] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.526209   870 raft_consensus.cc:740] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.527513   870 consensus_queue.cc:260] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.533147   870 ts_tablet_manager.cc:1434] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:20:35.533177   869 raft_consensus.cc:359] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.534797   869 raft_consensus.cc:385] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.535173   869 raft_consensus.cc:740] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.536123   869 consensus_queue.cc:260] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.538815   869 ts_tablet_manager.cc:1434] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:20:35.540138   869 tablet_bootstrap.cc:492] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:35.547398   869 tablet_bootstrap.cc:654] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.545315   574 catalog_manager.cc:5697] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.560813   904 raft_consensus.cc:493] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.561153   869 tablet_bootstrap.cc:492] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:35.561358   904 raft_consensus.cc:515] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.562016   869 ts_tablet_manager.cc:1403] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.005s
I20260709 12:20:35.563724   904 leader_election.cc:290] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.565476   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76704895e0014456af584dbc19a2e56c" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:35.566218   869 raft_consensus.cc:359] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.566668   828 raft_consensus.cc:2468] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 0.
I20260709 12:20:35.567142   869 raft_consensus.cc:385] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.567528   869 raft_consensus.cc:740] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.568742   720 leader_election.cc:304] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:35.568898   869 consensus_queue.cc:260] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.570716   904 raft_consensus.cc:2804] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.571103   904 raft_consensus.cc:493] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.571434   904 raft_consensus.cc:3060] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.571430   869 ts_tablet_manager.cc:1434] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:20:35.572695   869 tablet_bootstrap.cc:492] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:35.567462   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76704895e0014456af584dbc19a2e56c" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.573367   910 raft_consensus.cc:493] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.574760   678 raft_consensus.cc:2468] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 0.
I20260709 12:20:35.574993   910 raft_consensus.cc:515] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.578188   910 leader_election.cc:290] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.579706   869 tablet_bootstrap.cc:654] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.580593   910 raft_consensus.cc:493] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.581453   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.582127   678 raft_consensus.cc:2468] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:35.580549   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:35.583364   754 raft_consensus.cc:2468] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:35.583869   904 raft_consensus.cc:515] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.584638   792 leader_election.cc:304] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:35.586213   876 raft_consensus.cc:2804] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.586611   876 raft_consensus.cc:493] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.586937   876 raft_consensus.cc:3060] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.587455   869 tablet_bootstrap.cc:492] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:35.587184   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76704895e0014456af584dbc19a2e56c" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:35.588002   869 ts_tablet_manager.cc:1403] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:20:35.587962   828 raft_consensus.cc:3060] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.590472   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76704895e0014456af584dbc19a2e56c" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:35.591112   869 raft_consensus.cc:359] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.591995   869 raft_consensus.cc:385] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.591111   678 raft_consensus.cc:3060] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.592300   869 raft_consensus.cc:740] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.595228   869 consensus_queue.cc:260] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.597960   869 ts_tablet_manager.cc:1434] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:20:35.597573   876 raft_consensus.cc:515] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.599041   869 tablet_bootstrap.cc:492] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:35.600693   679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:35.601351   679 raft_consensus.cc:3060] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.593117   577 catalog_manager.cc:5697] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.603664   678 raft_consensus.cc:2468] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 1.
I20260709 12:20:35.604547   828 raft_consensus.cc:2468] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 1.
I20260709 12:20:35.605134   718 leader_election.cc:304] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:35.605819   904 leader_election.cc:290] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.605095   577 catalog_manager.cc:5697] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.606169   875 raft_consensus.cc:2804] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.606737   875 raft_consensus.cc:697] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:35.607223   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:35.607805   754 raft_consensus.cc:3060] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.607583   875 consensus_queue.cc:237] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.581315   910 raft_consensus.cc:515] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.610159   910 leader_election.cc:290] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.610895   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a200b2aab6c4b8bbb60cc5a960e746e" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.611554   677 raft_consensus.cc:2468] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:35.612382   869 tablet_bootstrap.cc:654] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:35.612795   792 leader_election.cc:304] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:35.613690   910 raft_consensus.cc:2804] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.614068   910 raft_consensus.cc:493] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.614416   910 raft_consensus.cc:3060] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.621335   754 raft_consensus.cc:2468] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:35.622733   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a200b2aab6c4b8bbb60cc5a960e746e" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:35.622814   794 leader_election.cc:304] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:35.624337   909 raft_consensus.cc:2804] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.624830   909 raft_consensus.cc:697] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:35.625654   909 consensus_queue.cc:237] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.626490   876 leader_election.cc:290] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.627455   904 raft_consensus.cc:493] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.628137   904 raft_consensus.cc:515] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
W20260709 12:20:35.631256   794 leader_election.cc:343] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:35.633353   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b53844068f46e59529347c65d0dd34" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.635388   869 tablet_bootstrap.cc:492] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:35.635262   679 raft_consensus.cc:2468] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:35.636090   869 ts_tablet_manager.cc:1403] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.012s
I20260709 12:20:35.637038   904 leader_election.cc:290] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.634578   678 raft_consensus.cc:2468] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 0.
I20260709 12:20:35.638540   718 leader_election.cc:304] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:35.640497   869 raft_consensus.cc:359] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.641562   869 raft_consensus.cc:385] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:35.641718   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b53844068f46e59529347c65d0dd34" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:35.642143   869 raft_consensus.cc:740] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:35.642499   828 raft_consensus.cc:2468] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 0.
I20260709 12:20:35.643011   869 consensus_queue.cc:260] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.643110   910 raft_consensus.cc:515] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.641376   875 raft_consensus.cc:2804] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:35.644032   875 raft_consensus.cc:493] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:35.644387   875 raft_consensus.cc:3060] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.646246   679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a200b2aab6c4b8bbb60cc5a960e746e" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:35.646698   910 leader_election.cc:290] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:35.647279   679 raft_consensus.cc:3060] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.649756   574 catalog_manager.cc:5697] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.651188   869 ts_tablet_manager.cc:1434] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:20:35.657433   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a200b2aab6c4b8bbb60cc5a960e746e" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:35.657630   679 raft_consensus.cc:2468] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:35.658164   753 raft_consensus.cc:3060] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.657449   875 raft_consensus.cc:515] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.659168   792 leader_election.cc:304] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:35.660061   875 leader_election.cc:290] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.661059   679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b53844068f46e59529347c65d0dd34" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:35.661202   910 raft_consensus.cc:2804] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.661691   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74b53844068f46e59529347c65d0dd34" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:35.661742   679 raft_consensus.cc:3060] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.662438   828 raft_consensus.cc:3060] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.661862   910 raft_consensus.cc:697] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:35.663807   910 consensus_queue.cc:237] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.669178   753 raft_consensus.cc:2468] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:35.670322   828 raft_consensus.cc:2468] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 1.
I20260709 12:20:35.670524   679 raft_consensus.cc:2468] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 1.
I20260709 12:20:35.671419   720 leader_election.cc:304] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:35.672331   875 raft_consensus.cc:2804] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:35.673004   875 raft_consensus.cc:697] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:35.673852   875 consensus_queue.cc:237] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.677469   577 catalog_manager.cc:5697] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.684520   574 catalog_manager.cc:5697] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.691864   577 catalog_manager.cc:5697] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:35.722538   753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088"
dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
mode: GRACEFUL
new_leader_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:49752
I20260709 12:20:35.723204   753 raft_consensus.cc:606] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Received request to transfer leadership to TS 5e36102ff7c240679f201426474eb1bb
I20260709 12:20:35.737097   828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52dbd030c34142f6b9df9e58a053c5c5"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
mode: GRACEFUL
new_leader_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:20:35.737812   828 raft_consensus.cc:606] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Received request to transfer leadership to TS 5e36102ff7c240679f201426474eb1bb
I20260709 12:20:35.738665   875 raft_consensus.cc:493] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.739156   875 raft_consensus.cc:515] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.740854   875 leader_election.cc:290] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.741652   679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.741967   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:35.742525   679 raft_consensus.cc:2393] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f76e6f821f0a4006851a42b049e524e3 in current term 1: Already voted for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in this term.
I20260709 12:20:35.743530   753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "76704895e0014456af584dbc19a2e56c"
dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
mode: GRACEFUL
new_leader_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:49752
I20260709 12:20:35.743656   718 leader_election.cc:304] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f76e6f821f0a4006851a42b049e524e3; no voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:35.744064   753 raft_consensus.cc:606] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Received request to transfer leadership to TS 5e36102ff7c240679f201426474eb1bb
I20260709 12:20:35.744412   875 raft_consensus.cc:3060] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.750065   828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
mode: GRACEFUL
new_leader_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:20:35.750926   875 raft_consensus.cc:2749] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.750948   828 raft_consensus.cc:606] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Received request to transfer leadership to TS f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.759215   828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
mode: GRACEFUL
new_leader_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:20:35.759722   828 raft_consensus.cc:606] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Received request to transfer leadership to TS f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.764514   828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
mode: GRACEFUL
new_leader_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:20:35.764999   828 raft_consensus.cc:606] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Received request to transfer leadership to TS f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:35.772632   889 consensus_queue.cc:1048] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:35.784159   889 consensus_queue.cc:1048] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:35.822667   875 raft_consensus.cc:493] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:35.823170   875 raft_consensus.cc:515] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.825021   875 leader_election.cc:290] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.825791   679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:35.825979   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:35.826553   679 raft_consensus.cc:2393] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f76e6f821f0a4006851a42b049e524e3 in current term 1: Already voted for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in this term.
I20260709 12:20:35.827509   720 leader_election.cc:304] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f76e6f821f0a4006851a42b049e524e3; no voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:35.828434   875 raft_consensus.cc:3060] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:35.834934   875 raft_consensus.cc:2749] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:35.914152   910 consensus_queue.cc:1048] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:35.920872   909 raft_consensus.cc:993] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f: : Instructing follower f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:35.921370   876 raft_consensus.cc:1081] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Signalling peer f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:35.926057   876 consensus_queue.cc:1048] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:35.927589   753 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2"
dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:46690
I20260709 12:20:35.928259   753 raft_consensus.cc:493] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:35.928656   753 raft_consensus.cc:3060] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:35.935433   753 raft_consensus.cc:515] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.937850   875 consensus_queue.cc:1048] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:35.938938   753 leader_election.cc:290] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.940500   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:35.940981   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:35.941171   828 raft_consensus.cc:3055] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:35.941556   828 raft_consensus.cc:740] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:35.942458   828 consensus_queue.cc:260] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.943908   828 raft_consensus.cc:3060] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:35.947772   904 raft_consensus.cc:993] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3: : Instructing follower 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:35.948545   875 raft_consensus.cc:1081] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Signalling peer 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:35.950455   679 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088"
dest_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:59860
I20260709 12:20:35.951627   679 raft_consensus.cc:493] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:35.952839   828 raft_consensus.cc:2468] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:35.953118   679 raft_consensus.cc:3060] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:35.954216   720 leader_election.cc:304] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 5e36102ff7c240679f201426474eb1bb
I20260709 12:20:35.955173   875 raft_consensus.cc:2804] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:35.955767   875 raft_consensus.cc:697] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:35.956835   875 consensus_queue.cc:237] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.963304   938 consensus_queue.cc:1048] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:35.965982   574 catalog_manager.cc:5697] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 1 to 2, leader changed from abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3) to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:35.966624   679 raft_consensus.cc:515] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.969887   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:35.970501   753 raft_consensus.cc:3055] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:35.970799   753 raft_consensus.cc:740] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:35.971201   827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:35.971774   753 consensus_queue.cc:260] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.972612   679 leader_election.cc:290] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:35.972747   753 raft_consensus.cc:3060] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:35.981359   753 raft_consensus.cc:2468] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:35.982535   645 leader_election.cc:304] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:35.983343   931 raft_consensus.cc:2804] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:35.983876   931 raft_consensus.cc:697] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:35.985103   931 consensus_queue.cc:237] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:35.993047   577 catalog_manager.cc:5697] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 1 to 2, leader changed from f76e6f821f0a4006851a42b049e524e3 (127.22.48.2) to 5e36102ff7c240679f201426474eb1bb (127.22.48.1). New cstate: current_term: 2 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:36.050208   876 consensus_queue.cc:1048] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.054263   914 consensus_queue.cc:1048] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.058354   909 raft_consensus.cc:993] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f: : Instructing follower f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:36.058843   909 raft_consensus.cc:1081] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Signalling peer f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:36.060945   754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65"
dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:46690
I20260709 12:20:36.063623   754 raft_consensus.cc:493] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:36.064101   754 raft_consensus.cc:3060] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.065359   876 consensus_queue.cc:1048] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:36.069981   914 consensus_queue.cc:1048] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.071511   909 consensus_queue.cc:1048] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.075974   754 raft_consensus.cc:515] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.082988   676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:36.090448   754 leader_election.cc:290] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:36.091022   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:36.091668   828 raft_consensus.cc:3055] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:36.091959   828 raft_consensus.cc:740] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:36.092839   828 consensus_queue.cc:260] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.093861   828 raft_consensus.cc:3060] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.094973   914 raft_consensus.cc:993] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f: : Instructing follower f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:36.095475   910 raft_consensus.cc:1081] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Signalling peer f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:36.095988   875 consensus_queue.cc:1048] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.099522   754 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6"
dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:46690
I20260709 12:20:36.100129   754 raft_consensus.cc:493] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:36.100512   754 raft_consensus.cc:3060] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.103397   909 raft_consensus.cc:993] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: : Instructing follower 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:36.105264   876 raft_consensus.cc:1081] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Signalling peer 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:36.110353   876 consensus_queue.cc:1048] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.111218   678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52dbd030c34142f6b9df9e58a053c5c5"
dest_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:59844
I20260709 12:20:36.111871   678 raft_consensus.cc:493] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:36.112217   678 raft_consensus.cc:3060] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.118719   938 consensus_queue.cc:1048] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.119688   678 raft_consensus.cc:515] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.121775   678 leader_election.cc:290] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:36.122321   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dbd030c34142f6b9df9e58a053c5c5" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:36.125361   827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52dbd030c34142f6b9df9e58a053c5c5" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:36.125844   827 raft_consensus.cc:3055] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:36.126137   827 raft_consensus.cc:740] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:36.127012   827 consensus_queue.cc:260] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.128320   827 raft_consensus.cc:3060] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.132401   828 raft_consensus.cc:2468] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:36.133649   720 leader_election.cc:304] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 5e36102ff7c240679f201426474eb1bb
I20260709 12:20:36.134694   938 raft_consensus.cc:2804] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:36.135202   938 raft_consensus.cc:697] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:36.135653   754 raft_consensus.cc:515] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.136261   827 raft_consensus.cc:2468] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:36.136035   938 consensus_queue.cc:237] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.140651   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:36.141440   826 raft_consensus.cc:3055] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:36.141770   826 raft_consensus.cc:740] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:36.141799   938 raft_consensus.cc:993] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3: : Instructing follower 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:36.141861   645 leader_election.cc:304] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:36.142453   875 raft_consensus.cc:1081] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Signalling peer 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:36.142910   889 raft_consensus.cc:2804] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:36.142709   826 consensus_queue.cc:260] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.143462   889 raft_consensus.cc:697] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:36.143972   826 raft_consensus.cc:3060] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.144261   677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "76704895e0014456af584dbc19a2e56c"
dest_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:59860
I20260709 12:20:36.144363   889 consensus_queue.cc:237] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.144948   677 raft_consensus.cc:493] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:36.145335   677 raft_consensus.cc:3060] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.150918   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84aeb1b9ddd94f5892571efe1b32fbd6" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:36.151950   678 raft_consensus.cc:3060] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.154500   677 raft_consensus.cc:515] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.157364   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76704895e0014456af584dbc19a2e56c" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:36.157966   753 raft_consensus.cc:3055] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:36.158304   753 raft_consensus.cc:740] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:36.159096   753 consensus_queue.cc:260] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.159948   753 raft_consensus.cc:3060] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.159101   574 catalog_manager.cc:5697] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 1 to 2, leader changed from abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3) to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:36.163339   677 leader_election.cc:290] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:36.165529   678 raft_consensus.cc:2468] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:36.165665   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76704895e0014456af584dbc19a2e56c" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:36.166255   828 raft_consensus.cc:3060] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.166344   753 raft_consensus.cc:2468] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:36.166781   718 leader_election.cc:304] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:36.167688   875 raft_consensus.cc:2804] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:36.168143   875 raft_consensus.cc:697] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:36.168943   875 consensus_queue.cc:237] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.169966   826 raft_consensus.cc:2468] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:36.170784   754 leader_election.cc:290] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:36.171757   645 leader_election.cc:304] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:36.172602   889 raft_consensus.cc:2804] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:36.173341   889 raft_consensus.cc:697] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:36.174188   828 raft_consensus.cc:2468] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:36.174741   889 consensus_queue.cc:237] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:36.177364   577 catalog_manager.cc:5697] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 1 to 2, leader changed from abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3) to 5e36102ff7c240679f201426474eb1bb (127.22.48.1). New cstate: current_term: 2 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:36.178820   574 catalog_manager.cc:5697] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 1 to 2, leader changed from abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3) to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:36.191627   574 catalog_manager.cc:5697] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 1 to 2, leader changed from f76e6f821f0a4006851a42b049e524e3 (127.22.48.2) to 5e36102ff7c240679f201426474eb1bb (127.22.48.1). New cstate: current_term: 2 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:36.206779   938 consensus_queue.cc:1048] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.217373   875 consensus_queue.cc:1048] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.253000   909 consensus_queue.cc:1048] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.263018   914 consensus_queue.cc:1048] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:36.419256   828 raft_consensus.cc:1275] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.420665   875 consensus_queue.cc:1048] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.427944   678 raft_consensus.cc:3060] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.435469   678 raft_consensus.cc:1275] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.436717   939 consensus_queue.cc:1048] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.533262   754 raft_consensus.cc:1275] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.534497   889 consensus_queue.cc:1048] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.542948   828 raft_consensus.cc:3060] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.549947   828 raft_consensus.cc:1275] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.551301   929 consensus_queue.cc:1048] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.580411   754 raft_consensus.cc:1275] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.581672   929 consensus_queue.cc:1048] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.589211   828 raft_consensus.cc:1275] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.591831   929 consensus_queue.cc:1048] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.616307   828 raft_consensus.cc:1275] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.617484   939 consensus_queue.cc:1048] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.624773   678 raft_consensus.cc:1275] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.626351   875 consensus_queue.cc:1048] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.651659   754 raft_consensus.cc:3060] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.656960   754 raft_consensus.cc:1275] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.658120   929 consensus_queue.cc:1048] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.664938   828 raft_consensus.cc:1275] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.668946   953 consensus_queue.cc:1048] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.681756   828 raft_consensus.cc:1275] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.683379   875 consensus_queue.cc:1048] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:36.690980   678 raft_consensus.cc:3060] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:36.698433   678 raft_consensus.cc:1275] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:36.699561   938 consensus_queue.cc:1048] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:38.797564   577 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38848:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:20:38.800426   577 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:20:38.849485   669 tablet_service.cc:1511] Processing CreateTablet for tablet cf98462c5c07412e8c44d6292419fcfa (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:38.850855   669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf98462c5c07412e8c44d6292419fcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.850649   739 tablet_service.cc:1511] Processing CreateTablet for tablet cf98462c5c07412e8c44d6292419fcfa (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:38.852021   739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf98462c5c07412e8c44d6292419fcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.852391   818 tablet_service.cc:1511] Processing CreateTablet for tablet cf98462c5c07412e8c44d6292419fcfa (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:20:38.853615   818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf98462c5c07412e8c44d6292419fcfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.855865   743 tablet_service.cc:1511] Processing CreateTablet for tablet 7671c3b459f641f58e40d3f395896d84 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:38.857314   743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7671c3b459f641f58e40d3f395896d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.861204   814 tablet_service.cc:1511] Processing CreateTablet for tablet d46ad7594d8a4a07b08d17d8d0aa7036 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:38.862617   814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46ad7594d8a4a07b08d17d8d0aa7036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.863727   665 tablet_service.cc:1511] Processing CreateTablet for tablet 7671c3b459f641f58e40d3f395896d84 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:38.864998   665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7671c3b459f641f58e40d3f395896d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.864656   740 tablet_service.cc:1511] Processing CreateTablet for tablet d46ad7594d8a4a07b08d17d8d0aa7036 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:38.866034   740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46ad7594d8a4a07b08d17d8d0aa7036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.856050   813 tablet_service.cc:1511] Processing CreateTablet for tablet 7671c3b459f641f58e40d3f395896d84 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:20:38.871083   813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7671c3b459f641f58e40d3f395896d84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.871757   664 tablet_service.cc:1511] Processing CreateTablet for tablet d46ad7594d8a4a07b08d17d8d0aa7036 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:20:38.873587   664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d46ad7594d8a4a07b08d17d8d0aa7036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.874372   667 tablet_service.cc:1511] Processing CreateTablet for tablet b9946ab042db4fcc8a860ce5921e7c46 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:38.875097   966 tablet_bootstrap.cc:492] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:38.875746   667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9946ab042db4fcc8a860ce5921e7c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.883589   966 tablet_bootstrap.cc:654] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:38.886245   812 tablet_service.cc:1511] Processing CreateTablet for tablet b9946ab042db4fcc8a860ce5921e7c46 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:38.886132   738 tablet_service.cc:1511] Processing CreateTablet for tablet b9946ab042db4fcc8a860ce5921e7c46 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:20:38.887686   812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9946ab042db4fcc8a860ce5921e7c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.887818   738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9946ab042db4fcc8a860ce5921e7c46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.891400   815 tablet_service.cc:1511] Processing CreateTablet for tablet 4051d53626e04940bfd95acdfba735b5 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:38.892807   815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4051d53626e04940bfd95acdfba735b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.892575   742 tablet_service.cc:1511] Processing CreateTablet for tablet 4051d53626e04940bfd95acdfba735b5 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:38.896793   742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4051d53626e04940bfd95acdfba735b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.899638   669 tablet_service.cc:1511] Processing CreateTablet for tablet 4051d53626e04940bfd95acdfba735b5 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:20:38.900959   669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4051d53626e04940bfd95acdfba735b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.919931   741 tablet_service.cc:1511] Processing CreateTablet for tablet 2d86b9c493904568bcdd1802ce96b5fb (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:38.921967   741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d86b9c493904568bcdd1802ce96b5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.924823   668 tablet_service.cc:1511] Processing CreateTablet for tablet 2d86b9c493904568bcdd1802ce96b5fb (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:38.926556   668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d86b9c493904568bcdd1802ce96b5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.928352   666 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd7bee287004be7962b77fd2706c789 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:38.929667   666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd7bee287004be7962b77fd2706c789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.933254   812 tablet_service.cc:1511] Processing CreateTablet for tablet 2d86b9c493904568bcdd1802ce96b5fb (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:20:38.934610   812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d86b9c493904568bcdd1802ce96b5fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.945554   744 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd7bee287004be7962b77fd2706c789 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:38.947537   744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd7bee287004be7962b77fd2706c789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.965721   811 tablet_service.cc:1511] Processing CreateTablet for tablet 3cd7bee287004be7962b77fd2706c789 (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:20:38.967262   811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3cd7bee287004be7962b77fd2706c789. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.980877   968 tablet_bootstrap.cc:492] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:38.983600   737 tablet_service.cc:1511] Processing CreateTablet for tablet 0abe181171324691b610c1d3c2b6168d (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:38.985069   737 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abe181171324691b610c1d3c2b6168d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:38.988036   966 tablet_bootstrap.cc:492] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:38.988582   966 ts_tablet_manager.cc:1403] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.114s	user 0.053s	sys 0.008s
I20260709 12:20:38.992687   665 tablet_service.cc:1511] Processing CreateTablet for tablet 0abe181171324691b610c1d3c2b6168d (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:38.994019   665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abe181171324691b610c1d3c2b6168d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:39.002691   968 tablet_bootstrap.cc:654] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.003799   966 raft_consensus.cc:359] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.004642   966 raft_consensus.cc:385] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.004964   966 raft_consensus.cc:740] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.013444   968 tablet_bootstrap.cc:492] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:39.014117   968 ts_tablet_manager.cc:1403] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.005s
I20260709 12:20:39.005741   966 consensus_queue.cc:260] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.013827   813 tablet_service.cc:1511] Processing CreateTablet for tablet 0abe181171324691b610c1d3c2b6168d (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:20:39.017310   813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0abe181171324691b610c1d3c2b6168d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:39.018126   966 ts_tablet_manager.cc:1434] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:20:39.019248   966 tablet_bootstrap.cc:492] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:39.015864   969 tablet_bootstrap.cc:492] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:39.026171   966 tablet_bootstrap.cc:654] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.035844   968 raft_consensus.cc:359] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.036734   968 raft_consensus.cc:385] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.037019   968 raft_consensus.cc:740] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.037768   968 consensus_queue.cc:260] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.038143   665 tablet_service.cc:1511] Processing CreateTablet for tablet da663516f00d43999d7196387fdb957d (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:39.039686   665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da663516f00d43999d7196387fdb957d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:39.040184   968 ts_tablet_manager.cc:1434] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:20:39.043005   968 tablet_bootstrap.cc:492] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:39.049686   968 tablet_bootstrap.cc:654] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.055611   738 tablet_service.cc:1511] Processing CreateTablet for tablet da663516f00d43999d7196387fdb957d (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:39.056895   738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da663516f00d43999d7196387fdb957d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:39.060166   813 tablet_service.cc:1511] Processing CreateTablet for tablet da663516f00d43999d7196387fdb957d (DEFAULT_TABLE table=soft_deleted_table [id=6190a578c5374334aff904102b04fb08]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:20:39.061457   813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da663516f00d43999d7196387fdb957d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:39.062247   969 tablet_bootstrap.cc:654] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.089840   968 tablet_bootstrap.cc:492] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:39.090509   968 ts_tablet_manager.cc:1403] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.000s
I20260709 12:20:39.093792   968 raft_consensus.cc:359] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.095165   968 raft_consensus.cc:385] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.095492   968 raft_consensus.cc:740] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.096351   966 tablet_bootstrap.cc:492] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:39.097323   969 tablet_bootstrap.cc:492] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:39.096390   968 consensus_queue.cc:260] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.097508   966 ts_tablet_manager.cc:1403] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.079s	user 0.025s	sys 0.034s
I20260709 12:20:39.097851   969 ts_tablet_manager.cc:1403] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.004s
I20260709 12:20:39.100611   966 raft_consensus.cc:359] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.101328   966 raft_consensus.cc:385] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.101671   966 raft_consensus.cc:740] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.102368   966 consensus_queue.cc:260] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.103924   969 raft_consensus.cc:359] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.104461   966 ts_tablet_manager.cc:1434] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:39.099476   968 ts_tablet_manager.cc:1434] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.006s
I20260709 12:20:39.104676   969 raft_consensus.cc:385] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.105474   966 tablet_bootstrap.cc:492] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:39.106480   969 raft_consensus.cc:740] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.107300   969 consensus_queue.cc:260] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.109632   969 ts_tablet_manager.cc:1434] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:20:39.110729   969 tablet_bootstrap.cc:492] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:39.105851   968 tablet_bootstrap.cc:492] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:39.113425   966 tablet_bootstrap.cc:654] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.117379   969 tablet_bootstrap.cc:654] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.120038   968 tablet_bootstrap.cc:654] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.129016   969 tablet_bootstrap.cc:492] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:39.129472   969 ts_tablet_manager.cc:1403] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:20:39.129683   966 tablet_bootstrap.cc:492] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:39.130452   966 ts_tablet_manager.cc:1403] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 12:20:39.131942   968 tablet_bootstrap.cc:492] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:39.132459   968 ts_tablet_manager.cc:1403] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.009s
I20260709 12:20:39.132434   969 raft_consensus.cc:359] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.133013   966 raft_consensus.cc:359] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.133388   969 raft_consensus.cc:385] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.133689   966 raft_consensus.cc:385] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.133745   969 raft_consensus.cc:740] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.134037   966 raft_consensus.cc:740] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.134814   966 consensus_queue.cc:260] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.134653   969 consensus_queue.cc:260] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.135664   968 raft_consensus.cc:359] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.136358   968 raft_consensus.cc:385] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.136632   968 raft_consensus.cc:740] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.136997   966 ts_tablet_manager.cc:1434] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:20:39.137423   968 consensus_queue.cc:260] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.138267   966 tablet_bootstrap.cc:492] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:39.140288   968 ts_tablet_manager.cc:1434] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:20:39.143280   968 tablet_bootstrap.cc:492] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:39.148281   966 tablet_bootstrap.cc:654] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.149559   968 tablet_bootstrap.cc:654] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.150650   969 ts_tablet_manager.cc:1434] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 12:20:39.155009   969 tablet_bootstrap.cc:492] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:39.161082   968 tablet_bootstrap.cc:492] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:39.161438   969 tablet_bootstrap.cc:654] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.161648   968 ts_tablet_manager.cc:1403] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.019s	user 0.002s	sys 0.010s
I20260709 12:20:39.164675   966 tablet_bootstrap.cc:492] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:39.165259   966 ts_tablet_manager.cc:1403] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.009s
I20260709 12:20:39.164898   968 raft_consensus.cc:359] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.165709   968 raft_consensus.cc:385] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.166016   968 raft_consensus.cc:740] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.166891   969 tablet_bootstrap.cc:492] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:39.166801   968 consensus_queue.cc:260] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.167409   969 ts_tablet_manager.cc:1403] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:20:39.167934   966 raft_consensus.cc:359] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.168637   966 raft_consensus.cc:385] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.168912   966 raft_consensus.cc:740] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.169647   968 ts_tablet_manager.cc:1434] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 12:20:39.169595   966 consensus_queue.cc:260] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.170816   968 tablet_bootstrap.cc:492] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:39.170768   961 raft_consensus.cc:493] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.171406   961 raft_consensus.cc:515] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.172331   966 ts_tablet_manager.cc:1434] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:39.173498   961 leader_election.cc:290] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.174600   966 tablet_bootstrap.cc:492] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:39.175336   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051d53626e04940bfd95acdfba735b5" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:39.176513   826 raft_consensus.cc:2468] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 0.
I20260709 12:20:39.178197   720 leader_election.cc:304] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:39.180043   904 raft_consensus.cc:2804] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.180441   904 raft_consensus.cc:493] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.180786   904 raft_consensus.cc:3060] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.181517   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051d53626e04940bfd95acdfba735b5" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
W20260709 12:20:39.183871   718 leader_election.cc:343] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:39.191766   968 tablet_bootstrap.cc:654] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.170464   969 raft_consensus.cc:359] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.195415   969 raft_consensus.cc:385] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.195758   969 raft_consensus.cc:740] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.196483   969 consensus_queue.cc:260] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.198596   969 ts_tablet_manager.cc:1434] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.003s
I20260709 12:20:39.199515   969 tablet_bootstrap.cc:492] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:39.194516   966 tablet_bootstrap.cc:654] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.193670   904 raft_consensus.cc:515] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.208662   969 tablet_bootstrap.cc:654] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.209551   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051d53626e04940bfd95acdfba735b5" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
W20260709 12:20:39.211288   718 leader_election.cc:343] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:39.212584   904 leader_election.cc:290] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.215123   966 tablet_bootstrap.cc:492] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:39.215070   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051d53626e04940bfd95acdfba735b5" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:39.215751   966 ts_tablet_manager.cc:1403] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.006s
I20260709 12:20:39.215785   828 raft_consensus.cc:3060] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.218178   968 tablet_bootstrap.cc:492] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:39.218736   968 ts_tablet_manager.cc:1403] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.009s
I20260709 12:20:39.219264   966 raft_consensus.cc:359] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.219967   966 raft_consensus.cc:385] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.220278   966 raft_consensus.cc:740] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.221004   966 consensus_queue.cc:260] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.221669   968 raft_consensus.cc:359] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.222470   968 raft_consensus.cc:385] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.222855   968 raft_consensus.cc:740] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.223053   966 ts_tablet_manager.cc:1434] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:20:39.224220   966 tablet_bootstrap.cc:492] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:39.223856   968 consensus_queue.cc:260] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.226941   968 ts_tablet_manager.cc:1434] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:39.230175   966 tablet_bootstrap.cc:654] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.232191   828 raft_consensus.cc:2468] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 1.
I20260709 12:20:39.235366   968 tablet_bootstrap.cc:492] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:39.238557   953 raft_consensus.cc:493] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.239341   953 raft_consensus.cc:515] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.241573   953 leader_election.cc:290] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.242799   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9946ab042db4fcc8a860ce5921e7c46" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.246928   720 leader_election.cc:304] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 5e36102ff7c240679f201426474eb1bb
I20260709 12:20:39.247364   754 raft_consensus.cc:2468] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 0.
I20260709 12:20:39.247792   904 raft_consensus.cc:2804] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:39.242799   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9946ab042db4fcc8a860ce5921e7c46" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:39.248201   904 raft_consensus.cc:697] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:39.248340   828 raft_consensus.cc:2468] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 0.
I20260709 12:20:39.248695   645 leader_election.cc:304] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:39.243234   968 tablet_bootstrap.cc:654] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.243602   966 tablet_bootstrap.cc:492] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:39.250102   966 ts_tablet_manager.cc:1403] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.001s
I20260709 12:20:39.249508   953 raft_consensus.cc:2804] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.253656   953 raft_consensus.cc:493] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.249073   904 consensus_queue.cc:237] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.246402   969 tablet_bootstrap.cc:492] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:39.254037   953 raft_consensus.cc:3060] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.254532   969 ts_tablet_manager.cc:1403] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.012s
I20260709 12:20:39.255756   968 tablet_bootstrap.cc:492] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:39.256280   968 ts_tablet_manager.cc:1403] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.005s
I20260709 12:20:39.253316   966 raft_consensus.cc:359] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.256945   966 raft_consensus.cc:385] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.257268   966 raft_consensus.cc:740] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.257977   966 consensus_queue.cc:260] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.258028   969 raft_consensus.cc:359] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.258987   969 raft_consensus.cc:385] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.259344   969 raft_consensus.cc:740] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.259244   968 raft_consensus.cc:359] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.260032   968 raft_consensus.cc:385] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.260495   968 raft_consensus.cc:740] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.260275   969 consensus_queue.cc:260] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.261292   968 consensus_queue.cc:260] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.262786   953 raft_consensus.cc:515] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.263574   968 ts_tablet_manager.cc:1434] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:20:39.264576   968 tablet_bootstrap.cc:492] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:39.265380   953 leader_election.cc:290] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.265916   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9946ab042db4fcc8a860ce5921e7c46" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:39.266546   754 raft_consensus.cc:3060] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.270857   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9946ab042db4fcc8a860ce5921e7c46" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:39.271412   828 raft_consensus.cc:3060] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.272501   909 raft_consensus.cc:493] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.273006   909 raft_consensus.cc:515] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.275112   909 leader_election.cc:290] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.276954   969 ts_tablet_manager.cc:1434] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:20:39.278470   828 raft_consensus.cc:2468] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 1.
I20260709 12:20:39.278820   968 tablet_bootstrap.cc:654] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.279642   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.280596   969 tablet_bootstrap.cc:492] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:39.280792   645 leader_election.cc:304] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:39.281049   966 ts_tablet_manager.cc:1434] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.003s
W20260709 12:20:39.281687   794 leader_election.cc:343] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:39.276887   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:39.282403   966 tablet_bootstrap.cc:492] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:39.282711   678 raft_consensus.cc:2468] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:39.283620   988 raft_consensus.cc:2804] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:39.283898   792 leader_election.cc:304] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:39.284250   988 raft_consensus.cc:697] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:39.274471   574 catalog_manager.cc:5697] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 1 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.288113   909 raft_consensus.cc:2804] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.291337   988 consensus_queue.cc:237] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.291842   909 raft_consensus.cc:493] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.302255   909 raft_consensus.cc:3060] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.303756   968 tablet_bootstrap.cc:492] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:39.297772   969 tablet_bootstrap.cc:654] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.304282   968 ts_tablet_manager.cc:1403] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.008s
I20260709 12:20:39.307513   968 raft_consensus.cc:359] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
W20260709 12:20:39.308202   625 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:39.300272   966 tablet_bootstrap.cc:654] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.308219   968 raft_consensus.cc:385] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.308957   968 raft_consensus.cc:740] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.309211   909 raft_consensus.cc:515] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.309888   968 consensus_queue.cc:260] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.301254   754 raft_consensus.cc:2468] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 1.
I20260709 12:20:39.314101   909 leader_election.cc:290] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.320729   969 tablet_bootstrap.cc:492] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:39.321477   969 ts_tablet_manager.cc:1403] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 12:20:39.324112   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
W20260709 12:20:39.326102   794 leader_election.cc:343] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:39.327198   969 raft_consensus.cc:359] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.327891   969 raft_consensus.cc:385] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.328213   969 raft_consensus.cc:740] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.329000   969 consensus_queue.cc:260] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.329308   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:39.329936   678 raft_consensus.cc:3060] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.330502   966 tablet_bootstrap.cc:492] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:39.330806   969 ts_tablet_manager.cc:1434] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:20:39.331017   966 ts_tablet_manager.cc:1403] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.009s
I20260709 12:20:39.331843   969 tablet_bootstrap.cc:492] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:39.336009   968 ts_tablet_manager.cc:1434] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.031s	user 0.009s	sys 0.007s
I20260709 12:20:39.336453   966 raft_consensus.cc:359] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.339385   966 raft_consensus.cc:385] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.339679   966 raft_consensus.cc:740] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.340377   966 consensus_queue.cc:260] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.337090   968 tablet_bootstrap.cc:492] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:39.341717   988 raft_consensus.cc:493] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.342185   988 raft_consensus.cc:515] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.342855   966 ts_tablet_manager.cc:1434] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:20:39.343909   966 tablet_bootstrap.cc:492] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:39.344195   988 leader_election.cc:290] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.345564   980 raft_consensus.cc:493] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.346052   980 raft_consensus.cc:515] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.346259   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.347648   968 tablet_bootstrap.cc:654] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:39.347743   645 leader_election.cc:343] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:39.348172   980 leader_election.cc:290] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.348897   969 tablet_bootstrap.cc:654] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.349391   828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:39.349850   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:39.350131   828 raft_consensus.cc:2393] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f76e6f821f0a4006851a42b049e524e3 in current term 1: Already voted for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in this term.
I20260709 12:20:39.350507   966 tablet_bootstrap.cc:654] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.351891   718 leader_election.cc:304] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f76e6f821f0a4006851a42b049e524e3; no voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:39.354450   904 raft_consensus.cc:3060] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.359745   968 tablet_bootstrap.cc:492] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:39.360782   988 raft_consensus.cc:493] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.360854   968 ts_tablet_manager.cc:1403] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
I20260709 12:20:39.361560   988 raft_consensus.cc:515] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.363956   988 leader_election.cc:290] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.365636   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf98462c5c07412e8c44d6292419fcfa" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.365394   968 raft_consensus.cc:359] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.366413   754 raft_consensus.cc:2468] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 0.
I20260709 12:20:39.366626   968 raft_consensus.cc:385] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.367168   968 raft_consensus.cc:740] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.368062   968 consensus_queue.cc:260] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.368847   645 leader_election.cc:304] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:39.369771   988 raft_consensus.cc:2804] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.370147   988 raft_consensus.cc:493] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.370507   988 raft_consensus.cc:3060] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.371042   968 ts_tablet_manager.cc:1434] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:20:39.372043   966 tablet_bootstrap.cc:492] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:39.372502   966 ts_tablet_manager.cc:1403] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.017s
I20260709 12:20:39.372865   968 tablet_bootstrap.cc:492] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f: Bootstrap starting.
I20260709 12:20:39.375118   966 raft_consensus.cc:359] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.375792   966 raft_consensus.cc:385] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.376087   966 raft_consensus.cc:740] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.376820   966 consensus_queue.cc:260] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.378304   969 tablet_bootstrap.cc:492] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:39.379165   966 ts_tablet_manager.cc:1434] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:20:39.379078   969 ts_tablet_manager.cc:1403] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.003s
I20260709 12:20:39.379076   968 tablet_bootstrap.cc:654] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.380273   966 tablet_bootstrap.cc:492] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb: Bootstrap starting.
I20260709 12:20:39.382995   678 raft_consensus.cc:2468] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:39.326719   575 catalog_manager.cc:5697] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e36102ff7c240679f201426474eb1bb (127.22.48.1). New cstate: current_term: 1 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.385402   904 raft_consensus.cc:2749] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:39.389694   994 raft_consensus.cc:493] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.390504   992 raft_consensus.cc:493] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.390198   994 raft_consensus.cc:515] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.390982   992 raft_consensus.cc:515] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.392542   994 leader_election.cc:290] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.393080   992 leader_election.cc:290] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.382925   969 raft_consensus.cc:359] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.394786   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf98462c5c07412e8c44d6292419fcfa" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.395140   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abe181171324691b610c1d3c2b6168d" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.386461   966 tablet_bootstrap.cc:654] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.396955   754 raft_consensus.cc:2468] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
W20260709 12:20:39.397751   794 leader_election.cc:343] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:39.398610   794 leader_election.cc:304] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:39.399539   792 leader_election.cc:304] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:39.378259   988 raft_consensus.cc:515] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.394156   969 raft_consensus.cc:385] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.401530   969 raft_consensus.cc:740] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.402340   969 consensus_queue.cc:260] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.403740   754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf98462c5c07412e8c44d6292419fcfa" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:39.404325   754 raft_consensus.cc:3060] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.404803   968 tablet_bootstrap.cc:492] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f: No bootstrap required, opened a new log
I20260709 12:20:39.405292   968 ts_tablet_manager.cc:1403] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.015s
I20260709 12:20:39.407119   909 raft_consensus.cc:2804] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.407528   909 raft_consensus.cc:493] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.407861   909 raft_consensus.cc:3060] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.408707   827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf98462c5c07412e8c44d6292419fcfa" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:39.411926   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf98462c5c07412e8c44d6292419fcfa" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:39.412192   969 ts_tablet_manager.cc:1434] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.032s	user 0.000s	sys 0.007s
I20260709 12:20:39.412783   678 raft_consensus.cc:2393] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in current term 1: Already voted for candidate 5e36102ff7c240679f201426474eb1bb in this term.
I20260709 12:20:39.413307   969 tablet_bootstrap.cc:492] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:39.413992   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abe181171324691b610c1d3c2b6168d" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:39.414657   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:39.414866   677 raft_consensus.cc:2468] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:39.420933   969 tablet_bootstrap.cc:654] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.422104   909 raft_consensus.cc:515] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.423028   994 raft_consensus.cc:2804] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:39.423475   827 raft_consensus.cc:2393] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e36102ff7c240679f201426474eb1bb in current term 1: Already voted for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in this term.
I20260709 12:20:39.427619   988 leader_election.cc:290] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.431069  1001 raft_consensus.cc:493] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.431669  1001 raft_consensus.cc:515] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
W20260709 12:20:39.432215   645 leader_election.cc:343] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:39.432740   645 leader_election.cc:304] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb; no voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:39.434373  1001 leader_election.cc:290] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.431083   792 leader_election.cc:304] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:39.420974   754 raft_consensus.cc:2468] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 1.
I20260709 12:20:39.437146   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da663516f00d43999d7196387fdb957d" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.437737  1001 raft_consensus.cc:2804] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.438127   994 raft_consensus.cc:697] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:39.438205  1001 raft_consensus.cc:493] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.438306   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf98462c5c07412e8c44d6292419fcfa" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:39.438988  1001 raft_consensus.cc:3060] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.439546   826 raft_consensus.cc:2393] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5e36102ff7c240679f201426474eb1bb in current term 1: Already voted for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in this term.
W20260709 12:20:39.441103   794 leader_election.cc:343] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:39.441319   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf98462c5c07412e8c44d6292419fcfa" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:39.440259   909 leader_election.cc:290] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.434181   968 raft_consensus.cc:359] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.442346   753 raft_consensus.cc:2393] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in current term 1: Already voted for candidate 5e36102ff7c240679f201426474eb1bb in this term.
I20260709 12:20:39.442551   968 raft_consensus.cc:385] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.442893   968 raft_consensus.cc:740] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.443616   968 consensus_queue.cc:260] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.444350   953 raft_consensus.cc:2749] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:39.445436   968 ts_tablet_manager.cc:1434] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:20:39.445539   966 tablet_bootstrap.cc:492] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb: No bootstrap required, opened a new log
I20260709 12:20:39.439198   994 consensus_queue.cc:237] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.446352   966 ts_tablet_manager.cc:1403] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb: Time spent bootstrapping tablet: real 0.066s	user 0.025s	sys 0.012s
I20260709 12:20:39.450254   969 tablet_bootstrap.cc:492] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:39.450874   969 ts_tablet_manager.cc:1403] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.015s
I20260709 12:20:39.453959   969 raft_consensus.cc:359] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.454727   969 raft_consensus.cc:385] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.454734   966 raft_consensus.cc:359] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.455386   969 raft_consensus.cc:740] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.455803   966 raft_consensus.cc:385] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.456210   969 consensus_queue.cc:260] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.458158   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf98462c5c07412e8c44d6292419fcfa" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:39.458739   969 ts_tablet_manager.cc:1434] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:39.458986   677 raft_consensus.cc:2393] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in current term 1: Already voted for candidate 5e36102ff7c240679f201426474eb1bb in this term.
I20260709 12:20:39.456180   966 raft_consensus.cc:740] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.459836   969 tablet_bootstrap.cc:492] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:39.459769   966 consensus_queue.cc:260] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.465288   966 ts_tablet_manager.cc:1434] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:20:39.463274  1001 raft_consensus.cc:515] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.467227   969 tablet_bootstrap.cc:654] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.467043   645 leader_election.cc:304] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:39.468627   953 raft_consensus.cc:2804] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:39.469082   953 raft_consensus.cc:697] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:39.470232   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da663516f00d43999d7196387fdb957d" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:39.469897   953 consensus_queue.cc:237] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.471168   677 raft_consensus.cc:2468] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:39.473263   792 leader_election.cc:304] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:39.474839   909 raft_consensus.cc:2749] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:39.474872   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abe181171324691b610c1d3c2b6168d" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:39.473412  1001 leader_election.cc:290] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.475666   753 raft_consensus.cc:3060] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.483870   792 leader_election.cc:304] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:39.485527  1001 raft_consensus.cc:2804] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.490600  1001 raft_consensus.cc:493] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.491097  1001 raft_consensus.cc:3060] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.495484   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abe181171324691b610c1d3c2b6168d" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:39.496404   677 raft_consensus.cc:3060] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.509708   969 tablet_bootstrap.cc:492] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:39.510466   969 ts_tablet_manager.cc:1403] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.019s
I20260709 12:20:39.510988   753 raft_consensus.cc:2468] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:39.512413   794 leader_election.cc:304] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:39.513430   994 raft_consensus.cc:2804] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:39.507406   677 raft_consensus.cc:2468] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:39.514143   994 raft_consensus.cc:697] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:39.514256   969 raft_consensus.cc:359] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.515066   969 raft_consensus.cc:385] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.515339   969 raft_consensus.cc:740] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.515435   994 consensus_queue.cc:237] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.516037   969 consensus_queue.cc:260] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.515764   574 catalog_manager.cc:5697] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.518577   969 ts_tablet_manager.cc:1434] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:39.519466   969 tablet_bootstrap.cc:492] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3: Bootstrap starting.
I20260709 12:20:39.520473   909 raft_consensus.cc:493] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.521173   909 raft_consensus.cc:515] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.525326   969 tablet_bootstrap.cc:654] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:39.525830   909 leader_election.cc:290] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.527186   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7671c3b459f641f58e40d3f395896d84" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:39.528059   677 raft_consensus.cc:2468] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:39.529460   792 leader_election.cc:304] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:39.530566   909 raft_consensus.cc:2804] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.530998   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7671c3b459f641f58e40d3f395896d84" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.531399  1001 raft_consensus.cc:515] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.531999   753 raft_consensus.cc:2468] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:39.531044   909 raft_consensus.cc:493] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.538341   909 raft_consensus.cc:3060] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.541383   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da663516f00d43999d7196387fdb957d" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:39.542243   677 raft_consensus.cc:3060] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.549515   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da663516f00d43999d7196387fdb957d" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
W20260709 12:20:39.551577   794 leader_election.cc:343] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:39.552461  1001 leader_election.cc:290] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.562795   677 raft_consensus.cc:2468] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:39.564098   792 leader_election.cc:304] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:39.565331   994 raft_consensus.cc:2804] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:39.566102   994 raft_consensus.cc:697] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:39.566972   994 consensus_queue.cc:237] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.585601   577 catalog_manager.cc:5697] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e36102ff7c240679f201426474eb1bb (127.22.48.1). New cstate: current_term: 1 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.601509   969 tablet_bootstrap.cc:492] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3: No bootstrap required, opened a new log
I20260709 12:20:39.602061   969 ts_tablet_manager.cc:1403] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.070s
I20260709 12:20:39.584378   909 raft_consensus.cc:515] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.605119   909 leader_election.cc:290] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.605336   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7671c3b459f641f58e40d3f395896d84" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:39.605273   969 raft_consensus.cc:359] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.606117   969 raft_consensus.cc:385] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:39.606149   753 raft_consensus.cc:3060] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.606498   969 raft_consensus.cc:740] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Initialized, Role: FOLLOWER
I20260709 12:20:39.607106   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7671c3b459f641f58e40d3f395896d84" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:39.607220   969 consensus_queue.cc:260] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.607759   677 raft_consensus.cc:3060] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.609436   969 ts_tablet_manager.cc:1434] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:20:39.611733   574 catalog_manager.cc:5697] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.613742   753 raft_consensus.cc:2468] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:39.613555   574 catalog_manager.cc:5697] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.615090   794 leader_election.cc:304] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:39.615988   909 raft_consensus.cc:2804] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:39.618255   909 raft_consensus.cc:697] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:39.619089   909 consensus_queue.cc:237] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.619705   677 raft_consensus.cc:2468] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:39.630913   577 catalog_manager.cc:5697] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.635301   953 raft_consensus.cc:493] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.635838   953 raft_consensus.cc:515] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.637600   953 leader_election.cc:290] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.638315   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd7bee287004be7962b77fd2706c789" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.638990   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd7bee287004be7962b77fd2706c789" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:39.639065   753 raft_consensus.cc:2468] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 0.
I20260709 12:20:39.639577   826 raft_consensus.cc:2468] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 0.
I20260709 12:20:39.640148   645 leader_election.cc:304] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:39.640746   953 raft_consensus.cc:2804] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.641032   953 raft_consensus.cc:493] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.641304   953 raft_consensus.cc:3060] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.645732   677 raft_consensus.cc:3060] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.647583   953 raft_consensus.cc:515] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.649726   953 leader_election.cc:290] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.650475   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd7bee287004be7962b77fd2706c789" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:39.650735   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd7bee287004be7962b77fd2706c789" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:39.650986   753 raft_consensus.cc:3060] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.651348   826 raft_consensus.cc:3060] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.653962   904 consensus_queue.cc:1048] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.657554   753 raft_consensus.cc:2468] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 1.
I20260709 12:20:39.657778   826 raft_consensus.cc:2468] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 1.
I20260709 12:20:39.658844   645 leader_election.cc:304] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:39.659615   953 raft_consensus.cc:2804] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:39.660061   953 raft_consensus.cc:697] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:39.660892   953 consensus_queue.cc:237] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.674180   904 consensus_queue.cc:1048] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.677537   577 catalog_manager.cc:5697] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5e36102ff7c240679f201426474eb1bb (127.22.48.1). New cstate: current_term: 1 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:39.777954   909 raft_consensus.cc:493] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.778546   909 raft_consensus.cc:515] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.780289   909 leader_election.cc:290] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.781144   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:39.781327   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:39.781782   678 raft_consensus.cc:2468] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:39.781961   753 raft_consensus.cc:2468] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 0.
I20260709 12:20:39.782796   792 leader_election.cc:304] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:39.783632   909 raft_consensus.cc:2804] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:39.783910   909 raft_consensus.cc:493] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:39.784162   909 raft_consensus.cc:3060] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.790367   909 raft_consensus.cc:515] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.791874   909 leader_election.cc:290] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:39.793025   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:39.793205   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:39.794140   678 raft_consensus.cc:3060] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.794162   753 raft_consensus.cc:3060] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.801590   753 raft_consensus.cc:2468] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:39.801590   678 raft_consensus.cc:2468] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:39.802947   792 leader_election.cc:304] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:39.803627   909 raft_consensus.cc:2804] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:39.804164   909 raft_consensus.cc:697] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:39.804958   909 consensus_queue.cc:237] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.812316   577 catalog_manager.cc:5697] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 0 to 1, leader changed from <none> to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 1 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:39.835153   909 consensus_queue.cc:1048] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.848349   909 consensus_queue.cc:1048] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:39.876020   953 consensus_queue.cc:1048] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.886174   988 consensus_queue.cc:1048] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.886622  1002 consensus_queue.cc:1048] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:39.899726   988 consensus_queue.cc:1048] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.950001   980 raft_consensus.cc:493] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:39.950517   980 raft_consensus.cc:515] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:39.952237   980 leader_election.cc:290] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:39.952940   678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da663516f00d43999d7196387fdb957d" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:39.953202   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da663516f00d43999d7196387fdb957d" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:39.953797   678 raft_consensus.cc:2393] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f76e6f821f0a4006851a42b049e524e3 in current term 1: Already voted for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in this term.
I20260709 12:20:39.955106   718 leader_election.cc:304] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f76e6f821f0a4006851a42b049e524e3; no voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:39.955857   980 raft_consensus.cc:3060] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:39.961090   980 raft_consensus.cc:2749] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:39.980082   992 consensus_queue.cc:1048] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:39.991816   826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7671c3b459f641f58e40d3f395896d84"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
mode: GRACEFUL
new_leader_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:20:39.992508   826 raft_consensus.cc:606] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Received request to transfer leadership to TS 5e36102ff7c240679f201426474eb1bb
I20260709 12:20:39.996824   909 consensus_queue.cc:1048] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:40.001711   909 consensus_queue.cc:1048] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:40.004248   826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
mode: GRACEFUL
new_leader_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:20:40.005309   826 raft_consensus.cc:606] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Received request to transfer leadership to TS 5e36102ff7c240679f201426474eb1bb
I20260709 12:20:40.016410   909 consensus_queue.cc:1048] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:40.023415   826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
mode: GRACEFUL
new_leader_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:20:40.024027   826 raft_consensus.cc:606] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Received request to transfer leadership to TS f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:40.047482   678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3cd7bee287004be7962b77fd2706c789"
dest_uuid: "5e36102ff7c240679f201426474eb1bb"
mode: GRACEFUL
new_leader_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:49720
I20260709 12:20:40.048049   678 raft_consensus.cc:606] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Received request to transfer leadership to TS f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:40.053527   826 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0abe181171324691b610c1d3c2b6168d"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
mode: GRACEFUL
new_leader_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:56046
I20260709 12:20:40.054001   826 raft_consensus.cc:606] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Received request to transfer leadership to TS f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:40.108711   909 consensus_queue.cc:1048] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:40.115298   994 raft_consensus.cc:993] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f: : Instructing follower 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:40.115787  1001 raft_consensus.cc:1081] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Signalling peer 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:40.117378   677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7671c3b459f641f58e40d3f395896d84"
dest_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:59844
I20260709 12:20:40.118731   677 raft_consensus.cc:493] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:40.119132   677 raft_consensus.cc:3060] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.121181  1001 consensus_queue.cc:1048] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:40.126734   677 raft_consensus.cc:515] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.129807   753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7671c3b459f641f58e40d3f395896d84" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:40.130323   677 leader_election.cc:290] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:40.130702   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7671c3b459f641f58e40d3f395896d84" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:40.131417   826 raft_consensus.cc:3055] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:40.130555   753 raft_consensus.cc:3060] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.131724   826 raft_consensus.cc:740] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:40.132786   826 consensus_queue.cc:260] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.135001   826 raft_consensus.cc:3060] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.139003   753 raft_consensus.cc:2468] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:40.140161   645 leader_election.cc:304] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:40.140928   988 raft_consensus.cc:2804] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.141389   988 raft_consensus.cc:697] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:40.141974   826 raft_consensus.cc:2468] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:40.142210   988 consensus_queue.cc:237] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.149485   575 catalog_manager.cc:5697] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 1 to 2, leader changed from abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3) to 5e36102ff7c240679f201426474eb1bb (127.22.48.1). New cstate: current_term: 2 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.204609   988 consensus_queue.cc:1048] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:40.210712  1002 raft_consensus.cc:993] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb: : Instructing follower f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:40.211266   953 raft_consensus.cc:1081] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Signalling peer f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:40.212838   752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3cd7bee287004be7962b77fd2706c789"
dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:46684
I20260709 12:20:40.214154   752 raft_consensus.cc:493] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:40.214555   752 raft_consensus.cc:3060] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.216281   953 consensus_queue.cc:1048] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:40.221711  1001 consensus_queue.cc:1048] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:40.229337   752 raft_consensus.cc:515] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.232625   752 leader_election.cc:290] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:40.239687   992 consensus_queue.cc:1048] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:40.233615   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd7bee287004be7962b77fd2706c789" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:40.240960   677 raft_consensus.cc:3055] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:40.241291   677 raft_consensus.cc:740] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:40.242097   677 consensus_queue.cc:260] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.233826   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3cd7bee287004be7962b77fd2706c789" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:40.243562   826 raft_consensus.cc:3060] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.247625   677 raft_consensus.cc:3060] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.251390   826 raft_consensus.cc:2468] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:40.252674   720 leader_election.cc:304] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:40.253872   980 raft_consensus.cc:2804] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.254417   980 raft_consensus.cc:697] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:40.255355   980 consensus_queue.cc:237] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.255751   677 raft_consensus.cc:2468] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:40.258031  1001 raft_consensus.cc:993] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f: : Instructing follower f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:40.258533   992 raft_consensus.cc:1081] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Signalling peer f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:40.259959   752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb"
dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:46690
I20260709 12:20:40.260434   752 raft_consensus.cc:493] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:40.260766   752 raft_consensus.cc:3060] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.266767   752 raft_consensus.cc:515] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.268342   752 leader_election.cc:290] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:40.269284   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:40.269285   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d86b9c493904568bcdd1802ce96b5fb" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:40.270146   677 raft_consensus.cc:3060] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.270437   826 raft_consensus.cc:3055] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:40.270830   826 raft_consensus.cc:740] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:40.271641   826 consensus_queue.cc:260] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.272683   826 raft_consensus.cc:3060] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.273221   574 catalog_manager.cc:5697] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 1 to 2, leader changed from 5e36102ff7c240679f201426474eb1bb (127.22.48.1) to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.277037   677 raft_consensus.cc:2468] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:40.278513   718 leader_election.cc:304] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:40.278594   826 raft_consensus.cc:2468] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:40.279435  1035 raft_consensus.cc:2804] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.279999  1035 raft_consensus.cc:697] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:40.280820  1035 consensus_queue.cc:237] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.288234   574 catalog_manager.cc:5697] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 1 to 2, leader changed from abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3) to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.317880  1001 raft_consensus.cc:993] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f: : Instructing follower 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:40.318434   992 raft_consensus.cc:1081] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Signalling peer 5e36102ff7c240679f201426474eb1bb to start an election
I20260709 12:20:40.319860   677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036"
dest_uuid: "5e36102ff7c240679f201426474eb1bb"
 from {username='slave'} at 127.0.0.1:59844
I20260709 12:20:40.320334   677 raft_consensus.cc:493] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:40.320667   677 raft_consensus.cc:3060] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.326877   677 raft_consensus.cc:515] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.328589   677 leader_election.cc:290] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:40.329509   826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:40.329521   752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d46ad7594d8a4a07b08d17d8d0aa7036" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:40.330204   826 raft_consensus.cc:3055] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:40.330503   752 raft_consensus.cc:3060] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.330616   826 raft_consensus.cc:740] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:40.331761   826 consensus_queue.cc:260] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.333078   826 raft_consensus.cc:3060] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.339829   826 raft_consensus.cc:2468] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:40.340130   752 raft_consensus.cc:2468] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:40.340857   645 leader_election.cc:304] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:40.341769  1002 raft_consensus.cc:2804] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.342612  1002 raft_consensus.cc:697] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:40.343441  1002 consensus_queue.cc:237] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.349993   574 catalog_manager.cc:5697] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 1 to 2, leader changed from abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3) to 5e36102ff7c240679f201426474eb1bb (127.22.48.1). New cstate: current_term: 2 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.575634   992 raft_consensus.cc:993] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f: : Instructing follower f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:40.576145   994 raft_consensus.cc:1081] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Signalling peer f76e6f821f0a4006851a42b049e524e3 to start an election
I20260709 12:20:40.577597   752 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0abe181171324691b610c1d3c2b6168d"
dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
 from {username='slave'} at 127.0.0.1:46690
I20260709 12:20:40.578111   752 raft_consensus.cc:493] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:40.578538   752 raft_consensus.cc:3060] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.583427   752 raft_consensus.cc:515] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.585279   752 leader_election.cc:290] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:40.586326   827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abe181171324691b610c1d3c2b6168d" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:40.586585   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0abe181171324691b610c1d3c2b6168d" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:40.587035   827 raft_consensus.cc:3055] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:40.587378   677 raft_consensus.cc:3060] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.588559   827 raft_consensus.cc:740] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:40.589448   827 consensus_queue.cc:260] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.590907   827 raft_consensus.cc:3060] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:40.594985   677 raft_consensus.cc:2468] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:40.596000   718 leader_election.cc:304] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:40.596654  1035 raft_consensus.cc:2804] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:40.596917   827 raft_consensus.cc:2468] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 2.
I20260709 12:20:40.597195  1035 raft_consensus.cc:697] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Becoming Leader. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:40.598097  1035 consensus_queue.cc:237] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:40.604267   574 catalog_manager.cc:5697] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 reported cstate change: term changed from 1 to 2, leader changed from abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3) to f76e6f821f0a4006851a42b049e524e3 (127.22.48.2). New cstate: current_term: 2 leader_uuid: "f76e6f821f0a4006851a42b049e524e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:40.637555   827 raft_consensus.cc:1275] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.638813   988 consensus_queue.cc:1048] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.646404   752 raft_consensus.cc:1275] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.648207   953 consensus_queue.cc:1048] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.706698   677 raft_consensus.cc:1275] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.707873  1035 consensus_queue.cc:1048] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.717653   827 raft_consensus.cc:1275] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.719515  1035 consensus_queue.cc:1048] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.743940   752 raft_consensus.cc:1275] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.745064   953 consensus_queue.cc:1048] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.752506   827 raft_consensus.cc:1275] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.754076   988 consensus_queue.cc:1048] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.829290   827 raft_consensus.cc:1275] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.830700  1036 consensus_queue.cc:1048] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:40.837647   677 raft_consensus.cc:1275] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:40.838905  1036 consensus_queue.cc:1048] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.145715   827 raft_consensus.cc:1275] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:41.147154   904 consensus_queue.cc:1048] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:41.159971   677 raft_consensus.cc:1275] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Refusing update from remote peer f76e6f821f0a4006851a42b049e524e3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:41.161458   904 consensus_queue.cc:1048] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:43.060331   577 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38848:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:20:43.086556   577 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38848:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:20:43.195930 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:20:43.257313  1061 log.cc:927] Time spent T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:20:43.392716  1086 tablet.cc:1724] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.449370  1094 tablet.cc:1724] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:43.484768  1090 log.cc:927] Time spent T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:20:43.495615  1093 log.cc:927] Time spent T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:20:43.502442  1098 tablet.cc:1724] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.513657  1106 tablet.cc:1724] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:20:43.534709  1087 log.cc:927] Time spent T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:20:43.504753  1096 tablet.cc:1724] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.533000  1101 tablet.cc:1724] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.571980  1102 tablet.cc:1724] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.578619  1105 tablet.cc:1724] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.585335  1107 tablet.cc:1724] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.585536  1109 tablet.cc:1724] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.599498  1110 tablet.cc:1724] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.604485  1112 tablet.cc:1724] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.607807   677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088"
dest_uuid: "5e36102ff7c240679f201426474eb1bb"
mode: GRACEFUL
new_leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
 from {username='slave'} at 127.0.0.1:49734
I20260709 12:20:43.611985   677 raft_consensus.cc:606] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Received request to transfer leadership to TS abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:43.618713  1106 tablet.cc:1724] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.634310  1106 tablet.cc:1724] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.635068  1098 tablet.cc:1724] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.641170  1086 tablet.cc:1724] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.648057  1105 tablet.cc:1724] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.658555  1110 tablet.cc:1724] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.653618  1112 tablet.cc:1724] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.662045  1106 tablet.cc:1724] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.665859  1098 tablet.cc:1724] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.678841  1096 tablet.cc:1724] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.682906  1094 tablet.cc:1724] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.692021  1101 tablet.cc:1724] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.700037  1096 tablet.cc:1724] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.717262   749 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2"
dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
mode: GRACEFUL
new_leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
 from {username='slave'} at 127.0.0.1:49762
I20260709 12:20:43.717983   749 raft_consensus.cc:606] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Received request to transfer leadership to TS abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:43.719831 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:43.720512 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:43.722070  1105 tablet.cc:1724] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.728614  1102 tablet.cc:1724] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:20:43.753630   577 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a: soft_deleted_table [id=6190a578c5374334aff904102b04fb08] alter complete (version 1)
I20260709 12:20:43.780959  1068 raft_consensus.cc:993] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb: : Instructing follower abef0c1ae4a3407c9eb0d6c8e8bff12f to start an election
I20260709 12:20:43.781630  1071 raft_consensus.cc:1081] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Signalling peer abef0c1ae4a3407c9eb0d6c8e8bff12f to start an election
I20260709 12:20:43.783245   824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
 from {username='slave'} at 127.0.0.1:51928
I20260709 12:20:43.783779   824 raft_consensus.cc:493] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:43.784140   824 raft_consensus.cc:3060] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.789759   824 raft_consensus.cc:515] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:43.791597   824 leader_election.cc:290] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 3 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:43.792467   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:43.792749   749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7eae1dca1c4648a3b18ef3fcdc425088" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:43.793282   677 raft_consensus.cc:3055] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:43.793375   749 raft_consensus.cc:3060] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.793684   677 raft_consensus.cc:740] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:43.794874   677 consensus_queue.cc:260] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:43.796592   677 raft_consensus.cc:3060] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:43.799412   749 raft_consensus.cc:2468] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 3.
I20260709 12:20:43.800736   794 leader_election.cc:304] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:43.801720  1076 raft_consensus.cc:2804] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:43.802098  1076 raft_consensus.cc:697] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:43.802345   677 raft_consensus.cc:2468] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 3.
I20260709 12:20:43.803052  1076 consensus_queue.cc:237] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:43.812574   574 catalog_manager.cc:5697] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 2 to 3, leader changed from 5e36102ff7c240679f201426474eb1bb (127.22.48.1) to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 3 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.008787  1035 raft_consensus.cc:993] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3: : Instructing follower abef0c1ae4a3407c9eb0d6c8e8bff12f to start an election
I20260709 12:20:44.009429  1070 raft_consensus.cc:1081] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Signalling peer abef0c1ae4a3407c9eb0d6c8e8bff12f to start an election
I20260709 12:20:44.011067   824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2"
dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
 from {username='slave'} at 127.0.0.1:51930
I20260709 12:20:44.011511   824 raft_consensus.cc:493] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:44.011777   824 raft_consensus.cc:3060] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.017894   824 raft_consensus.cc:515] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:44.019757   824 leader_election.cc:290] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 3 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:44.020442   677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:44.020731   749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d71a0f64b1dc4dda90150708045fc6c2" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:44.021186   677 raft_consensus.cc:3060] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.021311   749 raft_consensus.cc:3055] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:20:44.021703   749 raft_consensus.cc:740] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f76e6f821f0a4006851a42b049e524e3, State: Running, Role: LEADER
I20260709 12:20:44.022547   749 consensus_queue.cc:260] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:44.023622   749 raft_consensus.cc:3060] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:44.026399   677 raft_consensus.cc:2468] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 3.
I20260709 12:20:44.027676   792 leader_election.cc:304] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 
I20260709 12:20:44.028373  1076 raft_consensus.cc:2804] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:44.028825   749 raft_consensus.cc:2468] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 3.
I20260709 12:20:44.028873  1076 raft_consensus.cc:697] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 LEADER]: Becoming Leader. State: Replica: abef0c1ae4a3407c9eb0d6c8e8bff12f, State: Running, Role: LEADER
I20260709 12:20:44.030097  1076 consensus_queue.cc:237] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:44.037812   574 catalog_manager.cc:5697] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f reported cstate change: term changed from 2 to 3, leader changed from f76e6f821f0a4006851a42b049e524e3 (127.22.48.2) to abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3). New cstate: current_term: 3 leader_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:44.184026   749 raft_consensus.cc:1275] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Refusing update from remote peer abef0c1ae4a3407c9eb0d6c8e8bff12f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:44.185235  1076 consensus_queue.cc:1048] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:44.195353   677 raft_consensus.cc:1275] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Refusing update from remote peer abef0c1ae4a3407c9eb0d6c8e8bff12f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:44.197368   994 consensus_queue.cc:1048] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:20:44.595623   749 raft_consensus.cc:1275] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Refusing update from remote peer abef0c1ae4a3407c9eb0d6c8e8bff12f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:44.596701  1076 consensus_queue.cc:1048] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:44.606734   675 raft_consensus.cc:1275] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Refusing update from remote peer abef0c1ae4a3407c9eb0d6c8e8bff12f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:20:44.610198   994 consensus_queue.cc:1048] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:20:44.721602 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:44.728758 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:44.729296 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:45.730571 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:45.736588 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:45.737008 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:46.737947 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:46.743103 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:46.743573 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:47.744573 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:47.750204 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:47.750711 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:48.751708 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:48.756863 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:48.757292 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:49.758317 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:49.764014 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:49.764439 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:50.765481 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:50.771099 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:50.771605 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:20:52.045753   775 debug-util.cc:398] Leaking SignalData structure 0x7b0800176ce0 after lost signal to thread 22723
W20260709 12:20:52.047346   775 debug-util.cc:398] Leaking SignalData structure 0x7b08002d0180 after lost signal to thread 611
W20260709 12:20:52.048731   775 debug-util.cc:398] Leaking SignalData structure 0x7b08003a9d40 after lost signal to thread 703
W20260709 12:20:52.052906   775 debug-util.cc:398] Leaking SignalData structure 0x7b080026c2e0 after lost signal to thread 778
W20260709 12:20:52.077402   775 debug-util.cc:398] Leaking SignalData structure 0x7b0800170e00 after lost signal to thread 852
I20260709 12:20:52.169560  1147 raft_consensus.cc:493] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e36102ff7c240679f201426474eb1bb)
I20260709 12:20:52.170207  1147 raft_consensus.cc:515] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:52.170612  1140 raft_consensus.cc:493] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e36102ff7c240679f201426474eb1bb)
I20260709 12:20:52.171185  1140 raft_consensus.cc:515] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:52.172969  1147 leader_election.cc:290] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:52.174798  1144 raft_consensus.cc:493] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f76e6f821f0a4006851a42b049e524e3)
I20260709 12:20:52.175371  1144 raft_consensus.cc:515] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:52.177570  1144 leader_election.cc:290] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:52.179872  1140 leader_election.cc:290] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:52.180079  1149 raft_consensus.cc:493] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5e36102ff7c240679f201426474eb1bb)
I20260709 12:20:52.180567  1149 raft_consensus.cc:515] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:52.183247  1149 leader_election.cc:290] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:52.186151   676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:52.187786   749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:52.188500   749 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abef0c1ae4a3407c9eb0d6c8e8bff12f in term 1.
I20260709 12:20:52.190709   675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:52.191001   676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9946ab042db4fcc8a860ce5921e7c46" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb" is_pre_election: true
I20260709 12:20:52.193665   794 leader_election.cc:304] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:52.196431   827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:52.197888   827 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f76e6f821f0a4006851a42b049e524e3 in term 1.
I20260709 12:20:52.200938   824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9946ab042db4fcc8a860ce5921e7c46" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:52.201414  1151 raft_consensus.cc:2804] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:52.201905  1151 raft_consensus.cc:493] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e36102ff7c240679f201426474eb1bb)
I20260709 12:20:52.202371  1151 raft_consensus.cc:3060] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.208979   720 leader_election.cc:304] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:52.210089  1147 raft_consensus.cc:2804] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:52.210493  1147 raft_consensus.cc:493] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5e36102ff7c240679f201426474eb1bb)
I20260709 12:20:52.210840  1147 raft_consensus.cc:3060] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.216946  1151 raft_consensus.cc:515] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:52.220762  1147 raft_consensus.cc:515] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:52.222995  1147 leader_election.cc:290] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:52.224292   750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:52.224269   827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afd64dd461c24c6c8fad679e1b948f65" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:52.224995   820 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:52.224275   824 raft_consensus.cc:1240] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Rejecting Update request from peer 5e36102ff7c240679f201426474eb1bb for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:52.227586  1151 leader_election.cc:290] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 2 election: Requested vote from peers 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667), f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369)
I20260709 12:20:52.231530   750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:52.238969   718 leader_election.cc:304] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f76e6f821f0a4006851a42b049e524e3; no voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:52.240022   675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "f76e6f821f0a4006851a42b049e524e3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:52.240227   676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5e36102ff7c240679f201426474eb1bb"
I20260709 12:20:52.241525  1147 raft_consensus.cc:2749] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.280205  1148 consensus_queue.cc:1059] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:52.286485   645 leader_election.cc:304] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb; no voters: abef0c1ae4a3407c9eb0d6c8e8bff12f, f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:52.287797  1155 raft_consensus.cc:2749] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:20:52.289711   792 leader_election.cc:304] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abef0c1ae4a3407c9eb0d6c8e8bff12f; no voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3
I20260709 12:20:52.291159  1140 raft_consensus.cc:2749] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.294466   718 leader_election.cc:304] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f76e6f821f0a4006851a42b049e524e3; no voters: 5e36102ff7c240679f201426474eb1bb, abef0c1ae4a3407c9eb0d6c8e8bff12f
I20260709 12:20:52.297283  1147 raft_consensus.cc:2749] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.298229  1153 raft_consensus.cc:3055] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:52.298861  1153 raft_consensus.cc:740] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:52.300635  1153 consensus_queue.cc:260] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:52.305631  1153 raft_consensus.cc:3060] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:52.658200 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:52.670992 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:52.671671 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:20:53.057873   849 debug-util.cc:398] Leaking SignalData structure 0x7b0800297760 after lost signal to thread 22723
W20260709 12:20:53.059702   849 debug-util.cc:398] Leaking SignalData structure 0x7b0800388be0 after lost signal to thread 611
W20260709 12:20:53.061444   849 debug-util.cc:398] Leaking SignalData structure 0x7b0800148140 after lost signal to thread 703
W20260709 12:20:53.063134   849 debug-util.cc:398] Leaking SignalData structure 0x7b0800210e00 after lost signal to thread 778
W20260709 12:20:53.064733   849 debug-util.cc:398] Leaking SignalData structure 0x7b080026aa60 after lost signal to thread 852
I20260709 12:20:53.673177 22720 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:53.682773 22720 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:20:53.683463 22720 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:53.856038  1153 raft_consensus.cc:493] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.857211  1153 raft_consensus.cc:515] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:53.869460  1153 leader_election.cc:290] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:53.871058   824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" is_pre_election: true
I20260709 12:20:53.871490   749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3" is_pre_election: true
I20260709 12:20:53.872195   824 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:53.872292   749 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 2.
I20260709 12:20:53.874261   645 leader_election.cc:304] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:53.875116  1153 raft_consensus.cc:2804] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:20:53.875546  1153 raft_consensus.cc:493] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.875893  1153 raft_consensus.cc:3060] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.894474  1153 raft_consensus.cc:515] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:53.896670  1153 leader_election.cc:290] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 3 election: Requested vote from peers f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369), abef0c1ae4a3407c9eb0d6c8e8bff12f (127.22.48.3:33605)
I20260709 12:20:53.898145   749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f76e6f821f0a4006851a42b049e524e3"
I20260709 12:20:53.903152   749 raft_consensus.cc:3060] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.901064   824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aac6ec73a137479b9d5f14a053623dc9" candidate_uuid: "5e36102ff7c240679f201426474eb1bb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f"
I20260709 12:20:53.906580   824 raft_consensus.cc:3060] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:20:53.918064   749 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 3.
I20260709 12:20:53.925228   645 leader_election.cc:304] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e36102ff7c240679f201426474eb1bb, f76e6f821f0a4006851a42b049e524e3; no voters: 
I20260709 12:20:53.926357  1160 raft_consensus.cc:2804] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:20:53.927122  1160 raft_consensus.cc:697] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 3 LEADER]: Becoming Leader. State: Replica: 5e36102ff7c240679f201426474eb1bb, State: Running, Role: LEADER
I20260709 12:20:53.928058  1160 consensus_queue.cc:237] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } }
I20260709 12:20:53.930022   824 raft_consensus.cc:2468] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e36102ff7c240679f201426474eb1bb in term 3.
I20260709 12:20:53.956779   575 catalog_manager.cc:5697] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5e36102ff7c240679f201426474eb1bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5e36102ff7c240679f201426474eb1bb" member_type: VOTER last_known_addr { host: "127.22.48.1" port: 41667 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.420570   749 raft_consensus.cc:1275] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:54.422421  1160 consensus_queue.cc:1048] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "f76e6f821f0a4006851a42b049e524e3" member_type: VOTER last_known_addr { host: "127.22.48.2" port: 44369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:20:54.456027   824 raft_consensus.cc:1275] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Refusing update from remote peer 5e36102ff7c240679f201426474eb1bb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:20:54.458250  1153 consensus_queue.cc:1048] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "abef0c1ae4a3407c9eb0d6c8e8bff12f" member_type: VOTER last_known_addr { host: "127.22.48.3" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:20:54.771242 22720 tablet_server.cc:179] TabletServer@127.22.48.1:0 shutting down...
W20260709 12:20:54.831071   718 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
I20260709 12:20:54.847606 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:20:54.850122   718 consensus_peers.cc:597] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 -> Peer 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667): Couldn't send request to peer 5e36102ff7c240679f201426474eb1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:54.851451 22720 tablet_replica.cc:333] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.852952 22720 raft_consensus.cc:2243] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.853864 22720 raft_consensus.cc:2272] T 4051d53626e04940bfd95acdfba735b5 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.858147 22720 tablet_replica.cc:333] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.859252 22720 raft_consensus.cc:2243] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:54.860639 22720 raft_consensus.cc:2272] T 7671c3b459f641f58e40d3f395896d84 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.864540 22720 tablet_replica.cc:333] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.865391 22720 raft_consensus.cc:2243] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:54.866757 22720 raft_consensus.cc:2272] T 52dbd030c34142f6b9df9e58a053c5c5 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.870934 22720 tablet_replica.cc:333] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.871989 22720 raft_consensus.cc:2243] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.872747 22720 raft_consensus.cc:2272] T 1a200b2aab6c4b8bbb60cc5a960e746e P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.877179 22720 tablet_replica.cc:333] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.878185 22720 raft_consensus.cc:2243] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.879071 22720 raft_consensus.cc:2272] T 3cd7bee287004be7962b77fd2706c789 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.883356 22720 tablet_replica.cc:333] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.884317 22720 raft_consensus.cc:2243] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.885155 22720 raft_consensus.cc:2272] T 0abe181171324691b610c1d3c2b6168d P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.889245 22720 tablet_replica.cc:333] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.890235 22720 raft_consensus.cc:2243] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.894778 22720 raft_consensus.cc:2272] T 74b53844068f46e59529347c65d0dd34 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.898509 22720 tablet_replica.cc:333] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.899478 22720 raft_consensus.cc:2243] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:54.900781 22720 raft_consensus.cc:2272] T cf98462c5c07412e8c44d6292419fcfa P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.904723 22720 tablet_replica.cc:333] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.905663 22720 raft_consensus.cc:2243] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.906513 22720 raft_consensus.cc:2272] T d71a0f64b1dc4dda90150708045fc6c2 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.910166 22720 tablet_replica.cc:333] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.911113 22720 raft_consensus.cc:2243] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.911959 22720 raft_consensus.cc:2272] T 2d86b9c493904568bcdd1802ce96b5fb P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:54.912547   718 consensus_peers.cc:597] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 -> Peer 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667): Couldn't send request to peer 5e36102ff7c240679f201426474eb1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:54.915776 22720 tablet_replica.cc:333] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.916854 22720 raft_consensus.cc:2243] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.917711 22720 raft_consensus.cc:2272] T 7eae1dca1c4648a3b18ef3fcdc425088 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.921574 22720 tablet_replica.cc:333] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.922474 22720 raft_consensus.cc:2243] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:54.923769 22720 raft_consensus.cc:2272] T b9946ab042db4fcc8a860ce5921e7c46 P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.927538 22720 tablet_replica.cc:333] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.928503 22720 raft_consensus.cc:2243] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:54.929589 22720 raft_consensus.cc:2272] T d46ad7594d8a4a07b08d17d8d0aa7036 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.933445 22720 tablet_replica.cc:333] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.934235 22720 raft_consensus.cc:2243] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:54.935503 22720 raft_consensus.cc:2272] T 76704895e0014456af584dbc19a2e56c P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.939522 22720 tablet_replica.cc:333] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.940428 22720 raft_consensus.cc:2243] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.944259 22720 raft_consensus.cc:2272] T da663516f00d43999d7196387fdb957d P 5e36102ff7c240679f201426474eb1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.947980 22720 tablet_replica.cc:333] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.948839 22720 raft_consensus.cc:2243] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.949551 22720 raft_consensus.cc:2272] T afd64dd461c24c6c8fad679e1b948f65 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.953047 22720 tablet_replica.cc:333] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.953807 22720 raft_consensus.cc:2243] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:54.954540 22720 raft_consensus.cc:2272] T 84aeb1b9ddd94f5892571efe1b32fbd6 P 5e36102ff7c240679f201426474eb1bb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:54.958246 22720 tablet_replica.cc:333] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb: stopping tablet replica
I20260709 12:20:54.958950 22720 raft_consensus.cc:2243] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:54.959954 22720 raft_consensus.cc:2272] T aac6ec73a137479b9d5f14a053623dc9 P 5e36102ff7c240679f201426474eb1bb [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:54.971549   718 consensus_peers.cc:597] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 -> Peer 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667): Couldn't send request to peer 5e36102ff7c240679f201426474eb1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:54.981110   792 consensus_peers.cc:597] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f -> Peer 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667): Couldn't send request to peer 5e36102ff7c240679f201426474eb1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:54.984403   792 consensus_peers.cc:597] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f -> Peer 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667): Couldn't send request to peer 5e36102ff7c240679f201426474eb1bb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.042804 22720 tablet_server.cc:196] TabletServer@127.22.48.1:0 shutdown complete.
I20260709 12:20:55.102029 22720 tablet_server.cc:179] TabletServer@127.22.48.2:0 shutting down...
W20260709 12:20:55.134164   794 consensus_peers.cc:597] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f -> Peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Couldn't send request to peer f76e6f821f0a4006851a42b049e524e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.160336   792 consensus_peers.cc:597] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f -> Peer 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667): Couldn't send request to peer 5e36102ff7c240679f201426474eb1bb. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:41667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.172461 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:55.173517 22720 tablet_replica.cc:333] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.174553 22720 raft_consensus.cc:2243] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.175367 22720 raft_consensus.cc:2272] T cf98462c5c07412e8c44d6292419fcfa P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.179342 22720 tablet_replica.cc:333] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.180486 22720 raft_consensus.cc:2243] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.181279 22720 raft_consensus.cc:2272] T 7671c3b459f641f58e40d3f395896d84 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.184764 22720 tablet_replica.cc:333] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.185734 22720 raft_consensus.cc:2243] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.186424 22720 raft_consensus.cc:2272] T 52dbd030c34142f6b9df9e58a053c5c5 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.190063 22720 tablet_replica.cc:333] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.191046 22720 raft_consensus.cc:2243] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.191672 22720 raft_consensus.cc:2272] T 1a200b2aab6c4b8bbb60cc5a960e746e P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.195114 22720 tablet_replica.cc:333] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.196029 22720 raft_consensus.cc:2243] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.197346 22720 raft_consensus.cc:2272] T 4051d53626e04940bfd95acdfba735b5 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.200848 22720 tablet_replica.cc:333] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.201757 22720 raft_consensus.cc:2243] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.202399 22720 raft_consensus.cc:2272] T da663516f00d43999d7196387fdb957d P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.205724 22720 tablet_replica.cc:333] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.206398 22720 raft_consensus.cc:2243] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.207365 22720 raft_consensus.cc:2272] T afd64dd461c24c6c8fad679e1b948f65 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.209826 22720 tablet_replica.cc:333] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.210508 22720 raft_consensus.cc:2243] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.210935 22720 raft_consensus.cc:2272] T aac6ec73a137479b9d5f14a053623dc9 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.214460 22720 tablet_replica.cc:333] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.215058 22720 raft_consensus.cc:2243] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.216095 22720 raft_consensus.cc:2272] T 84aeb1b9ddd94f5892571efe1b32fbd6 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.218523 22720 tablet_replica.cc:333] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.219120 22720 raft_consensus.cc:2243] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.219609 22720 raft_consensus.cc:2272] T d71a0f64b1dc4dda90150708045fc6c2 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.222193 22720 tablet_replica.cc:333] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.222828 22720 raft_consensus.cc:2243] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.223385 22720 raft_consensus.cc:2272] T 76704895e0014456af584dbc19a2e56c P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.225955 22720 tablet_replica.cc:333] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.226581 22720 raft_consensus.cc:2243] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.228109 22720 raft_consensus.cc:2272] T 3cd7bee287004be7962b77fd2706c789 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.231005 22720 tablet_replica.cc:333] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.231537 22720 raft_consensus.cc:2243] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.232579 22720 raft_consensus.cc:2272] T 0abe181171324691b610c1d3c2b6168d P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.235037 22720 tablet_replica.cc:333] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.235589 22720 raft_consensus.cc:2243] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.236657 22720 raft_consensus.cc:2272] T 74b53844068f46e59529347c65d0dd34 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.239297 22720 tablet_replica.cc:333] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.239811 22720 raft_consensus.cc:2243] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.240325 22720 raft_consensus.cc:2272] T d46ad7594d8a4a07b08d17d8d0aa7036 P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.242827 22720 tablet_replica.cc:333] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.243398 22720 raft_consensus.cc:2243] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.244027 22720 raft_consensus.cc:2272] T b9946ab042db4fcc8a860ce5921e7c46 P f76e6f821f0a4006851a42b049e524e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.246594 22720 tablet_replica.cc:333] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.247118 22720 raft_consensus.cc:2243] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.248292 22720 raft_consensus.cc:2272] T 2d86b9c493904568bcdd1802ce96b5fb P f76e6f821f0a4006851a42b049e524e3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.252223 22720 tablet_replica.cc:333] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3: stopping tablet replica
I20260709 12:20:55.252882 22720 raft_consensus.cc:2243] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.253540 22720 raft_consensus.cc:2272] T 7eae1dca1c4648a3b18ef3fcdc425088 P f76e6f821f0a4006851a42b049e524e3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:55.253539   792 consensus_peers.cc:597] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f -> Peer 5e36102ff7c240679f201426474eb1bb (127.22.48.1:41667): Couldn't send request to peer 5e36102ff7c240679f201426474eb1bb. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.1:41667: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:55.303951   794 consensus_peers.cc:597] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f -> Peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Couldn't send request to peer f76e6f821f0a4006851a42b049e524e3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.470111 22720 tablet_server.cc:196] TabletServer@127.22.48.2:0 shutdown complete.
I20260709 12:20:55.519170 22720 tablet_server.cc:179] TabletServer@127.22.48.3:0 shutting down...
W20260709 12:20:55.581713   794 consensus_peers.cc:597] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f -> Peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Couldn't send request to peer f76e6f821f0a4006851a42b049e524e3. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:44369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.583269 22720 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:55.584332 22720 tablet_replica.cc:333] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.585353 22720 raft_consensus.cc:2243] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.586198 22720 raft_consensus.cc:2272] T 7671c3b459f641f58e40d3f395896d84 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.589808 22720 tablet_replica.cc:333] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.590786 22720 raft_consensus.cc:2243] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.591517 22720 raft_consensus.cc:2272] T 4051d53626e04940bfd95acdfba735b5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.595265 22720 tablet_replica.cc:333] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
W20260709 12:20:55.595285   794 consensus_peers.cc:597] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f -> Peer f76e6f821f0a4006851a42b049e524e3 (127.22.48.2:44369): Couldn't send request to peer f76e6f821f0a4006851a42b049e524e3. Status: Network error: Client connection negotiation failed: client connection to 127.22.48.2:44369: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:55.596530 22720 raft_consensus.cc:2243] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.597393 22720 raft_consensus.cc:2272] T cf98462c5c07412e8c44d6292419fcfa P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.600771 22720 tablet_replica.cc:333] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.601732 22720 raft_consensus.cc:2243] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.602442 22720 raft_consensus.cc:2272] T 52dbd030c34142f6b9df9e58a053c5c5 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.606020 22720 tablet_replica.cc:333] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.606915 22720 raft_consensus.cc:2243] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.608047 22720 raft_consensus.cc:2272] T 1a200b2aab6c4b8bbb60cc5a960e746e P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.611189 22720 tablet_replica.cc:333] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.612064 22720 raft_consensus.cc:2243] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.612730 22720 raft_consensus.cc:2272] T 3cd7bee287004be7962b77fd2706c789 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.616056 22720 tablet_replica.cc:333] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.616912 22720 raft_consensus.cc:2243] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.617655 22720 raft_consensus.cc:2272] T 0abe181171324691b610c1d3c2b6168d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.621249 22720 tablet_replica.cc:333] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.622134 22720 raft_consensus.cc:2243] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.622720 22720 raft_consensus.cc:2272] T 74b53844068f46e59529347c65d0dd34 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.625970 22720 tablet_replica.cc:333] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.626930 22720 raft_consensus.cc:2243] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.627744 22720 raft_consensus.cc:2272] T b9946ab042db4fcc8a860ce5921e7c46 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.631451 22720 tablet_replica.cc:333] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.632341 22720 raft_consensus.cc:2243] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.633168 22720 raft_consensus.cc:2272] T d46ad7594d8a4a07b08d17d8d0aa7036 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.636497 22720 tablet_replica.cc:333] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.637362 22720 raft_consensus.cc:2243] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.637953 22720 raft_consensus.cc:2272] T 76704895e0014456af584dbc19a2e56c P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.641186 22720 tablet_replica.cc:333] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.641955 22720 raft_consensus.cc:2243] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.643162 22720 raft_consensus.cc:2272] T d71a0f64b1dc4dda90150708045fc6c2 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.646287 22720 tablet_replica.cc:333] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.647125 22720 raft_consensus.cc:2243] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.647847 22720 raft_consensus.cc:2272] T 2d86b9c493904568bcdd1802ce96b5fb P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.651127 22720 tablet_replica.cc:333] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.651935 22720 raft_consensus.cc:2243] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.653076 22720 raft_consensus.cc:2272] T 7eae1dca1c4648a3b18ef3fcdc425088 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.661258 22720 tablet_replica.cc:333] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.662249 22720 raft_consensus.cc:2243] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.662982 22720 raft_consensus.cc:2272] T 84aeb1b9ddd94f5892571efe1b32fbd6 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.666270 22720 tablet_replica.cc:333] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.667096 22720 raft_consensus.cc:2243] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.667621 22720 raft_consensus.cc:2272] T aac6ec73a137479b9d5f14a053623dc9 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.670585 22720 tablet_replica.cc:333] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.671293 22720 raft_consensus.cc:2243] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:55.672417 22720 raft_consensus.cc:2272] T da663516f00d43999d7196387fdb957d P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:55.675490 22720 tablet_replica.cc:333] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f: stopping tablet replica
I20260709 12:20:55.676167 22720 raft_consensus.cc:2243] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:55.676781 22720 raft_consensus.cc:2272] T afd64dd461c24c6c8fad679e1b948f65 P abef0c1ae4a3407c9eb0d6c8e8bff12f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.496163 22720 tablet_server.cc:196] TabletServer@127.22.48.3:0 shutdown complete.
I20260709 12:20:56.531972 22720 master.cc:562] Master@127.22.48.62:41249 shutting down...
I20260709 12:20:56.555362 22720 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:56.555866 22720 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:56.556136 22720 tablet_replica.cc:333] T 00000000000000000000000000000000 P 479c8a0b3c8f480bb04f19ce86e1227a: stopping tablet replica
I20260709 12:20:56.577049 22720 master.cc:584] Master@127.22.48.62:41249 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (22531 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (43053 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (341848 ms total)
[  PASSED  ] 8 tests.
I20260709 12:20:56.637507 22720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2311 messages since previous log ~33 seconds ago
I20260709 12:20:56.637765 22720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2311 messages since previous log ~33 seconds ago
I20260709 12:20:56.637959 22720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2311 messages since previous log ~33 seconds ago
I20260709 12:20:56.638182 22720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~51 seconds ago
I20260709 12:20:56.638514 22720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~52 seconds ago
I20260709 12:20:56.638721 22720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 2 messages since previous log ~204 seconds ago
I20260709 12:20:56.638913 22720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~140 seconds ago
I20260709 12:20:56.639199 22720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 14 messages since previous log ~1 seconds ago
I20260709 12:20:56.639508 22720 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~21 seconds ago
